Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.6881699s FAIL (2025-10-02 01:11:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.688206641s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.977510093s FAIL (2025-10-02 01:10:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.977539771s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.727176457s FAIL (2025-10-02 01:09:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.727206394s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.684933221s FAIL (2025-10-02 01:09:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.684957988s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.840033005s FAIL (2025-10-02 01:09:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.8400613s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.759961424s FAIL (2025-10-02 01:08:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.759993897s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.55054647s FAIL (2025-10-02 01:07:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.550576054s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.874170428s FAIL (2025-10-02 01:06:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.874192741s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.845003491s FAIL (2025-10-02 01:05:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.845033679s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.713552391s FAIL (2025-10-02 01:04:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.713580365s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.724422187s FAIL (2025-10-02 01:04:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.724440071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001520736s FAIL (2025-10-02 01:04:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001547478s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.278247154s FAIL (2025-10-01 17:37:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.278287469s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.092043795s FAIL (2025-10-01 17:36:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.092082368s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.09934458s FAIL (2025-10-01 17:35:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.099378705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.114825641s FAIL (2025-10-01 17:35:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.114860546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.326877004s FAIL (2025-10-01 17:34:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.326911951s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.281549691s FAIL (2025-10-01 17:33:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.281581503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.248141335s FAIL (2025-10-01 17:32:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.248173557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 6.259669142s FAIL (2025-10-01 17:32:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.259700412s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 6.152452605s FAIL (2025-10-01 17:31:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.152503874s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.300904187s FAIL (2025-10-01 17:30:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.300938233s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.421964451s FAIL (2025-10-01 17:30:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.422006619s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 6.418256778s FAIL (2025-10-01 17:29:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.418287466s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 6.264952255s FAIL (2025-10-01 17:29:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.264988804s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 6.581550022s FAIL (2025-10-01 17:29:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.58158662s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.305279652s FAIL (2025-10-01 17:28:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.305327583s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.194548978s FAIL (2025-10-01 17:27:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.19458201s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 6.27268884s FAIL (2025-10-01 17:26:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.272722345s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.911803387s FAIL (2025-10-01 17:25:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.911839224s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 6.649960637s FAIL (2025-10-01 17:25:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.649989972s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 7.306790662s FAIL (2025-10-01 17:24:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 7.306827933s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 6.023622409s FAIL (2025-10-01 17:24:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.023661144s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.484217101s FAIL (2025-10-01 17:24:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.484255173s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.313538553s FAIL (2025-10-01 17:24:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.313571297s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 6.053817968s FAIL (2025-10-01 17:23:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.053847464s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.481619546s FAIL (2025-10-01 17:23:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.481652359s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [XXXX........................................................] duration: 6.114937259s FAIL (2025-10-01 17:23:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.114964881s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.454724782s FAIL (2025-10-01 17:22:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.454761904s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.498777981s FAIL (2025-10-01 17:21:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.498859016s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [XXXXX.......................................................] duration: 6.051009141s FAIL (2025-10-01 17:21:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.05104527s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.549252779s FAIL (2025-10-01 17:21:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.549289319s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 5 out of 60 is failed (threshold=3) [.XXXXX......................................................] duration: 5.885653143s FAIL (2025-10-01 17:21:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.885680104s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.482093599s FAIL (2025-10-01 17:21:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.482134607s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.540372151s FAIL (2025-10-01 17:20:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.540400725s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 6 out of 60 is failed (threshold=3) [X.XXXXX.....................................................] duration: 5.958062274s FAIL (2025-10-01 17:20:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 5.958095497s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 7 out of 60 is failed (threshold=3) [XX.XXXXX....................................................] duration: 6.006058988s FAIL (2025-10-01 17:20:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.006378467s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.053838837s FAIL (2025-10-01 17:20:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.053876488s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 8 out of 60 is failed (threshold=3) [XXX.XXXXX...................................................] duration: 6.041105471s FAIL (2025-10-01 17:19:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== PAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.690731701 (195h8m44.152824184s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691094853 (195h8m44.153187337s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691382441 (195h8m44.153474924s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691461271 (195h8m44.153553744s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.691890559 (195h8m44.153983042s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692036066 (195h8m44.154128549s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.692627151 (195h8m44.154719634s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693223577 (195h8m44.15531606s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.693839129 (195h8m44.155931612s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.694400127 (195h8m44.1564926s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:58.695526752 (195h8m44.157619235s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Uploading piece... Oct 1 16:39:59.537152040 (195h8m44.999244523s) [upload=171561]: Next returned nil segment Oct 1 16:39:59.537172840 (195h8m44.999265313s) [upload=171561]: Waiting for error group managing segments... Oct 1 16:39:59.920536138 (195h8m45.382628621s) [noise=true , address=81.171.14.70:4039 , piece_id=U2GJQFLF6J3SZG6MO3YPDH42Z5UFOMG6LOTVENC2PGXXHETZCNCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.924789116 (195h8m45.386881589s) [noise=true , address=81.171.14.70:4031 , piece_id=PY5DTFUG22PQMWCFEZACCHXFGYQ7JXBSPO24KRKLYU2M34TPIISA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.928102956 (195h8m45.390195429s) [noise=true , address=81.171.14.70:4044 , piece_id=ZYDYDWTE3DCFAOSMEJ7ATNFQ2YYZ2WSYX2BDXIIFDPZQWR4AKOMQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.930338394 (195h8m45.392430877s) [noise=true , address=81.171.14.70:4026 , piece_id=LMWGOE6B3PGBD77LG5PQVHHFKDI37HTGPNIIEU62PBMNJPXRITSQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.935653474 (195h8m45.397745947s) [noise=true , address=81.171.14.70:4036 , piece_id=GBIBYYNGE4WBCGLOFISPVARWSSSB2NES5OWHJDECAXF635X5P5BQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.949749756 (195h8m45.411842229s) [noise=true , address=81.171.14.70:4027 , piece_id=FDMZ3JFS7G3R5D64PEGJUNAPLS5XQLJQRRRESNTWSYZ3A65EUJTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.951695091 (195h8m45.413787564s) [noise=true , address=89.149.201.147:4005 , piece_id=2KKZENV35CASFLLBW46GGRAPSBDWCTYHSQP4GXVOUOKFI4IWJXTQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993230843 (195h8m45.455323326s) [noise=true , address=89.149.201.147:4010 , piece_id=N7WNTKSLMOXHNJTZV6U2CWTRMSPYSXIOO3EAHMOZPWIKFO7S3PTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:39:59.993476972 (195h8m45.455569455s) [noise=true , address=81.171.14.70:4029 , piece_id=GEL5JRUWLEPM34O65NSKNEKIJ432CMGTZWG7CVWEGSNAZODGHDXA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.017172863 (195h8m45.479265346s) [noise=true , address=81.171.14.70:4046 , piece_id=2CUMYY367LA3AC2PHDV4OHIFKUC42UIFOAV7F3GQHAGYFV4AKWKQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.061335968 (195h8m45.523428452s) [noise=true , address=89.149.201.147:4009 , piece_id=XSCLTHISFKDNF43PIYNIIQGUZOMBRJSGGG46WBGOZA4R3PGAX4LQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.421363861 (195h8m45.883456334s) [noise=true , address=81.171.14.70:4030 , piece_id=OYTGUTI2QYIACPTBJBWDHJFXHI4KINLMAVEGRPYOMXVRFGZYT22Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471366175 (195h8m45.933458658s) [noise=true , address=89.149.201.147:4011 , piece_id=HGYCIF4KHD2ZKL2NXNXET37QSFVLNFIP7N5C4PWCYT4SMTFFNALA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.471783109 (195h8m45.933875592s) [noise=true , address=81.171.14.70:4028 , piece_id=32CUSE6DKDPWAZJKD6K5YWNUHJNKU7YCNV6JRWXFRD7XQWJNRERQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:00.487109153 (195h8m45.949201636s) [noise=true , address=89.149.201.147:4016 , piece_id=U4FZVKBLGD7CHOKQNEOLXZCFVOUDLBJ36HUZHVHF26TD2BRHSBUA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.025421023 (195h8m46.487513506s) [noise=true , address=185.167.204.206:4046 , piece_id=P2UVSWKIBOROFOWOAJKCGUW4RSD73J2LPGFTB2YN2BM5GK4XQURQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.090281840 (195h8m46.552374323s) [noise=true , address=185.167.204.206:4041 , piece_id=ZWNFGLYFRSG5NKDYTKUTGOGQP63BFL3IX4H2BSY5EU3L4ZK35EYQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.096678981 (195h8m46.558771464s) [noise=true , address=185.167.204.206:4062 , piece_id=5U6KCRNKR4ZEWURIAVCRXLXQHKTDPYQHP64JPYCU6WBBE6657JJQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.100958480 (195h8m46.563050963s) [noise=true , address=185.167.204.205:4003 , piece_id=4OVAXQLUQDAPP3QFMPAIE53ANN3JMWMC6BMAKDCWNPQZJE47PMCA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.111861611 (195h8m46.573954094s) [noise=true , address=185.167.204.206:4071 , piece_id=X4LNM5LHQZPDCEUWGPDBGJKW3Q6ZTWFFA4FYSDYIAHE75SI2B7LA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.138578326 (195h8m46.600670809s) [noise=true , address=185.167.204.205:4028 , piece_id=AN5AGJZSJWFDWQTV5S72FU4G2UB72S2UA7T3UBH5YXH2L4PR462A, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.165936301 (195h8m46.628028784s) [noise=true , address=185.167.204.205:4034 , piece_id=VAQGK2GKD7Y3XA7ZOZODMXEMU4JWXKKP45CWTIOD2ML52E2UKQ3Q, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.193714366 (195h8m46.655806849s) [noise=true , address=185.167.204.205:4021 , piece_id=RXVV4THB3XZ3NTBC26ZNKLM73KM2OUSVFADYFXKHP4PYF5VMP3OQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:01.239727935 (195h8m46.701820418s) [noise=true , address=185.167.204.205:4004 , piece_id=DW5BFIHMAKAQNKNH4APGULN7X4NYHIIBWEXDB3E3SDIWII7C4ORQ, seg_pos={0 0}, upload=171561]: Done uploading piece. err: <nil> Oct 1 16:40:58.025638705 (195h9m43.487731178s) [noise=true , address=185.167.204.205:4025 , piece_id=UJGID7MRCCK2RJY6TANV4O7GF6H5GMX6LUN576YHWDUS5Q3JIKZA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1cnhWXZCgZz567E5PAaPyfNKkmsSa4imaWPmfW2ir7U48gYEkp, address:185.167.204.205:4025): protocol: rpc: dial tcp 185.167.204.205:4025: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.025934648 (195h9m43.488027121s) [noise=true , address=185.167.204.206:4065 , piece_id=CAZPWMBCHWJDX4XESWNI23JW2YATCDROBONYUUZKNIADDCGCT7PA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: write tcp 188.166.225.170:49714->185.167.204.206:4065: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 1 16:40:58.026117206 (195h9m43.488209689s) [noise=true , address=185.167.204.206:4040 , piece_id=CFKXF34YU5PPEZWYQ5HPW5ZUCAD2OI3GAECN5X55SBGC327J4HTA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:1F6P8VfgAdXdcXykRHWpik5CDN4aWj7LKrugb8uAThZpAchkdT, address:185.167.204.206:4040): protocol: write tcp 188.166.225.170:59514->185.167.204.206:4040: use of closed network connection; context deadline exceeded Oct 1 16:40:58.026358665 (195h9m43.488451138s) [noise=true , address=185.167.204.205:4023 , piece_id=767QOG2U57S4257DWJLV5ER7IEAWZ3JQTG3PC2U474KQSLWXRQNA, seg_pos={0 0}, upload=171561]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: context deadline exceeded; context deadline exceeded Oct 1 16:40:58.026385056 (195h9m43.488477529s) [seg_pos={0 0}, upload=171561]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Oct 1 16:40:58.192803019 (195h9m43.654895522s) [upload=171561]: Done uploading segments... Oct 1 16:40:58.192837354 (195h9m43.654929827s) [upload=171561]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 6.041136639s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.662130801s FAIL (2025-10-01 17:19:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== batch item: pb.BatchRequestItem_ObjectBegin Oct 1 16:53:03.112165488 (195h21m48.574257971s) [upload=171754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 1 16:53:03.387654633 (195h21m48.849747116s) [seg_pos={0 0}, upload=171754]: Begin upload segment... Oct 1 16:53:03.387742670 (195h21m48.849835153s) [seg_pos={0 0}, upload=171754]: Done begin upload segment. Oct 1 16:53:03.387784950 (195h21m48.849877443s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.388707357 (195h21m48.85079984s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.389327869 (195h21m48.851420352s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390085291 (195h21m48.852177775s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.390602366 (195h21m48.852694849s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391228919 (195h21m48.853321402s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.391722980 (195h21m48.853815473s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.392313033 (195h21m48.854405517s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.393877793 (195h21m48.855970286s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.394403424 (195h21m48.856495907s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395012443 (195h21m48.857104936s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.395723007 (195h21m48.85781549s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.396460240 (195h21m48.858552723s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.397183297 (195h21m48.85927578s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.399393876 (195h21m48.861486349s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:03.401849232 (195h21m48.863941715s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Uploading piece... Oct 1 16:53:05.266626155 (195h21m50.728718638s) [upload=171754]: Next returned nil segment Oct 1 16:53:05.266652726 (195h21m50.728745209s) [upload=171754]: Waiting for error group managing segments... Oct 1 16:53:05.648400446 (195h21m51.110492929s) [noise=true , address=45.91.116.12:4227 , piece_id=4I2O56YL44SVA5UAVXKVEWKBXKJPRN5JN6M5MHAXYEL66EZRLSQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.775052126 (195h21m51.237144609s) [noise=true , address=45.91.116.4:4938 , piece_id=M4LJXFRIKZIHUPLZY6PQQUX7DYEU7VAAIH6FNSADCF4SCZ5FIJJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.858514754 (195h21m51.320607227s) [noise=true , address=45.91.116.9:4263 , piece_id=BRFSF5QT444X3ELLJTP5NMDTUCI4GRCJD4T3PRYSB3OVQHYH64HA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861361796 (195h21m51.323454279s) [noise=true , address=77.90.31.14:4661 , piece_id=JZY6YIYFVVNTGOKKTMVLUUXG6UHFEVUZLH7ZYNQHHD7LIWUBKWUQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.861523945 (195h21m51.323616428s) [noise=true , address=45.91.116.6:4973 , piece_id=TQXS6VL4SCGYPON3QVVSBCQ6M6XNENSYIKYJQILPHCQ3LONG5Q7Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.940727594 (195h21m51.402820077s) [noise=true , address=77.90.31.19:4843 , piece_id=UO6PX5N5IFJWGYROUILE4LL55IMHTDVC6ETSFKWV652UM5KSXN6A, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.967278131 (195h21m51.429370624s) [noise=true , address=77.90.31.11:4553 , piece_id=IQTBMU5NY57CWE6KWSVR2DX326LLZ2EH3MIKPMCAX5NBG5GPSWTQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:05.974543666 (195h21m51.436636149s) [noise=true , address=77.90.31.16:4734 , piece_id=GAMBNVAF6PDMXDXX22DUFDEUNE47HQP33CC5BDSIONOIQKJWVQQA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:06.128826549 (195h21m51.590919032s) [noise=true , address=45.91.116.10:4081 , piece_id=X4BKQ6QH4ATR4OR6KYXHDDZBC2UKOBBWBWCMLV5PKI27IHYC523Q, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:22.822816521 (195h22m8.284909004s) [noise=true , address=145.79.227.4:4186 , piece_id=7CBEHX2ABPEXZPLDDHQF47XXWB7ODMWK63ARK6WBH3YLMRLRF7UA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: <nil> Oct 1 16:53:32.366721322 (195h22m17.828813805s) [noise=true , address=145.79.227.11:4730 , piece_id=SF2LOD2PX6J56QBAEWJ6XXLUZOVJDSUAZTGAHF2TVOBG74AHOXDA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42566->145.79.227.11:4730: use of closed network connection Oct 1 16:53:32.366853464 (195h22m17.828945937s) [noise=true , address=145.79.227.14:4839 , piece_id=CL5DFQNEUONLQPVRQ3OFNW5OJQC44BUEIYKXVBXBAML7ZKGY5ESQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52020->145.79.227.14:4839: use of closed network connection Oct 1 16:53:32.366931632 (195h22m17.829024125s) [noise=true , address=145.79.227.7:4294 , piece_id=RNFLXBJ43JGNLALHHOG4XW6UDGR7M757Y7JUBK6C3XOHO5TMIFAA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40198->145.79.227.7:4294: use of closed network connection Oct 1 16:53:32.366947181 (195h22m17.829039664s) [noise=true , address=145.79.227.12:4767 , piece_id=ILT6CJCPV7NSV2ELEDZJAVGM2N6DUZPAA2RPM4NP346JVAOWG2ZQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: expected piece hash; context deadline exceeded; EOF Oct 1 16:53:32.367022686 (195h22m17.829115169s) [noise=true , address=145.79.227.6:4257 , piece_id=QT53TTFUCHANA55WRHH4KWY3PU5CL6F6ZQXKROE6G2NR4BJK2PJQ, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39766->145.79.227.6:4257: use of closed network connection Oct 1 16:53:32.367078812 (195h22m17.829171295s) [noise=true , address=145.79.227.17:4970 , piece_id=JB7X2SRY7R5IKRW2B46OROP7DXQTOTRWG2X7QQQSHMAPHASKFJFA, seg_pos={0 0}, upload=171754]: Done uploading piece. err: ecclient: upload failed (node:1Fyc4xk3wSbE57sX7JZG3mex5Jwdqb7aey6PXSbCKHzkD7KUVe, address:145.79.227.17:4970): protocol: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53458->145.79.227.17:4970: use of closed network connection Oct 1 16:53:32.367111585 (195h22m17.829204058s) [seg_pos={0 0}, upload=171754]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Oct 1 16:53:32.620429881 (195h22m18.082522364s) [upload=171754]: Done uploading segments... Oct 1 16:53:32.620474186 (195h22m18.08256667s) [upload=171754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 6.662155858s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)