Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.302559341s FAIL (2025-09-27 20:48:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.302708084s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.060961973s FAIL (2025-09-27 20:48:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.061068778s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.483746054s FAIL (2025-09-27 20:47:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.483778907s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 7.29372361s FAIL (2025-09-27 20:46:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 7.293751304s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.135745954s FAIL (2025-09-27 20:45:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.135778836s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.498125258s FAIL (2025-09-27 20:44:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.498154826s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 8.413791234s FAIL (2025-09-27 20:43:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 8.413820611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.047316069s FAIL (2025-09-27 20:43:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.047401341s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.441018842s FAIL (2025-09-27 20:42:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.441048477s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.288533776s FAIL (2025-09-27 20:41:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.288572259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.252182382s FAIL (2025-09-27 20:40:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.25221264s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.103491707s FAIL (2025-09-27 20:40:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 6.103526274s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.006388297s FAIL (2025-09-27 20:40:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=90783]: Done starting upload Sep 27 20:39:50.617859843 (103h8m36.079952326s) [upload=90783]: Uploading segments... Sep 27 20:39:50.618015278 (103h8m36.080107762s) [upload=90783]: Got next segment. Inline: false Sep 27 20:39:50.618068059 (103h8m36.080160542s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 20:39:50.618073910 (103h8m36.080166393s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 20:39:50.895097614 (103h8m36.357190097s) [seg_pos={0 0}, upload=90783]: Begin upload segment... Sep 27 20:39:50.895158801 (103h8m36.357251274s) [seg_pos={0 0}, upload=90783]: Done begin upload segment. Sep 27 20:39:50.895190081 (103h8m36.357282554s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895311401 (103h8m36.357403884s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.895852111 (103h8m36.357944594s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896255138 (103h8m36.358347611s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.896950091 (103h8m36.359042564s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897367737 (103h8m36.35946022s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897553641 (103h8m36.359646124s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.897756698 (103h8m36.359849181s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898204801 (103h8m36.360297284s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898240398 (103h8m36.360332871s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898688792 (103h8m36.360781265s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.898747905 (103h8m36.360840388s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899105576 (103h8m36.361198049s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.899266453 (103h8m36.361358926s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.901584417 (103h8m36.3636769s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:50.902770355 (103h8m36.364862838s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Uploading piece... Sep 27 20:39:52.520290469 (103h8m37.982382942s) [upload=90783]: Next returned nil segment Sep 27 20:39:52.520313484 (103h8m37.982405967s) [upload=90783]: Waiting for error group managing segments... Sep 27 20:39:52.910261185 (103h8m38.372353658s) [noise=true , address=145.79.227.17:4971 , piece_id=CAB2N7I5DRL5EB7B4VP3W2QFY3FL3IDRUGSEAOS2CAOP4RBEIQNQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.915667992 (103h8m38.377760465s) [noise=true , address=145.79.227.18:4006 , piece_id=ODNQEBH6DIZFGIIJIPS433IT4JFDTJ43GA7LL73S6IGSVHYN2B3A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.939145917 (103h8m38.4012384s) [noise=true , address=145.79.227.5:4221 , piece_id=OG342AHDULX5AQFMFD32QJ3ZKZKZT7AXMLAE6PWMDGUIJBBLKLHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.941359793 (103h8m38.403452276s) [noise=true , address=145.79.227.6:4257 , piece_id=7XQPAMXDAQYIDPCFPGUUZ6C3CEOZNLX2J6U7MH4A4NHV6S6QPFVQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.947314151 (103h8m38.409406634s) [noise=true , address=145.79.227.7:4294 , piece_id=2FBXYCXLQYW26Q27PP73QYFBTO4GWSQFJ77UMP6GXV7FOZWTQOZQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.948246286 (103h8m38.410338759s) [noise=true , address=145.79.227.12:4767 , piece_id=MAZW5TM6HR76VZJCUBPC5RIMCHQ6FGYIKBOX2W6IEE3M6USFPCQQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.977714730 (103h8m38.439807213s) [noise=true , address=145.79.227.19:4079 , piece_id=HUOHDOIQDFVAUI2HLVZELCL7NZOOCNQJNE75FM4VLQZ3FNTDC62A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:52.985491959 (103h8m38.447584432s) [noise=true , address=77.90.31.13:4627 , piece_id=TSVRIWQHN4YIQTWJO2FZGTQQVBP64KHVZEKMFVVXIG6H3MOHLCQA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.198290076 (103h8m38.660382559s) [noise=true , address=145.79.227.17:4970 , piece_id=P7HQ24T6AM5WD4MGLZLSKX44G4JB7MYWJGZ3G45OVC6HX2JPXL2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.264807387 (103h8m38.72689987s) [noise=true , address=77.90.31.10:4517 , piece_id=K6444A7SDWGP3KIGP2A3ATTBJGDQQJOEW5B4V5IRISQHQM5K6HIA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.303171990 (103h8m38.765264473s) [noise=true , address=77.90.31.14:4662 , piece_id=GG3J4NZ377D6XNCWQ7QYT6C75L73QP4HIX4GOUEVQBN4KUTO7LYQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:39:53.406309744 (103h8m38.868402227s) [noise=true , address=77.90.31.12:4590 , piece_id=N5ORZC35EYWBF6ME7XRE44DK53A2ZAMFWBW6ACK2CWUSWPGFIWHQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873615449 (103h9m0.335707922s) [noise=true , address=45.91.116.6:4973 , piece_id=6EGU2W5ZEVLBGNBRBLHTEDZ4ODO7KHV4T5UTUVL3TXLDKTZKXH2A, seg_pos={0 0}, upload=90783]: Done uploading piece. err: <nil> Sep 27 20:40:14.873655536 (103h9m0.335748019s) [seg_pos={0 0}, upload=90783]: Segment reached optimal threshold of 13 pieces. Sep 27 20:40:14.873873852 (103h9m0.335966335s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB): protocol: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43238->45.91.116.8:4048: use of closed network connection Sep 27 20:40:14.873883560 (103h9m0.335976043s) [noise=true , address=45.91.116.8:4048 , piece_id=XYSSF5YO3SW5SD4ZBI3VEKIOREFVFPMOSX7Z7EHBEDEWATERFHOA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.873951780 (103h9m0.336044273s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm): protocol: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60024->45.91.116.11:4119: use of closed network connection Sep 27 20:40:14.873979422 (103h9m0.336071906s) [noise=true , address=45.91.116.11:4119 , piece_id=3KPNBD7DPRBPEHLI35VF7NFKRD5P65P4LAN2YNF6SBQOGGWYZ5HA, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874064063 (103h9m0.336156546s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Sep 27 20:40:14.874075806 (103h9m0.336168279s) [noise=true , address=45.91.116.7:4011 , piece_id=CLJPYK4OIGPZONVS5434QGLNNAZB6MLJQUEVN5BJOVE4CJRCTQTQ, seg_pos={0 0}, upload=90783]: Long tail cancellation due to optimal threshold Sep 27 20:40:14.874115121 (103h9m0.336207604s) [seg_pos={0 0}, upload=90783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 27 20:40:14.874208810 (103h9m0.336301293s) [upload=90783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 20:40:14.874215262 (103h9m0.336307745s) [upload=90783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 20:40:15.182126621 (103h9m0.644219104s) [upload=90783]: Done uploading segments... Sep 27 20:40:15.182152621 (103h9m0.644245104s) [upload=90783]: Upload finished. err: <nil> Duration: 30.006488496s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.734904385s FAIL (2025-09-27 20:24:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.73493239s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.836581719s FAIL (2025-09-27 20:23:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.836618048s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.82102343s FAIL (2025-09-27 20:22:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.821058778s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 4.862534455s FAIL (2025-09-27 20:21:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.862566867s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 4.810437723s FAIL (2025-09-27 20:21:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.810468902s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.796750828s FAIL (2025-09-27 20:19:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.796791757s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 4.871807451s FAIL (2025-09-27 20:18:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.871967848s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 4.736106861s FAIL (2025-09-27 20:18:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.736143561s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.715207245s FAIL (2025-09-27 20:17:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.715237242s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 4.81293032s FAIL (2025-09-27 20:17:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.812967118s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.789188321s FAIL (2025-09-27 20:16:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.78922493s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.834047772s FAIL (2025-09-27 20:16:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.834092978s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.89618409s FAIL (2025-09-27 20:15:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.896215191s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.299961501s FAIL (2025-09-27 20:15:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.299994985s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.848172205s FAIL (2025-09-27 20:15:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.848205998s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.988379551s FAIL (2025-09-27 20:14:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.988411974s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.885865311s FAIL (2025-09-27 20:14:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.885893735s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 6.049456201s FAIL (2025-09-27 20:13:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.04948643s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.898928326s FAIL (2025-09-27 20:13:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.898960136s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.X........................................................] duration: 6.105881755s FAIL (2025-09-27 20:12:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.105916042s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 4.812687195s FAIL (2025-09-27 20:12:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.812744455s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.950906301s FAIL (2025-09-27 20:12:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.950931337s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration: 6.071729726s FAIL (2025-09-27 20:11:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.071765284s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.833624116s FAIL (2025-09-27 20:11:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.833663971s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..X.X......................................................] duration: 6.418535317s FAIL (2025-09-27 20:11:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.418570754s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.802151553s FAIL (2025-09-27 20:10:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.802186819s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..X.X.....................................................] duration: 6.047495049s FAIL (2025-09-27 20:09:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.047523503s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.855045844s FAIL (2025-09-27 20:09:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.855087735s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.872875085s FAIL (2025-09-27 20:08:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.872902838s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..X.X....................................................] duration: 6.445181811s FAIL (2025-09-27 20:08:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.445215123s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.832187596s FAIL (2025-09-27 20:08:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.832238473s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X..X.X...................................................] duration: 5.8138157s FAIL (2025-09-27 20:08:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.813849234s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X..X.X..................................................] duration: 6.053166067s FAIL (2025-09-27 20:07:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.053210121s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.992975217s FAIL (2025-09-27 20:07:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.993008642s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.878002879s FAIL (2025-09-27 20:06:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.878037866s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X....X..X.X.................................................] duration: 6.121618988s FAIL (2025-09-27 20:06:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.12165149s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X....X..X.X................................................] duration: 6.103826543s FAIL (2025-09-27 20:05:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.103857491s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)