Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X....X..X.X.......................................] duration: 6.421712514s FAIL (2025-09-27 19:57:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.421745676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X....X..X.X......................................] duration: 6.406416025s FAIL (2025-09-27 19:57:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.406452032s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.813104856s FAIL (2025-09-27 19:57:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.813273146s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X....X..X.X.....................................] duration: 6.005645322s FAIL (2025-09-27 19:56:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.005676551s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X....X..X.X....................................] duration: 6.324527011s FAIL (2025-09-27 19:56:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.324561716s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X....X..X.X...................................] duration: 12.472267132s FAIL (2025-09-27 19:55:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 12.472297831s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.820386871s FAIL (2025-09-27 19:55:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.820427257s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.780780933s FAIL (2025-09-27 19:55:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.78081537s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 4.960217494s FAIL (2025-09-27 19:55:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.960268313s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X....X..X.X..................................] duration: 6.475728739s FAIL (2025-09-27 19:54:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.475770909s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 4.896582731s FAIL (2025-09-27 19:53:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.89661326s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X....X..X.X.................................] duration: 14.583716858s FAIL (2025-09-27 19:53:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 14.583751705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X....X..X.X................................] duration: 6.283410699s FAIL (2025-09-27 19:53:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.283445766s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 4.902224994s FAIL (2025-09-27 19:53:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.902263158s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................X....X..X.X...............................] duration: 6.008035481s FAIL (2025-09-27 19:52:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.008084454s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 4.871557358s FAIL (2025-09-27 19:52:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.871589959s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 4.85680726s FAIL (2025-09-27 19:51:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.856836196s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................X....X..X.X..............................] duration: 6.443817784s FAIL (2025-09-27 19:51:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.443870585s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 4.891278384s FAIL (2025-09-27 19:51:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.891317528s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.787060642s FAIL (2025-09-27 19:50:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.787090669s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................X....X..X.X.............................] duration: 6.473432901s FAIL (2025-09-27 19:50:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.473480541s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 4.855289037s FAIL (2025-09-27 19:49:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.855315247s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................X....X..X.X............................] duration: 6.250985836s FAIL (2025-09-27 19:49:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.2510197s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 4.867314188s FAIL (2025-09-27 19:49:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.867349135s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.949075706s FAIL (2025-09-27 19:48:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.949108218s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................X....X..X.X...........................] duration: 6.076280866s FAIL (2025-09-27 19:48:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.076318489s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.012013515s FAIL (2025-09-27 19:48:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 5.012054373s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................X....X..X.X..........................] duration: 6.088644695s FAIL (2025-09-27 19:47:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.088676525s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 4.867062375s FAIL (2025-09-27 19:47:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.867091351s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.750375142s FAIL (2025-09-27 19:47:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.750409316s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................X....X..X.X.........................] duration: 5.995505888s FAIL (2025-09-27 19:46:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.995535454s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 4.899804353s FAIL (2025-09-27 19:46:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.899834011s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................X....X..X.X........................] duration: 6.025485008s FAIL (2025-09-27 19:46:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.025523281s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 4.758821629s FAIL (2025-09-27 19:45:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.758847497s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.888372076s FAIL (2025-09-27 19:45:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.888412203s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................X....X..X.X.......................] duration: 6.920050724s FAIL (2025-09-27 19:44:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.920103885s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.805873411s FAIL (2025-09-27 19:44:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.805908117s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........................X....X..X.X......................] duration: 6.152254481s FAIL (2025-09-27 19:44:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.152291541s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............................X....X..X.X.....................] duration: 9.80451788s FAIL (2025-09-27 19:43:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 9.804551694s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.882249196s FAIL (2025-09-27 19:43:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.882278942s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.835608564s FAIL (2025-09-27 19:43:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.83564412s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............................X....X..X.X....................] duration: 6.545187755s FAIL (2025-09-27 19:43:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.545223613s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 4.83211883s FAIL (2025-09-27 19:43:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.832155701s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............................X....X..X.X...................] duration: 5.943839068s FAIL (2025-09-27 19:42:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.943874015s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.924682034s FAIL (2025-09-27 19:42:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 4.924701092s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.110837916s FAIL (2025-09-27 19:42:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer ======LOGS====== ploading piece... Sep 27 19:42:16.851904981 (102h11m2.313997454s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852399574 (102h11m2.314492047s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.852873816 (102h11m2.314966299s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.853507803 (102h11m2.315600276s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.855290378 (102h11m2.317382851s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.857320493 (102h11m2.319412967s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.859477411 (102h11m2.321569884s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.861648736 (102h11m2.323741219s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.863879203 (102h11m2.325971686s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:16.866136491 (102h11m2.328228974s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Uploading piece... Sep 27 19:42:17.717331390 (102h11m3.179423873s) [upload=89929]: Next returned nil segment Sep 27 19:42:17.717367178 (102h11m3.179459662s) [upload=89929]: Waiting for error group managing segments... Sep 27 19:42:18.087365918 (102h11m3.549458401s) [noise=true , address=81.171.14.70:4035 , piece_id=M3OI7SKEGYRTQCLXDWE364IABTZEDGP6QXWSQHHYGXTPP3VCLDZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.105655594 (102h11m3.567748077s) [noise=true , address=81.171.14.70:4041 , piece_id=HESUR7NWPV427S2XRODHYHLS5KLNQLPOTPF3HOVNDQNRTUWGZ7KA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.107753430 (102h11m3.569845913s) [noise=true , address=81.171.14.70:4037 , piece_id=NF4KCWJHMWPWVF2SZLIHLFIJDH6TNCTDSQT3EQDBYMU6HHYBJ5OA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.114636617 (102h11m3.5767291s) [noise=true , address=81.171.14.70:4031 , piece_id=332OHLFNBAJ7LB36Y72MNALDU7NPXQIRY5QRVLAPJOTE6TCDOCEA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.125611034 (102h11m3.587703527s) [noise=true , address=81.171.14.70:4028 , piece_id=TKDL5V3DXRB6IEX4UCDIORWH5C2JEA2SJV4FURSB2E43TUR5BVOQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.130988554 (102h11m3.593081037s) [noise=true , address=81.171.14.70:4039 , piece_id=DI7DICLIQLQBNTR62K6KT2Z3F4PJMPEGRDAJJFHQNUF4D53WHQNQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.133905207 (102h11m3.59599769s) [noise=true , address=81.171.14.70:4047 , piece_id=2SEMSVDNNEQGCTKTJ2NPIXUAGFIHQ7B32O2FEOSFLYC55ZFWAE5Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.137235840 (102h11m3.599328313s) [noise=true , address=89.149.201.147:4019 , piece_id=DQJBIPFQLRH7PVC5ET7YSKJNQ4ZXT2BR6LHX74ZHRVHLIHEQXXUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.138020274 (102h11m3.600112747s) [noise=true , address=89.149.201.147:4009 , piece_id=ZFTEYLRPQPK3MPAQS5OPXGZHJMAFOACLFRROWVIPXEZQFUP2ZGVQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.169014162 (102h11m3.631106645s) [noise=true , address=81.171.14.70:4036 , piece_id=WAGPANGKB4NLD75UKGEQM2V53LSKLZCAMRIXNAYMPKXQYD5ZJSHA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.174214444 (102h11m3.636306927s) [noise=true , address=89.149.201.147:4001 , piece_id=S4GZ34GDBSFVRS52KNUFSZFTPD4TDTFUMHUKWZSMNAHSFLZHZ5QQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.176187641 (102h11m3.638280114s) [noise=true , address=89.149.201.147:4023 , piece_id=HJKU46COZJYWALQCKMMZJ54AJG5SIIAN63X45HHVOTIUTL5GS2GA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.194676498 (102h11m3.656768971s) [noise=true , address=89.149.201.147:4024 , piece_id=RZP5QD6DULXOU2SP6XWPBTO7X6UTNNOVLAMYXACVOXA2JQH6ODEQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.552714451 (102h11m4.014806934s) [noise=true , address=81.171.14.70:4026 , piece_id=XRJKHK2QW5ZM7MAP2GEJMXALCFPXRNR7CQYOJHDMLJQNIVGRTI2A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.578246218 (102h11m4.040338702s) [noise=true , address=81.171.14.70:4045 , piece_id=HESWYJWN53AC7JEYBA2LZJPE5N4E72MMVSAK4OOYRSUFKLPGS45Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.654575645 (102h11m4.116668128s) [noise=true , address=185.167.204.206:4040 , piece_id=IKSYLPGG2N2WNMYMJ2GE6LZOVS2ZLIWQDMO353TEOD52YDLQNFGQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.660837959 (102h11m4.122930442s) [noise=true , address=185.167.204.205:4013 , piece_id=AEOKIN7HCKU3S2QVUCXLL6M6ZG5ZFAE6MWAZGMIGQ46MFM5YTVFA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.684086459 (102h11m4.146178942s) [noise=true , address=185.167.204.206:4046 , piece_id=NW274SFLMGEFR6C4JRGTJ2V64PECG56KFU2233QXTSATRMQUFMYQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.717321825 (102h11m4.179414308s) [noise=true , address=185.167.204.205:4030 , piece_id=ED7OHHYUSNPOHSU3TF425LKVZKPNW55HAGMVD4YEOYZSTFUOC5QA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.734861794 (102h11m4.196954278s) [noise=true , address=185.167.204.205:4003 , piece_id=423DPR4A4F5ZIQCJ5PN73LVER7I5LJ33HC2PO2AU45M3F5W4KIZA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.743283301 (102h11m4.205375794s) [noise=true , address=185.167.204.205:4019 , piece_id=7IDC4PR2J5BSCO7LDYL4B5ZH72LERJ53QQ3CJQVEUSZBABQJFMRQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.765742828 (102h11m4.227835301s) [noise=true , address=185.167.204.205:4018 , piece_id=ODY5PWZUU2UQZCHUVZOT2AN6MWVDWWYLJO4UYTK2MMRVR3QVVLVA, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.768463980 (102h11m4.230556463s) [noise=true , address=185.167.204.206:4051 , piece_id=62564CXV5ZNICNGEZMA4ZV4CZYHJW4NJZU64ARYG772SQ3MD5A2Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.770897814 (102h11m4.232990297s) [noise=true , address=185.167.204.205:4017 , piece_id=VOEPYLSGFS3F4TDYTKWHOR4KLIFUWIFKGTESNECVK5BTKAJQKPWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.779253035 (102h11m4.241345518s) [noise=true , address=185.167.204.206:4068 , piece_id=WIE6MTMDCZI3OVGOPNC3D6GVLEP32IUUJQZLZJ6FPOEPM3HGESWQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786276548 (102h11m4.248369031s) [noise=true , address=185.167.204.205:4028 , piece_id=W26MBIC7BOZU4WHU652JUMLGD6OMGR2FCZP77WUOU262AG3ULMUQ, seg_pos={0 0}, upload=89929]: Done uploading piece. err: <nil> Sep 27 19:42:18.786311094 (102h11m4.248403567s) [seg_pos={0 0}, upload=89929]: Segment reached optimal threshold of 26 pieces. Sep 27 19:42:18.786446752 (102h11m4.248539225s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786454498 (102h11m4.248546981s) [noise=true , address=185.167.204.205:4016 , piece_id=GYH5PXP335XI5C6BEZZ6IIFXI7CGHTRMX5JSGEOB25NRTEEUP46A, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786597260 (102h11m4.248689753s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U): protocol: expected piece hash; context canceled; EOF Sep 27 19:42:18.786620463 (102h11m4.248712946s) [noise=true , address=185.167.204.206:4069 , piece_id=KGO3J74KNEVFROVWK4BP7FUE6C7HNGRPWNFUCRQQBQE5ZGQ4F27Q, seg_pos={0 0}, upload=89929]: Long tail cancellation due to optimal threshold Sep 27 19:42:18.786667804 (102h11m4.248760287s) [seg_pos={0 0}, upload=89929]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 27 19:42:18.786777773 (102h11m4.248870246s) [upload=89929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 27 19:42:18.786785097 (102h11m4.24887758s) [upload=89929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 27 19:42:46.236891187 (102h11m31.69898367s) [upload=89929]: Done uploading segments... Sep 27 19:42:46.236928157 (102h11m31.69902064s) [upload=89929]: Upload finished. err: metaclient: manager closed: closed: read tcp 188.166.225.170:34184->35.207.121.91:7777: read: connection reset by peer Duration: 30.110865601s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............................X....X..X.X..................] duration: 6.127491748s FAIL (2025-09-27 19:41:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.127532975s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................................X....X..X.X.................] duration: 6.211195769s FAIL (2025-09-27 19:41:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.211231077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................................X....X..X.X................] duration: 6.495733464s FAIL (2025-09-27 19:40:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.495765995s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................................X....X..X.X...............] duration: 6.062793563s FAIL (2025-09-27 19:38:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 27 19:27:22.886943307 (101h56m8.34903578s) [upload=89705]: Starting upload Sep 27 19:27:22.887049439 (101h56m8.349141922s) [upload=89705]: Done starting upload Sep 27 19:27:22.887160700 (101h56m8.349253184s) [upload=89705]: Uploading segments... Sep 27 19:27:22.887344050 (101h56m8.349436533s) [upload=89705]: Got next segment. Inline: false Sep 27 19:27:22.887393123 (101h56m8.349485606s) [upload=89705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 27 19:27:22.887400948 (101h56m8.349493431s) [upload=89705]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 27 19:27:23.144152141 (101h56m8.606244624s) [seg_pos={0 0}, upload=89705]: Begin upload segment... Sep 27 19:27:23.144224288 (101h56m8.606316771s) [seg_pos={0 0}, upload=89705]: Done begin upload segment. Sep 27 19:27:23.144303519 (101h56m8.606396002s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144356600 (101h56m8.606449083s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.144899694 (101h56m8.606992177s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145386381 (101h56m8.607478864s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.145749413 (101h56m8.607841896s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146190593 (101h56m8.608283076s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146569114 (101h56m8.608661597s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.146975998 (101h56m8.609068481s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.147437558 (101h56m8.609530051s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.148991526 (101h56m8.611083999s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.151370226 (101h56m8.613462699s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.153185462 (101h56m8.615277966s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.154735545 (101h56m8.616828028s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.158605123 (101h56m8.620697606s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162754133 (101h56m8.624846616s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:23.162908967 (101h56m8.62500145s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Uploading piece... Sep 27 19:27:24.838034007 (101h56m10.30012649s) [upload=89705]: Next returned nil segment Sep 27 19:27:24.838098610 (101h56m10.300191093s) [upload=89705]: Waiting for error group managing segments... Sep 27 19:27:25.171482756 (101h56m10.633575229s) [noise=true , address=145.79.227.19:4077 , piece_id=GIAYXZLLUURES3HHVNRQC6ZRQX2CZ5WDQASVHRPQPICA6PW4EQ2A, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.176947972 (101h56m10.639040456s) [noise=true , address=145.79.227.13:4803 , piece_id=TUT4CT2ORVPAKJKQP4J3QH5FZGFTB7PYRNXZ2XIQHUQ52EQDJXBA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.180229350 (101h56m10.642321834s) [noise=true , address=145.79.227.2:4115 , piece_id=JVWJRKDIFWN77BVDO4VPJIL6C4OO5BN7WBNN4TJO5SXKLFUTKV4Q, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.181707686 (101h56m10.643800159s) [noise=true , address=145.79.227.4:4187 , piece_id=WCGSKL7TB7VEZEPZ4ODOTTM5XEXN2YEJF37V6UFR4O2SB2XLCEWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.182762434 (101h56m10.644854917s) [noise=true , address=145.79.227.15:4875 , piece_id=XICWMTJP3OSIZXFHD3S2PUIWVTVULF36YFG2BMXPZYWK6PVJOALQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.192828732 (101h56m10.654921205s) [noise=true , address=145.79.227.3:4149 , piece_id=CQYYHMVQLWOLUDJIQJUILGP4TRPDF7NG6LXRCSZHG324RBGRCGZA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.198888852 (101h56m10.660981335s) [noise=true , address=145.79.227.14:4837 , piece_id=O65YIB773YZFS4CX3ENJYSDG2ILJHKAHMOQZARA6ILGCIMYFM7HA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.205614519 (101h56m10.667707012s) [noise=true , address=145.79.227.7:4295 , piece_id=YQB2LXXCSWTATSDT4C6JBCA2NWPDTAJ2BOL456U7HGV6WGSZRGDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.207989521 (101h56m10.670081994s) [noise=true , address=145.79.227.6:4259 , piece_id=QEEY7JI7PGB24S5CVWYOP6IMM5J7QYMRRIZVLVQK7ZDP2CGJYYYA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.222032181 (101h56m10.684124654s) [noise=true , address=145.79.227.11:4732 , piece_id=43B3XCLUV4GAZYCAXG56Y5I4S6L47LCVJL53HDLYODCS4OGOAOWQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.290677625 (101h56m10.752770118s) [noise=true , address=45.91.116.11:4118 , piece_id=WSNNWC5FALMJCWDOF6ORUJIXLK6G4PCKX3MTXMWSPBGRZ4SJKRRA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:25.652827506 (101h56m11.114919989s) [noise=true , address=45.91.116.9:4263 , piece_id=BV37BJAZJFVJ4RRXCFPEYKXTLYQ3JJDHSRCMYUXTSSHADFX2BZAQ, seg_pos={0 0}, upload=89705]: Done uploading piece. err: <nil> Sep 27 19:27:52.180260159 (101h56m37.642352652s) [noise=true , address=77.90.31.16:4734 , piece_id=CWEHVMSWIGUYFOSA5QQQIQYPUCLGNGMKYQEMF3J62DBXBMXXXXGA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180423099 (101h56m37.642515582s) [noise=true , address=77.90.31.14:4662 , piece_id=42PHYS3UEPXDUO3RATCUTQRQPXMS6HI3O6AOZI4R2NUULIKAWQVA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180455370 (101h56m37.642547853s) [noise=true , address=77.90.31.14:4661 , piece_id=KXFCG3HWMGGG5Z74VKNKEHRAM3VQSRUXK64OTLHGU5MNQS54IKDA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: rpc: dial tcp 77.90.31.14:4661: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 27 19:27:52.180565359 (101h56m37.642657842s) [noise=true , address=77.90.31.15:4697 , piece_id=EWX3ABIK3WRK64RP4LHBJNXYTPI4N7YDRECFSG222PKPLQLZ3UWA, seg_pos={0 0}, upload=89705]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 188.166.225.170:37784->77.90.31.15:4697: use of closed network connection; conn closed: op Sep 27 19:27:52.180610105 (101h56m37.642702588s) [seg_pos={0 0}, upload=89705]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 27 19:27:52.433487771 (101h56m37.895580254s) [upload=89705]: Done uploading segments... Sep 27 19:27:52.433517006 (101h56m37.89560948s) [upload=89705]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.062826225s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)