第16卷第1期 智能系统学报 Vol.16 No.1 2021年1月 CAAI Transactions on Intelligent Systems Jan.2021 D0L:10.11992tis.202101003 基于语义分割的简洁线条肖像画生成方法 吴涛2，董肖莉3，孟伟2，徐健，覃鸿，李卫军 (1.北京林业大学信息学院，北京100083：2.国家林业草原林业智能信息处理工程技术研究中心，北京100083： 3.中国科学院半导体研究所，北京100083：4.中国科学院大学微电子学院，北京100045) 摘要：针对目前主流的线条提取算法对于区域对比度不明显的边缘的检测能力较弱，且对于所有区域采用无 差别、统一化的处理策略，所生成的线条画往往较复杂，非常不利于机器人机械臂绘图的问题，本文提出了一种 基于语义分割的简洁线条肖像画生成方法(concise line portrait generation based on semantic segmentation,CLPG-SS)。 首先，对人脸图像进行语义分割.将人脸划分为不同的区域，基于不同区域提取边缘轮廓与五官细节线条，进 行边缘切向流优化，从而加强方向信息：在此基础上，利用线条图来生成调和图像，并利用优化后的边缘切向 流、人脸语义分割结果以及调和图像，针对不同的分割区域调整线条提取方法的参数.实现对细节无关区域的 线条过滤和细节重点区域的线条加强，生成简洁线条肖像画。实验结果表明：本文提出的CLPG-S$方法能够 有效提取人脸主轮廓线条，并针对不同区域实现了对细节线条的针对性调节，提高了机器人机械臂的绘制效率。 关键词：语义分割；区域轮廓；切向流场：简洁线条肖像画；人脸线条提取；基于流的高斯差分；参数调整 中图分类号：TP391文献标志码：A文章编号：1673-4785(2021)01-0134-08 中文引用格式：吴涛，董肖莉，孟伟，等.基于语义分割的简洁线条肖像画生成方法.智能系统学报，2021,16(1)：134-141. 英文引用格式：WU Tao,.DONG Xiaoli,,MENG Wei,etal.Concise line portrait generation method based on semantic segmenta tionJ.CAAI transactions on intelligent systems,2021,16(1):134-141. Concise line portrait generation method based on semantic segmentation WU Tao2,DONG Xiaoli,MENG Wei2,XU Jian',QIN Hong3,LI Weijun3 (1.School of Information Science and Technology,Beijing Forestry University,Beijing 100083,China;2.Engineering Research Center for Forestry-oriented Intelligent Information Processing of National Forestry and Grassland Administration,Beijing 100083, China;3.Institute of Semiconductors,Chinese Academy of Sciences,Beijing 100083,China;4.School of Microelectronics,Uni- versity of Chinese Academy of Sciences,Beijing 100045,China) Abstract:Currently,mainstream line extraction algorithms have weak detection capabilities for edges with inconspicu- ous regional contrast,and they use an undifferentiated and unified processing strategy for all regions.The generated line drawings are often complex,which is very unfavorable for robot manipulator drawing.Given this situation,this paper proposes a concise line portrait generation based on the semantic segmentation(CLPG-SS)method.In this method,se- mantic segmentation is performed on the face image,and the face is divided into different regions.Edge contour and fa- cial detail lines are extracted based on different regions,and edge tangent flow is optimized to enhance the direction in- formation.On this basis,the line image is used to generate the harmonic image,and the optimized edge tangent flow,fa- cial semantic segmentation results,and harmonic image are used to adjust the parameters of the line extraction method for different segmentation regions to realize the line filtering of the detail independent region and line enhancement of the detail focus region,generating a concise line portrait.The experimental results showed that the proposed CLPG-SS method could effectively extract the main contour lines of a human face,adjust the detail lines for different regions,and improve the rendering efficiency of a robot manipulator. Keywords:semantic segmentation:region contour;edge tangent flow;concise line portrait;face line extraction;fdog; parameter adjustment 线条肖像画，是描绘人物形象的一种绘画方 画具有非常悠久的历史，发展至今仍十分流行， 式，是一种独具风格的艺术表现形式。线条肖像 世界各国的艺术家经常举办相关艺术展，甚至在 收稿日期：2021-01-14. 公园、广场等场所也常会遇到正在进行线条肖像 通信作者：孟伟.E-mail:mnancy(@bjfu.edu.cn 画创作的街头艺术家。众所周知，线条肖像画以DOI: 10.11992/tis.202101003 基于语义分割的简洁线条肖像画生成方法 吴涛1,2，董肖莉3 ，孟伟1,2，徐健3 ，覃鸿3,4，李卫军3,4 （1. 北京林业大学 信息学院，北京 100083; 2. 国家林业草原林业智能信息处理工程技术研究中心，北京 100083; 3. 中国科学院 半导体研究所， 北京 100083; 4. 中国科学院大学 微电子学院，北京 100045） 摘 要：针对目前主流的线条提取算法对于区域对比度不明显的边缘的检测能力较弱，且对于所有区域采用无 差别、统一化的处理策略，所生成的线条画往往较复杂，非常不利于机器人机械臂绘图的问题，本文提出了一种 基于语义分割的简洁线条肖像画生成方法 (concise line portrait generation based on semantic segmentation, CLPG-SS)。 首先，对人脸图像进行语义分割，将人脸划分为不同的区域，基于不同区域提取边缘轮廓与五官细节线条，进 行边缘切向流优化，从而加强方向信息；在此基础上，利用线条图来生成调和图像，并利用优化后的边缘切向 流、人脸语义分割结果以及调和图像，针对不同的分割区域调整线条提取方法的参数，实现对细节无关区域的 线条过滤和细节重点区域的线条加强，生成简洁线条肖像画。实验结果表明：本文提出的 CLPG-SS 方法能够 有效提取人脸主轮廓线条，并针对不同区域实现了对细节线条的针对性调节，提高了机器人机械臂的绘制效率。 关键词：语义分割；区域轮廓； 切向流场；简洁线条肖像画；人脸线条提取；基于流的高斯差分；参数调整 中图分类号：TP391 文献标志码：A 文章编号：1673−4785(2021)01−0134−08 中文引用格式：吴涛, 董肖莉, 孟伟, 等. 基于语义分割的简洁线条肖像画生成方法 [J]. 智能系统学报, 2021, 16(1): 134–141. 英文引用格式：WU Tao, DONG Xiaoli, MENG Wei, et al. Concise line portrait generation method based on semantic segmenta￾tion[J]. CAAI transactions on intelligent systems, 2021, 16(1): 134–141. Concise line portrait generation method based on semantic segmentation WU Tao1,2 ，DONG Xiaoli3 ，MENG Wei1,2 ，XU Jian3 ，QIN Hong3,4 ，LI Weijun3,4 (1. School of Information Science and Technology, Beijing Forestry University, Beijing 100083, China; 2. Engineering Research Center for Forestry-oriented Intelligent Information Processing of National Forestry and Grassland Administration, Beijing 100083, China; 3. Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, China; 4. School of Microelectronics, Uni￾versity of Chinese Academy of Sciences, Beijing 100045, China) Abstract: Currently, mainstream line extraction algorithms have weak detection capabilities for edges with inconspicu￾ous regional contrast, and they use an undifferentiated and unified processing strategy for all regions. The generated line drawings are often complex, which is very unfavorable for robot manipulator drawing. Given this situation, this paper proposes a concise line portrait generation based on the semantic segmentation (CLPG-SS) method. In this method, se￾mantic segmentation is performed on the face image, and the face is divided into different regions. Edge contour and fa￾cial detail lines are extracted based on different regions, and edge tangent flow is optimized to enhance the direction in￾formation. On this basis, the line image is used to generate the harmonic image, and the optimized edge tangent flow, fa￾cial semantic segmentation results, and harmonic image are used to adjust the parameters of the line extraction method for different segmentation regions to realize the line filtering of the detail independent region and line enhancement of the detail focus region, generating a concise line portrait. The experimental results showed that the proposed CLPG-SS method could effectively extract the main contour lines of a human face, adjust the detail lines for different regions, and improve the rendering efficiency of a robot manipulator. Keywords: semantic segmentation; region contour; edge tangent flow; concise line portrait; face line extraction; fdog; parameter adjustment 线条肖像画，是描绘人物形象的一种绘画方 式，是一种独具风格的艺术表现形式。线条肖像 画具有非常悠久的历史，发展至今仍十分流行， 世界各国的艺术家经常举办相关艺术展，甚至在 公园、广场等场所也常会遇到正在进行线条肖像 画创作的街头艺术家。众所周知，线条肖像画以 收稿日期：2021−01−14. 通信作者：孟伟. E-mail：mnancy@bjfu.edu.cn. 第 16 卷第 1 期 智 能 系 统 学 报 Vol.16 No.1 2021 年 1 月 CAAI Transactions on Intelligent Systems Jan. 2021