Surface scratch detection of mobile phone screen based on machine vision

ZHANG Jianguo; LI Ying; QI Jiakun; JI Tiantian; LIU Jun

doi:10.5768/JAO202041.0502008

Journal of Applied Optics > 2020 > 41(5): 984-989. > DOI: 10.5768/JAO202041.0502008

ZHANG Jianguo, LI Ying, QI Jiakun, JI Tiantian, LIU Jun. Surface scratch detection of mobile phone screen based on machine vision[J]. Journal of Applied Optics, 2020, 41(5): 984-989. DOI: 10.5768/JAO202041.0502008

Citation:

PDF (779 KB)

Surface scratch detection of mobile phone screen based on machine vision

School of Mechanical Engineering, Shanghai Institute of Technology, Shanghai 201418, China

More Information

Received Date: September 15, 2019
Revised Date: December 30, 2019
Available Online: June 05, 2020

Graphical Abstract

Abstract

Abstract

Aiming at the problem of irregular shape and low contrast of the scratches in the image of mobile phone screen, a method based on machine vision was proposed to detect the surface scratches of mobile phone screen. Firstly, the PatMax algorithm and affine transformation were adopted to preprocess the screen images of mobile phone. Then the shear transformation was used to decompose the image into two parts: low frequency and high frequency, the element shapes in four directions of 0°, 45°, 90° and 135° were constructed to perform gray-scale closing operation on the low frequency part, and the N × M median filter denoising operation was performed on the high frequency part, the enhanced image was generated by the inverse shear transformation. Finally, the improved Otsu double threshold method was used to extract the target. 450 pieces of mobile phone screen images were randomly selected for experiments, and the highest detection rate is 98.7%. The results show that this method can effectively enhance the detail information of the images, which greatly guarantees the integrity of the scratch defects.
- machine vision,
- scratch detection,
- shear transformation,
- gray morphology,
- Otsu double threshold

FullText(HTML)

References (16)

References

[1]	邝泳聪, 张坤, 谢宏威. 数码产品外壳表面的适应性智能检测技术[J]. 华南理工大学学报(自然科学版),2015,43(1):1-8. KUANG Yongcong, ZHANG Kun, XIE Hongwei. Adaptive intelligent detection technology for digital products' shell surface[J]. Journal of South China University of Technology( Natural Science Edition),2015,43(1):1-8.
[2]	陈春谋. 基于直方图均衡化与拉普拉斯的铅条图像增强算法[J]. 国外电子测量技术,2019,38(7):131-135. CHEN Chunmou. Lead line image enhancement algorithm based on histogram equalization and laplacian[J]. Foreign Electronic Measurement Technology,2019,38(7):131-135.
[3]	张一豪, 孙冬梅, 沈玉成, 等. 双目视觉测量系统特征点提取与匹配技术研究[J]. 应用光学,2016,37(6):866-871. ZHANG Yihao, SUN Dongmei, SHEN Yucheng, et al. Feature points extraction and matching technology of binocular vision measurement system[J]. Journal of Applied Optics,2016,37(6):866-871.
[4]	ZHOU Rigui, LIU Daqian. Quantum image edge extraction based on improved sobel operator[J]. International Journal of Theoretical Physics,2019,58(9):1-17.
[5]	SHANG Jiyang, ZHANG Yu, ZHANG Qibo, et al. Distorted target recognition based on prewitt operator combined with MACH filter[J]. Key Engineering Materials,2013,552:523-528. doi: 10.4028/www.scientific.net/KEM.552.523
[6]	王景艳. 旧电影图像质量评价方法研究[D]. 大连: 大连海事大学, 2012. WANG Jingyan. Research of old film video image quality assessment method[D]. Dalian: Dalian Maritime University, 2012.
[7]	杨燕, 孙智权, 陈震, 等. 基于机器视觉的纽扣电池表面划痕检测方法研究[J]. 自动化与仪表,2019,34(4):50-64. YANG Yan, SUN Zhiquan, CHEN Zhen, et al. Research on surface scratch detection method of button battery based on machine vision[J]. Automation & Instrumentation,2019,34(4):50-64.
[8]	杨健, 辛浪, 豆昌军. 基于机器视觉技术的瓶盖划痕检测[J]. 包装工程,2019,40(13):227-232. YANG Jian, XIN Lang, DOU Changjun. Bottle cap scratch detection based on machine vision technology[J]. Packaging Engineering,2019,40(13):227-232.
[9]	徐瑶. 基于机器视觉的智能手机触摸屏与基板对位检测[D]. 青岛: 山东科技大学, 2013. XU Yao. Machine vision-based smartphone touch screen and substrate alignment detection[D]. Qingdao: Shandong University of Science and Technology, 2013.
[10]	威洛斯, 焦宗夏. 基于VisionPro的焊膏印刷机视觉定位系统[C]// 中国体视学与图像分析学术会议.北京: 中国体视学学会, 2008: 533-539. WEI Luosi, JIAO Zongxia. Visual location system of solder paste printer based on VisionPro[C]// Chinese Stereology and Image Analysis Conference.Beijing:Chinese Society for Sterology, 2008: 533-539.
[11]	阳强. 高精度的天文图像拼接[D]. 广州: 暨南大学, 2016. YANG Qiang. High-precision astronomical image mosaics[D]. Guangzhou: Jinan University, 2016.
[12]	EASLENG Glenn, LABATE Demetrio, LIM Wang. Sparse directional image representations using the discrete shearlet transform[J]. Applied and Computational Harmonic Analysis,2008,25(1):25-46. doi: 10.1016/j.acha.2007.09.003
[13]	张三林. 基于机器视觉的嵌入式车道偏离预警系统的研究[D]. 长沙: 湖南大学, 2015. ZHANG Sanlin. Research on the embedded lane departure warning system based on machine vision[D]. Changsha: Hunan University, 2015.
[14]	DE NATALE FRANCESCO G B, BOATO G. Detecting morphological filtering of binary images[J]. IEEE Transactions on Information Forensics and Security,2017,12(5):1207-1217. doi: 10.1109/TIFS.2017.2656472
[15]	钟雪君. 一种改进的Otsu双阈值二值化图像分割方法[J]. 电子世界,2013(4):104. ZHONG Xuejun. An improved otsu double threshold binarized image segmentation method[J]. Electronics World,2013(4):104.
[16]	赵文宏, 彭超, 陈红星. 基于形态学玻璃屏幕表面划痕检测方法研究[J]. 浙江工业大学学报,2016,44(3):279-282. ZHAO Wenhong, PENG Chao, CHEN Hongxing. Study on scratch inspection methods of glass screen surface based on morphology[J]. Journal of Zhejiang University of Technology,2016,44(3):279-282.

[1]	DING Wei, YANG Jiegen, HU Feng, ZOU Liner. Design of ultra-short focal miniature projection lens based on DMD[J]. Journal of Applied Optics, 2023, 44(6): 1294-1299. DOI: 10.5768/JAO202344.0601002
[2]	LIU Xiaochan, CHEN Chen, SONG Tao, LI Weishan, ZHANG Xin, GAO Song, YANG Bo. Optical design of spherical zone projection lens for small and medium-sized flight simulator[J]. Journal of Applied Optics, 2023, 44(1): 30-36. DOI: 10.5768/JAO202344.0101005
[3]	LUO Rui, LIANG Xiuling. Design of large-aperture and wide-spectrum zoom lens[J]. Journal of Applied Optics, 2022, 43(5): 839-845. DOI: 10.5768/JAO202243.0501002
[4]	WANG Kang, DUAN Jie, ZHOU Jianhong, WANG Chen, FU Yuegang. Design on projection objective of portable projector[J]. Journal of Applied Optics, 2019, 40(2): 316-322. DOI: 10.5768/JAO201940.0205003
[5]	Huang Yaolin, Wang Min, Lin Zheng. Design of zoom projection lens with large aperture and wild view[J]. Journal of Applied Optics, 2018, 39(3): 412-417. DOI: 10.5768/JAO201839.0305002
[6]	Hou Guozhu, Lyu Lijun. Design of large aperture zoom projection lens[J]. Journal of Applied Optics, 2018, 39(3): 405-411. DOI: 10.5768/JAO201839.0305001
[7]	Ju Rongbing, Kang Lianjie, Han Min, Liu Yan. Design of miniprojection wideangle lens[J]. Journal of Applied Optics, 2016, 37(4): 527-531. DOI: 10.5768/JAO201637.0401006
[8]	LI Wei-shan, CHEN Chen, ZHANG Yu, LIU Xiao-chan. Digital light processing mini-projection lens based on ZEMAX[J]. Journal of Applied Optics, 2011, 32(6): 1121-1125.
[9]	LI Wei-shan, CHEN Chen, ZHANG Yu, LIU Xiao-chan. Design of short focal digital projection lens based on ZEMAX[J]. Journal of Applied Optics, 2010, 31(5): 714-717.
[10]	SONG Dong-fan, ZHANG Ping, WANG Cheng, ZHANG Ren-jian, REN Zhao-yu, BAI Jin-tao. Design of mobile phone camera lens based on ZEMAX[J]. Journal of Applied Optics, 2010, 31(1): 34-38.

Cited By

Cited by

Periodical cited type(3)

1.	刘尊辈，蔡毅，刘福平，马俊卉，张猛蛟，王岭雪. 分孔径紫外多波段成像光学系统设计. 中国光学. 2021(06): 1476-1485 .
2.	李西杰，刘钧，邹纯博，杨佳婷. 双波段共口径同时偏振光学系统设计. 西安工业大学学报. 2020(01): 25-31 .
3.	陈旭，吴智勇，赵新潮，周兴雷，王丁. 中红外双通道滤波器的研制. 光学仪器. 2020(01): 32-39 .

Other cited types(3)

Get Citation

PDF

XML

Article views (3884) PDF downloads (127) Cited by(6)

Turn off MathJax

Article Contents

Abstract

References

Surface scratch detection of mobile phone screen based on machine vision