In response to the rapid development of smart manufacturing, the use of artificial intelligence to solve industrial problems is increasing. This research uses a supervised deep convolutional neural network to learn the characteristics of holes, missing yarn and broken warp in textiles. Moreover using transfer learning and fine-tuning to improve training speed and accuracy. After the neural network achieves the goal of automatic detection, this network predicts that it will take 0.189 seconds for 600*600 images on a 2080Ti GPU.