The detection identification of the lane line is an important part of automatic driving and advanced driving assistance. It is well known that the computer is not as simple as human beings for the identification of lane lines. Although there are many lane detection processing methods based on traditional computer vision. However, these processing methods are not ideal in the state of road conditions or poor illumination conditions. This paper discusses a method of detecting recognition based on deep learning. A convolutional neural network (CNN) is used, a neural network that is good at processing image data. The idea of the project is to make the network with the ability to calculate the road polynomial coefficient, and use these coefficients to predict the lane cable. Finally, draw the current driving lane based on the predicted road line. This is similar to a regression problem. And use average variance to narrow the loss of training. After the final experiment, the model of this paper has a good performance in complex circumstances, combining time-effective, high accuracy, and high robustness.