Red dates need to be graded in the process of processing, so as to price according to quality, convenient for consumers to choose at the same time to speed up the circulation of goods, improve the added value of products. A deep learning based Stacking method for date classification was proposed. 21280 date images of 4 different grades of the same variety were collected for pre-processing and data set was established. A Stacking integrated learning model with three different convolutional neural networks (VGG16, ResNet 50, Densenet121) as the base learner and logistic regression as the secondary learner was constructed. The comparison between the integrated model and the single neural network model was conducted. The results show that the Stacking integration model proposed in this experiment can achieve 91.88% accuracy in jujube grading.