Recently deep learning has been widely applied in diverse fields. The convolutional neural network (CNN) and the long short-term memory neural network (LSTM) are two main branches in deep learning. Previously, LSTM was the obvious candidate in tackling sequence modeling tasks, such as financial time series prediction, speech recognition, music generation, and so on. But the CNN is catching up and getting its share of attention as it also provides satisfactory results; therefore, researchers are being attracted to it. Our goal is to compare CNN and LSTM on the prediction accuracy of Taiwan Electronics Total Return Index. LSTM is found to outperform CNN with daily data.