Oral English learning is an important part of English learning for college students, it is also the weak part for them. There are many reasons for it. Oral English learning is affected by intelligence factors as well as non intelligence factors. For the college students, from the perspective of educational psychology, emotional factors play an important role in oral English learning. This thesis will mainly analyze the specific factors in emotional factor that influence oral English learning and the measures we should take to overcome or get rid of the negative emotional feeling and then form the positive emotional feeling and improve the oral English level on the whole.