Knowledge base completion involves in discovering missing facts. However, knowledge changes over time. The issue of knowledge base integrity arises when the operations for knowledge base update including insertion and deletion result some facts inconsistent with others in the knowledge base. Therefore, the removal of out-of-date facts is required to keep knowledge base integrity. In this study, we explore two kinds of approaches to knowledge base integrity. In this way, we can eliminate the conflicting facts and out-of-date facts. Our work provides a significant benefit for other tasks such as question answering and knowledge base completion.