The era of artificial intelligence has witnessed the redistribution of social resources through algorithms which greatly improves social efficiency. However, the pitfalls of the algorithm, such as 'Black Box' Algorithms, Automatic Relevance Determination (ARD) and Automatic Decision‐making, compromise the legal interest of the data subject to varying degrees. At present, from the perspective of enterprises, the individual Data Protection Officer (DPO) system should be established to form a interactive mechanism between the person responsible for protecting personal data and regulatory bodies. From the perspective of individuals, corresponding rights should be allocated against algorithms that violate personal information rights; at the same time, a binary‐path construction will make the AI governance more perfect, all of which can eventually realize the effective protection of personal data in the age of artificial intelligence.