This study proposes a light field flexible compensation system of fringe projection color grating measurement which uses the fringe projection method to calculate the height of a work piece to be measured. A video device first generates an image without gratings for projection, and then projects this image. An imaging device then captures the image and sends it back to the image processing device, so as to form an image with projection information without gratings, as well as an image with gratings. Thus, both images with and without gratings can be clearer. In this way, more accurate 3D contouring measurement and reconstructive analytical calculation can be carried out for the work piece to be measured.