We use a recently developed effective Ginzberg-Landau equa tion to study the vortex lattice structure in d-wave superconductors. By introducing explicit four-fold symmetry breaking terms we are able to reproduce the small angle neutron scattering data on YBCO by Keimer et al. [9]. A phase diagram is also constructed and shows quite rich structures.