The story of Xu Fu's(徐福) sea-voyage eastward has been widely spread in China, Japan and the Korean Peninsula. The narration and memory of Xu Fu's deed by the Korean scholars can be traced at least back to the period of Silla. Legends and folk songs about Xu Fu are still widely spread in the southern part of the Peninsula, and the trace of the known as inscriptions on precipice carving Xu Shi Guo Zhi (which means Xu Fu once has been here) has been preserved to this day. Both the imaginative narration and the memory in the relics reflect the unique cultural phenomenon and logic in the cultural circle of Chinese characters. Through the study of the Korean literati's narration and folk memory of the Peninsula such as legends, ballads and other materials, this paper outlines the possible track of Xu Fu on the Peninsula, and further reveals the contemporary cultural significance of research on Xu Fu.