Maintaining that physical senses not only constitute the foundation of our sensory perception but also enable us to comprehend the world, this paper takes several contemporary Taiwanese family history writings as examples to illustrate how they center on sensory memories. Since family history writings often depart from the subject's questioning of his/her origin, the topics related to physical senses, such as sex/sexuality, memory, and identity, are constantly dealt with in this particular genre. This paper, therefore, will discuss respectively the senses of taste, smell, touch, and sight in family history writings, in the hope of elucidating how physical senses play an important part in the subject's remembrance and construction of his/her family history.