It is now widely accepted that the Portuguese first arrived in Guangdong in 1513, Ryukyu in 1543, and finally Japan in 1543. Previous research suggests that Europeans did not arrive in the Kingdom of Joseon (present-day Korea) until the late 1570s, sometime after their first visits to Ryukyu and Japan. However, a series of historical records in the Annals of the Joseon Dynasty (朝鮮王朝實錄) suggest that a delegation of Portuguese that landed at the port of Shuangyu (雙嶼) to form a trade alliance with Japan some thirty years earlier in 1544, might have drifted into Korean waters. This paper referes to and analyzes these records and other related historical materials in order to explain the connection between the so-called 'anomalous Chinese ship' (荒唐船) and the 'southern barbarians' (南蠻, i.e. the Portuguese), referred to in the records.