In the early historical era, Koh Yor was a mountainous area, uninhabited by any settlers. It wasn't until the late Sukhothai period and the Ayutthaya period that evidence of Koh Yor began to appear on maps, notably in the illustrations of Wat Phako, which depicted Koh Yor as a mountain at the far end of the map, labeled as "Koh An Yor." Additionally, Koh Yor is featured on the city map of Songkhla, created in 1687 by the French engineer Monsieur de la Mare. This map reveals that at least nine communities had already formed on Koh Yor. Most of these communities were situated on the flatland at the base of the southern, eastern, and western hills surrounding Koh Yor, which now corresponds to the areas around Khao Hua Lang, Khao Suan Nuea, and Khao Kudi.