The name Kaki Bukit literally translates to "Foot of the Hill," reflecting its geographical position. The town’s history is deeply intertwined with the tin mining boom of the 20th century. In 1935, an Englishman discovered that the underground stream through Gua Kelam could be used to transport tin ore from the Wan Tangga Valley to the town. Miners once navigated the pitch-black cave using carbide lamps to move ore, a legacy still visible today through remnants of mining equipment and rails inside the cave. Today, the town is a peaceful cultural blend of Chinese and Thai communities, famous for its local delicacies like Kaya Pao and Lo Mai Gai.