The pier was established in 1904 as a replacement for the city's aging wharves, originally being known as the "Iron Pier" due to its sturdy metal construction. It was later renamed in 1906 to honor Sir Frank Swettenham, the Governor of the Straits Settlements. During World War II, the pier played a strategic military role as a submarine base for Japanese, German, and Italian navies between 1942 and 1945. While it served as a vital cargo hub for decades, the shifting of container services to the mainland in the 1970s led to its transformation. Following a major rebuild in 2010, it has been revitalized as a world-class cruise hub, now surpassing Port Klang in passenger volume and serving as a critical homeport for Southeast Asian tourism.