In 1930, Maulana Abdul Aleem Siddique came to Singapore with the vision to establish a Muslim society for spreading the true teachings of Islam and the message of peace. He, alongside other Islamic activists, spotted an old surau (a small place of prayers) in Telok Kurau (the land on which the masjid is right now). On 25 February 1953, the ownership of the land was transferred to Syed Ibrahim bin Oman Alsagoff, Ahmad bin Mohamed Ibrahim and Haji Adam Naina Mohamed Ibrahim as trustees of the All-Malaya Muslim Missionary Society (now known as JAMIYAH). And after relentlessly raising funds, the masjid came to its existence.

Built in 1954, it is named after the renowned Islamic scholar, spiritual master, and author – Maulana Shah Muhammad Abdul Aleem Siddique, who dedicated his entire life preaching and propagating Islam in Singapore and around the world.

The Moroccan influence in the architecture and the interior design of the Masjid was the work of five Moroccan artisans who were specially flown in during the construction of the Masjid. Today the Masjid stands out because of its unique design.