Although this is a Muslim place of worship, it is not a mosque, but a shrine, built to commemorate a visit to the island by a Muslim holy man of the Chulia people (Muslim merchants and moneylenders from India's Coromandel Coast) who was traveling around Southeast Asia spreading the word of Indian Islam. The most interesting visual feature is its facade: Two arched windows flank an arched doorway, with columns in between. Above these is a "miniature palace" -- a massive replica of the facade of a palace, with tiny cutout windows and a small arched doorway in the middle. The cutouts in white plaster make it look like lace. From the corners of the facade, two 14-level minarets rise, with three little domed cutouts on each level and onion domes on top. Inside, the prayer halls and two shrines are painted and decorated in shockingly tacky colors.

Controversy surrounds the dates that the shrine was built. The government, upon naming the Nagore Durgha a national monument, claimed it was built sometime in the 1820s; however, Nagoreallauddeen, who is the 15th descendant of the holy man for whom the shrine is named, claims it was built many years before. According to Nagoreallauddeen, the shrine was first built out of wood and attap (a thatch roof made from a type of palm), and later, in 1815, was rebuilt from limestone, 4 years before the arrival of Sir Stamford Raffles. In 1818, rebuilding materials were imported from India to construct the present shrine.