The first Custom House opened in 1620 on the Tuesday Market Place, where the Hogge Mansion (currently owned by Barcaly's Bank) stands. However, it was too small and St George's Guildhall was used temporarily until in 1685 when the Custom House that survives today opened. It was built by Sir John Turner from Ketton Stone, having been designed by Henry Bell.
The ground floor was used by merchants who used it for dealing, and HM Customs occupied the first floor. However, due to the distance from the Tuesday Market Place, merchants became unhappy with this arrangement and by 1717 Customs occupied the entire building.
300 years on and whilst the building is no longer used for its original role, it is still Lynn's most famous building and is open to all visitors as it is now the Town's Tourist Information Office.