Easy to miss as you ascend the hill into town, the Moffatt-Ladd’s on the right as you begin to enter the commercial district but well before you penetrate it. It was built in 1763 by a successful merchant with a view right down onto his docks and operations. The gardens are as well known as the house’s woodwork and architecture. The same family kept it for nearly 2 centuries, so most of the furnishings and artwork here are absolutely original—and that’s rare.