The central historic district runs along the waterfront, where you can see legitimately old buildings, Hollywood fakes , and spectacular views of the harbor from small, grassy parks. (Note that some of the remaining Scarlet Letter buildings weren't meant to last and might have been demolished by the time you arrive.) There's a lot more in the district, however, including a helpful little tourist office at the bend in the road , gift shops, a B&B (the Cooper's Inn), a husband-and-wife team of coopers making barrels in an open shop (technically, it's not open to the public, but ask nicely for a look), a kayaking and outdoor adventure center, and the Sea Dog Saloon (tel. 902/875-2862) at the very end of the road. A block inland from the water is Shelburne's more commercial stretch, where you can find services that include banks, shops, and a wonderful bakery.
Flower fanciers should inquire about the self-guided garden tours sponsored by the Shelburne County Garden Club. Some 18 gardens are open to the public. Most of the gardens are indeed quite pleasant, but almost as enjoyable is the chance to meet local gardeners and talk about a shared passion. Ask for a brochure at the tourist bureau.