A great bargain option is to pick up fried seafood platters or fish sandwiches at Sayle’s, which is a short walk from the harbor, and eat it by the water. This is water-view dining on the cheap, and the fish here is among the best you can get on the island.