A complex of eight buildings on site includes several restored sea captains' homes, the former Town Hall, the Phillips Memorial Library and the adjoining Douglas and Margaret Carver Memorial Gallery. Displayed throughout the buildings, the museum's rich collection of marine paintings, models and artifacts illustrates the era of navigation and trade.