In truth, this structure is known as the ‘1668 Turner/Ingersoll Mansion’ (Turner and Ingersoll were both sea captains- one sold the mansion to the other). Good luck with calling it that, though.
The Ingersolls were cousins of Nathaniel Hawthorne. Hawthorne’s visits to one female cousin (who would inherit the mansion herself) inspired the setting and title of his 1851 novel.
Caroline Emmerton and Joseph Everett Chandler are credited with saving and restoring the house so that we can appreciate and visit it now. In 1908, Emmerton purchased the mansion and restored it to its original seven gables.
Over time, other structures were purchased and moved to the site, notably including Hawthorne’s birthplace. It now composes its own National Historic District in the National Register of Historic Places.