Plough Inn is a significant remnant of Madison's early development. It served pioneer farmers, business travelers, legislators, civil war soldiers, and city visitors. Frederick Paunack was a stonecutter and prominent stone businessman in Madison. He and his wife Amelia constructed the building from local sandstone as a residence. Paunack quickly converted it to an inn as the number of travelers increased on the newly improved Madison-Wiota Road.

This simple vernacular structure has few distinctive elements of the Greek Revival style. These include returned eaves and a shallowly hipped roof. The main entrance, once facing Monroe Street, was reached by a wide, wooden porch. A below grade doorway leads to what was the taproom for the inn. The interior is also simple. A long hall extends from the entrance to the back stairway. In the late 19th century a large parlor located at the front of the house was a common room for the inn.

The building is now Arbor House: An Environmental Bed and Breakfast Inn. It is open to lodging. Please respect the privacy of its owners and guests.