The house does not appear to have survived.
Interesting porch columns. . . . It appears, from Google Satellite, that the house is still standing.
Georgia family in their front yard, ca. 1899, photographer unknown, via Library of Congress Prints and Photographs Division.
Click on the image for a little better view.
The parterre, viewed from the porch of “Boxwood” (Kolb-Pou-Newton House), Madison, Georgia, June 1936, by L. D. Andrew for an Historic American Building Survey (HABS), via Library of Congress Prints and Photographs Division (all three photos).
‘Parterre’ means ‘on the ground’ (par terre) in French.
A parterre is a garden of planting beds laid out on level ground, typically in geometric patterns, often outlined in clipped boxwood.
This house was built about 1845; its garden was laid out about 1854. A 1935 HABS drawing of its parterres, front and back, is here.
There are more photos of the garden in this 2007 article in Garden and Gun.