Son of Margaret Montgomery and Peter R. Summers. He married Ella Proctor on 16 November 1892 in Guilford County, North Carolina. There were seven known children from that union, three of whom died in childhood or at birth.

Following is obituary printed in the Greensboro Daily News (NC), November 19, 1926:

James F. Summers, aged 71, died yesterday morning at 9:30 o'clock at his home at Summerfield. he had been in declining health for several years. He leaves his wife, tow daughters, Mrs. R.L. Winfree and Mrs. Charles Pulliam of Summerfield; two sons, Lacy Summers, of Greensboro and John Summers, of Summerfield, and two sisters, Mrs. Maggie May and Mrs. John Ingle of Gibsonville.

Mr. Summers was a member of the Summerfield Methodist church. Funeral services will be held this afternoon at 2 o'clock from the Baptist church at Summerfield, conducted by Rev. W.T. Albright, and interment will be made in the church cemetery. 470, James Franklin Summers