James H. Brownlee was a son of James and Margaret (Hill) Brownlee. He married (1) Christiana McDiarmid and (2) Susan E. Montgomery. Their five children included Margaret Jane (Nettie) who married Harvey Macartney and Delmer James ('Dellie') who married Lulu Code and remained on the farm occupied by his father and grandfather.