Ballentine, also known by the nickname "Stag," was born on a farm in Wake County on April 6, 1899. After graduating from Wake Forest College, Ballentine returned home to help operate the family dairy farm. He was active in the North Carolina Democratic Party, and was elected to the Wake County Board of Commissioners and to the North Carolina Senate before seeking statewide office.