Lord Carrington married, firstly, Anne, daughter of Lewyns Boldero-Barnard, in 1780. They had one son and five daughters. After her death in 1827 he married, secondly, Charlotte, daughter of John Hudson, in 1836. Carrington died in September 1838, aged 86, and was succeeded in his titles by his only son Robert, who later assumed the surname of Carington. Lady Carrington died in 1849. Two of Carrington's descendants gained particular political prominence. His grandson Robert Wynn Carington, 3rd Baron Carrington, was a Liberal politician and was created Earl Carrington in 1895 and Marquess of Lincolnshire in 1912, while his great-great-grandson Peter Carington, 6th Baron Carrington, is a Conservative politician and served as Foreign Secretary between 1979 and 1982.