The village was initially called after Brian de Lisle, a Baron at the court of King John. The Rogers family owned it for a long period of time, and it was later purchased by Sir William Portman, who took part in Monmouth's rebellion in 1685. Around 1890 the Portman family built a palatial country house designed by Richard Norman Shaw set in 400 acres (1.6 km²). Subsequently in 1928 this estate was sold to Bryanston School.
Most of the remaining land of the parish is now owned by the Crown.