Charles de Lannoy was born the younger son of Jean de Lannoy, Lord of Mingoval, and his wife, Philipotte de Lalaing (c. 1487). He took service with the Emperor Maximilian I and won distinction for bravery and leadership. He was appointed to the council of Charles of Burgundy — later Emperor Charles V. (1515). He was appointed knight of the Golden Fleece in 1516. He became governor of Tournai in 1521, was made viceroi of Naples in 1522 and made commander in chief of Imperial armies in Italy upon the death of Prospero Colonna at the end of 1523.