Born in Melbourne, the son of an Aboriginal mother and father of Scottish-African descent, Tovey endured sexual abuse, neglect and poverty throughout his childhood and adolescence. Despite this hardship he went on to become successful in the theatre in both Australia and London, including appearing in the world premiere of Oh! Calcutta!. He taught at the Bristol Old Vic Theatre School and the Royal Academy of Dramatic Art in London and co-founded the London Theatre for Children before returning to Australia in 1990.
He recently played the lead role in Skipping on Stars based on the life of indigenous tightwire walker Con Colleano, performed to celebrate the 25th anniversary of the Flying Fruit Fly Circus.