While at University College in partnership with William Jackson Brodribb, he translated Tacitus and edited Pliny's Letters (Epistulae). Church also wrote a number of stories in English re-telling of classical tales and legends for young people (Stories from Virgil, Stories from Homer, etc.). He also wrote much Latin and English verse, and in 1908 published his Memories of Men and Books. Church died in Richmond, Surrey.