The diocese was founded by Charlemagne in 804 in order to missionize Saxons and Polabian Slavs. Its capital was initially Osterwieck, but was soon moved to Halberstadt. When the Archbishopric of Magdeburg was founded in 968, Halberstadt lost the eastern half of its district to it, and was made subordinate to Magdeburg.