The remains of a prehistoric hill fort, dated around 500-300 BC, can still be seen at Woodbury Castle. This scheduled ancient monument comprises multiple ditches and ramparts, and was probably used as a stronghold by the local chieftains. Sited on Woodbury Common, the castle has extensive views over the surrounding area. The remains of circular wooden houses and a series of wooden buildings, thought to have been granaries, along with a small oven and a piece of pottery dated 600-500 BC have been discovered here. The B3180 runs through the castle.

Between 2000-1000 BC, during the Bronze Age, burial mounds called 'barrows' were built and can still be seen to the north of the castle. Excavation of one of these barrows led to the discovery of a bronze dagger and a stone battle axe. Finds, together with those from other locations on the Commons, can be viewed at the Exeter City Museum.