In this paper we describe our approach to realize a pervasive (computing) learning environment for children based on augmented toys: traditional toys that are equipped with pervasive computing technologies and can thus be linked with virtual information such as educational content. We report on our experiences building and deploying the Augmented Knight’s Castle, an augmented toy environment that allows for learning about the Middle Ages in a playful way. We demonstrate and discuss how educational content is provided in such an environment and describe the design of the underlying infrastructure.