In this talk I will describe why the  structure of information in the holographic correspondence is readily described by quantum error correcting codes. I will introduce the necessary notions of quantum error correcting codes and show how they may be composed using the language of tensor networks. Using these tools, I will introduce a family of exactly solvable toy models of a holographic correspondence called holographic quantum error-correcting codes. These models capture key features of entanglement in the holographic correspondence. Namely, bulk operators admit multiple representations on boundary regions mimicking the Rindler-wedge reconstruction. Furthermore, the Ryu-Takayanagi formula for entanglement entropy and the negativity of tripartite information are obeyed exactly in many cases.