"ello peejon" - Pepe le Peu

Does anyone know the origin if the phrase "being pigeon-holed"? I've almost figured it out, but I'm not sure if it's the hole on the front or the back of the pigeon. Please help; there are feathers EVERYWHERE, and I'm running out of pigeons.