Doesn't sound normal but I can't tell if it is an exhaust leak or something inside the engine.
You may start by feeling arounf the manifold where it meets the engine. You'll have to do it when its cold of course because you're going to want to get right up on the mating surface.