1. Preheat oven to 350°. Coat a 11/2-quart baking dish with cooking spray.
2. Combine eggs, 3 tablespoons honey, milk, and bread in a large bowl. Beat with a mixer at x speed until smooth. Add sweet potato, vanilla, cinnamon, and allspice; beat until smooth. Pour into prepared baking dish. Scatter pecans and ginger over top. Bake at 350° for 25 minutes until pudding is set and slightly puffy (it will sink slightly as the pudding cools).
3. While pudding bakes, combine yogurt and remaining 1 tablespoon honey; stir until smooth. Divide pudding among 4 bowls, and top evenly with yogurt mixture.