Lightly oil a baking pan or sturdy baking sheet. Rinse fish, pat dry, and lay in pan. (Depending on the size of your pan and fish, you may need to use two pans to accommodate all 4 fish.)
Combine lemon juice and next 4 ingredients in a small bowl. Brush fish inside and out with half of lemon-apricot glaze; set remaining glaze aside.
Stuff cavity of each fish with 2 to 3 lemon slices and 2 bay leaves. Lay 1 or 2 lemon slices on top of each fish, and tie to secure.
Bake, uncovered, at 425° for 15 to 25 minutes or until fish flakes easily.
Meanwhile, whisk together cornstarch and reserved glaze in a small saucepan. Bring to a boil over medium heat, stirring constantly. Reduce heat, and simmer 1 minute, stirring constantly. Serve sauce with fish.