Combine the first 5 ingredients in a medium saucepan, and bring to a boil over medium-high heat. Reduce heat, and simmer 5 minutes or until thick and golden brown. Remove from heat. Add powdered sugar and vanilla, and beat at medium speed of a mixer until smooth and slightly warm. Add milk 1/2 teaspoon at a time for a more spreadable consistency, if needed.