Whisk together powdered sugar, 2 Tbsp. milk, rum, and vanilla. Stir in up to 1 Tbsp. more milk, 1 tsp. at a time, until desired consistency is reached.