Combine 2 cups cranberry juice, sugar, zest, cinnamon, and cloves in a saucepan.
Simmer over medium heat until sugar dissolves. let stand about 30 minutes.
Strain into a pitcher; stir in vanilla, rum, bitters (if using), and remaining 2 cups cranberry juice. Divide among 5 ice-filled glasses.