Combine first 4 ingredients in a Dutch oven. Add orange slices, and bring to a boil. Reduce heat to medium-low; cook 5 minutes. Remove orange slices with a slotted spoon; place in a bowl.
Cook juice mixture over medium-high heat 15 minutes (until slightly syrupy). Pour over oranges. Cover and chill at least 4 hours.