Place cardamom and cloves on a 6-inch square of cheesecloth; tie with string.
Bring spice bag, chopped peaches, orange juice, and next 4 ingredients to a boil in a large saucepan. Reduce heat; simmer, stirring occasionally, 10 minutes or until peach is tender. Remove and discard spice bag; let peach mixture cool.
Process peach mixture in batches in a blender or food processor until smooth; stir in yogurt and ginger. Cover and chill; garnish, if desired.
*1/8 teaspoon ground cardamom may be substituted; stir in with cinnamon and ginger.