Combine first 4 ingredients in a nonaluminum bowl; crush with a spoon. Place berry mixture, vinegar, cloves, and cinnamon in a widemouthed jar; cover and let stand 2 weeks in a cool, dark place, gently shaking jar occasionally.
Strain the vinegar mixture through a cheesecloth-lined sieve into a glass measure or medium bowl, and discard solids. Pour strained vinegar into a small nonaluminum saucepan, and add sugar. Cook 5 minutes over low heat or until sugar dissolves; cool. Pour into a decorative bottle; add peppercorns and remaining ingredients. Seal with a cork or other airtight lid; store in a cool, dark place.