Combine vinegar, lemon juice, sugar and salt in large nonreactive pan. Bring to boil over medium-high heat, stirring until sugar dissolves.

Add allspice and apples, lower heat to medium and cook for 15 minutes, stirring occasionally.

Remove from heat, add horseradish and allow sauce to cool to room temperature. Sauce will thicken as it cools.