Bring first 4 ingredients to a boil in a saucepan; reduce heat, and simmer 15 minutes. Cool slightly; discard cloves.
Process apple mixture in a blender or food processor, in batches, until smooth. Return to saucepan, and stir in butter, horseradish, and lemon juice. Cook over low heat 2 to 3 minutes or until thoroughly heated.