Combine first 4 ingredients and water to cover in a stockpot. Bring to a boil. Reduce heat; cover and simmer 30 minutes. Add mushrooms, ham, chives, and thyme; simmer 15 minutes. Stir in milk; cover and simmer (do not boil) 30 minutes. Stir in butter and crackers. Serve hot.