Bring potatoes with water to cover by 2 inches to a boil in a medium saucepan over high heat; reduce heat to medium. Simmer 25 minutes or until tender. Drain and return to pan. Add goat cheese and next 3 ingredients; mash with a potato masher until cheese and butter melt. Gradually add milk, mashing to desired consistency.