Combine fruit and 1/4 cup brown sugar, tossing to coat. Cover and chill 8 hours, stirring occasionally.
Melt butter in a saucepan over medium heat; add remaining 1/4 cup brown sugar, and cook, stirring constantly, until sugar dissolves and mixture is bubbly. Remove from heat; gradually stir in sour cream and vanilla. Serve with fruit mixture.