Combine first 3 ingredients in a large bowl, stirring until sugar dissolves. Stir in peanut butter and next 3 ingredients (through bananas). Stir in milk.
Pour mixture into the freezer can of an ice-cream freezer; freeze according to manufacturer's instructions. Spoon ice cream into a freezer-safe container; cover and freeze 1 hour or until firm.