Stir together first 2 ingredients in a large punch bowl. Scoop sorbet and sherbet into punch; add fresh rosemary sprigs. Serve immediately.
