Combine sugar and cocoa in a bowl; stir. Combine milk and margarine in a 1-cup glass measure. Microwave at HIGH 1 minute. Add milk mixture and vanilla to sugar mixture; beat at low speed of a mixer until blended.