Place first 3 ingredients in a coffee filter or filter basket of a coffeemaker. Add 5 cups water to coffeemaker; brew according to manufacturer's instructions.
Combine milk, sugar, and syrup in a heavy saucepan. Cook over low heat, stirring constantly, until sugar dissolves. Stir in brewed coffee and vanilla. Serve with whipped cream, if desired. Serve immediately.