Place first 4 ingredients on a 4-inch square of cheesecloth or coffee filter; tie with string.
Pour cider and orange juice into a small saucepan; add spice bag. Cook over low heat 15 minutes, stirring occasionally. Remove and discard spice bag. Pour cider into mugs. Garnish with cinnamon sticks, if desired.