In a medium saucepan, combine the cherries and brandy. Bring to a simmer and cook until the cherries are soft but still hold their shape, about 7 minutes. Remove from heat and cool to room temperature.
Meanwhile, with an electric mixer, beat the cream cheese until smooth. Add the heavy cream and sugar and mix on low speed to combine. Increase the speed and whip until firm peaks form.
Place 6 ladyfingers in the bottom of a 2 1/2-quart bowl. Top with half the cherries and their juices, 1/4 cup of the almonds, 1/4 cup of the chocolate, and half the cream mixture. Continue to layer with the remaining ingredients. Refrigerate, covered, for 3 hours or until set. Divide among individual bowls.