In a small saucepan, combine the sugar and cocoa. Gradually whisk in 1/4 cup water and bring to a boil. Reduce heat and simmer, stirring, until slightly thickened, 2 to 3 minutes. Let cool slightly.
Divide the frozen yogurt and bananas among bowls and top with the chocolate sauce and almonds.