Preheat oven to 350F.
In a small bowl, whisk together all purpose flour, almond flour, baking powder, and salt.
In another large bowl, beat the eggs and sugar until it lightens up with bubbles.
Incorporate the flour by folding it in or using a paddle attachment. Now fold in the olive oil, yogurt, and vanilla and almond extract as well.
Prepare a cake pan by cutting out a circular piece of parchment paper to fit the bottom of the pan. Butter the parchment and the sides of the pan. Sprinkle the brown sugar evenly over the butter.
Slice your figs thinly and spread evenly over the brown sugar. Squeeze a bit of fresh lemon over the figs and add a sprinkle of brown sugar (optional). Then pour the cake batter completely over.
Bake for 50 minutes or until toothpick comes out clean. Slice and enjoy with more fresh figs, powdered sugar, and sliced almonds.