Pre-heat oven to 350 degrees. Line a loaf pan with parchment paper. Oil and flour the exposed sides of the pan. In a Standing mixer bowl add oil and sugar. Mix in eggs. Add vanilla, and, rosemary, lemon zest, lemon juice. Mix. Add dry ingredients and buttermilk and blend. Pour into the pan. Add almond slices on top of the batter.
Bake for 1 hour to 1 hour and 15 minutes. Cool and serve.