Prepare Egg Mixture: Whisk together the eggs, milk, brown sugar, nutmeg, and cinnamon until well combined.
Macerate Berries: Mix the fresh berries with the caster sugar and set aside at room temperature for about 25 minutes.
Whip Cream: Combine the whipping cream, vanilla pod (split and seeds scraped), and icing sugar. Whisk until soft peaks form.
Cook Panettone: Heat a frying pan over medium-high heat. Melt butter. Dip each panettone slice into the egg mixture, ensuring both sides are well coated, and fry for 3-4 minutes on each side or until golden brown.
Prepare Berry Mixture: Give the berry mixture a final stir, lightly mashing about a third of the berries to release their juices.
Plate and Serve: Place a piece of cooked panettone on a plate, top with the berry mixture, and add a dollop of whipped cream. Serve immediately.