Preheat the oven to 350 degrees then coat a 9x5 loaf pan with cooking spray.
In a large bowl, beat together the butter and sugar with a hand mixer until creamy. Add the eggs, bananas, and vanilla then continue beating until well combined.
In a separate bowl, combine the flour, baking soda, cinnamon, salt, and fresh nutmeg and mix well.
Add the flour mixture to the banana mixture and stir until just combined. Pour the batter into the prepared loaf pan.
Bake for 55-60 minutes or until a tester inserted in the center comes out clean. Let the bread cool in the pan for 10 minutes then turn it out onto a wire rack.