Combine the pumpkin, cinnamon and nutmeg in a small bowl, stir to combine. Place the pumpkin, brown sugar, milk and vanilla in a medium size saucepan. Cook on low to medium heat until mixture is hot but not boiling, whisking as it cooks.
Place the hot mixture into a food processor to smooth the latte, you can also use an immersion blender if you like. Serve in mugs topped with whipped cream and sprinkled with cinnamon.