Whisk together your cocoa powder, sugar, cinnamon, salt, nutmeg in a medium saucepan. Add your water and stir until fully incorporated. Bring to a boil.
Whisk in the milk and cook until just warm. Remove from the heat and stir in the vanilla extract. Divide between 4 glasses.