In a small bowl, mix cocoa and sugar. Add milk a teaspoon at a time and stir constantly with a spoon or small wire whip until you have a smooth, velvety paste, thick as heavy cream.
Continue adding milk to thin the paste more, then stir all the milk into it.