While mushrooms are cooking, mix cornstarch with a little of the milk in a small bowl to make a smooth, thin paste. Then add the rest of the milk and stir until mixture is free of lumps.
Slowly add milk mixture to mushrooms in the pan, stirring constantly. Cook over low heat for 1 minute.