Separate the eggs and beat the yolks with the sugar in a large punch bowl. Reserve the whites. Stir in the milk and the whipped cream. Add the Brandy and refrigerate for at least one hour. Before serving, whip the egg whites until stiff and fold into the eggnog. Sprinkle with freshly grated nutmeg.