Heat the milk in the saucepan until it comes just up to the boil, then take off the heat immediately. In a bowl, beat together the egg yolks, vanilla sugar and flours. Pour the milk slowly over the egg mix, beating well.
Return the mixture to the pan and place over a low heat, stirring for 8-10 mins until the mixture begins to thicken. Remove and serve with the dumplings.