The only disadvantage I can think of is that the milk paint is a denatured protein stain and therefore will not be removed by normal solvents and even water-based solvents.
So no stripping - but you can paint it over. Not a problem when you paint the kids’ building blocks, because you won’t want to change their colour too often