I think the point of veganism is to reduce harm and exploitation. Is the person willingly giving milk in the situation? Are they being exploited in any way related to the milk? If no, then it’s vegan.

The same question could be raised for other human products - like human hair wigs. If the person happily donated the hair, then I’d consider it vegan.