This used to happen to my (multiracial) family all the time when I was growing up. Though my sister and I do favor my dad, so people usually assumed that my (White) mom was not part of the family. When my parents were living in India, several people tried to “save” my mother from my dad, who they were convinced was actually trafficking her. It’s sad because if you flipped the script (White man, Black or Brown woman) no one would have any concern about the woman at all, even if she really was being trafficked.