It's fine.
Obviously, context matters... if someone is at work talking about their female superiors and calling her a "Gal" then that might not be appropriate. BUt... for a husband referring to his family ... I don't think it's your call to judge and I don't think there's anything wrong with it. If he's shooting the shit and you say, "What are you up to this weekend?" and every time he replies "I am taking my wife and four daughters to the sports event," then it would sound stilted and awkward, as oppsoed to "Me and the gals are going to the game." He's probably comfortable saying it about his family, but might not say it if referring to a group of 3 or 4 women at work... "I have a meeting with the gals at 3PM to talk about GDPR Compliance," would be mroe dismissive than an endearing way to refer to his family. I'd see it similarly if a woman has 3 sons and a husband her referring to them as "The boys," which is common, and endearing.
My wife uses the word too for her girlfriends, or when her sister and their kids are hanging out ... "The gals!" Or "Galentines Day," Etc.
If you're using it in a pejorative way, then sure, it could be a pejorative but... don't do that. Like, if your female superior at work corrects you when you do something wrong and you say, "ugh, okay, GAL," then that's not right, I'd see it similar to if a male superior corrects you and you respond, "ugh, okay, BRO." It's dismissive and disrespectful.