Am I missing the point completely here?
In general? Yes, I would say so. There's nothing that USB-C audio offers users that the 3.5mm jack doesn't already do (despite whatever the fluff pieces you've read online will tell you), without needing promises that the standard will get better over time. Side-stepping that with 'just use a Bluetooth set' isn't worth discussing, as Bluetooth audio quality is not ideal, and many people don't want to invest in a separate pair of headphones just for their phone when what they have is already pretty good. What you think is 'fine' applies to your sole use case, and has nothing to do with anyone else.
I have a phone that uses only USB-C audio, and I find the out-of-the-box experience really flat and poor compared to pretty much every previous handset I've used in the past. I won't mind if someone makes an adapter that addresses my power and clarity concerns, but that still won't resolve the issues others have raised, which is just as easily remedied by just having a 3.5mm jack in addition to the USB-C jack. I also have a pair of Bluetooth headphones that Samsung gave out for free with phone upgrades years ago which I use once in a while, but the audio quality is so muddy compared to the output when I use the 3.5mm jack on the very same pair that it's often barely worth using them over my normal pairs.
Your 'solutions' actually come with a compromise somewhere - be it an additional cost, having someone's use case stepped on by a company's unfortunate hardware design, or lacking audio quality. They don't have these issues with what's already available. You have to be able to think outside of your own usage scenarios and think of how this move actually affects others. I'd honestly be surprised if USB-C Audio only handsets don't get walked back the same way that ditching user-expandable storage was. Removing the headphone jack is solving a problem nobody had.
/cdn.vox-cdn.com/uploads/chorus_asset/file/9601553/oppo_r11s.jpeg)
