Would it work to turn off the microphones on your HomePods, turn off listening for "Hey Siri" on your phone, iPad, and Macs, and set your Apple watch to the "raise to speak" setting, and then do all your voice control through the watch?

If that works, that might be a solution for people who want the convenience of voice control but do not want an always-listening microphone in their house.