I've accomplished this with the Atom Echo and they work... fine?
The speaker is essentially inaudible, but the mic works well enough for me to just yell at HomeAssistant to do things.
And hey, can't beat the size/price/power footprint and the deployment with ESPHome takes like, 30 seconds.