HomePod does not recognize primary user

The majority of time that I ask HomePod to do anything it asks me in return “who is speaking?” If I say my name, it tells me to “authenticate on your iPhone.” This drive me absolutely crazy. I AM THE ONLY PERSON WHO SPEAKS TO THE SYSTEM!!! I followed all the troubleshooting I could find in this community and none of it seems to work. Interested in a response from Apple. I think it’s a big problem that they are selling a product that does not work the way they advertise it.