Airpod Pro 3 Temporary Sharing Noise Cancelling weak

My Airpod Pro 3 worked great when I am using them on my iphone, ipad, etc and specifc to noise cancelling they are awesome. However when I connect to my wife's ipad to watch a movie, which I do in temporary sharing mode since she is watching it with me, the noise cancelling doesn't seem to be completely off, but it is not very good especially compared to when I use them directly connected to my devices. Is there a known issue or the way it works when in temporary sharing?