Vision Pro - VisionOS 1.2 - Macbook virtual display window does not anchor

When I connect to my macbook pro from my vision pro the window does not anchor and actually follows me a little when i leave my desk.

I have noticed that if a window casts a shadow on my desk or any other surface it anchors properly

If there is no shadow the window does not anchor and moves as my head moves and follows me as i leave my desk

Any ideas how to resolve this?