Can I disable certain iCloud apps from syncing to Apple Vision Pro?

I’m trying to figure out if there is an option to only sync particular data from iCloud apps, eg Photos or Notes, etc, to my Vision Pro?

Even though the device was originally activated through my iCloud account, there are some apps that I don’t want to have sync down to the Apple Vision Pro.

I know there are some settings that disable certain content when putting it into shared user mode, however I would like to eliminate any of that data downloading initially regardless, as part of the first set up. I also want to be careful not to accidentally delete any data that might be in the iCloud account that I’m accessing on other devices such as my iPhone or Mac.

Thanks