M1 mac google contacts not syncing

I added the google account in accounts as usual, but it wouldn't sync my contacts.

I followed the troubleshooting article here: https://support.apple.com/en-us/HT203521

The solution was to remove the google account from internet accounts and it asks "do you want to remove from ALL devices (including my old laptop)?" -> "yes". Then re-add it, and the syncing started immediately.