Adding partner with own family to my family as a member to share apple music

My partner has his own family as a single parent and so do I, being a single parent as well. I want to add him to my family to share my apple music (I pay for up to 6 people). However, he is already in his apple family with his kids. I read that you can only be in 1 family at a time. It seems unfair that I can’t share my music now. Is there a way to make this work?