Downgrade from M2 to M1?

Last year I ditched my trusty iMac 27" (2009 model) after 11 years of use, and bought a new 2023 Mac Mini M2. Unfortunately I chose unwisely, going for the smallest SSD (256GB) and thinking that a 2TB Satechi add-on device would fit the bill, rather than paying Apple the £850-plus difference to upgrade to 2TB on-board. The limitations were quickly evident; recording audio to an external drive results in glitches and frequent crashes, and it's a clumsy process to be continually moving files to free up space. New 2TB model now out of reach financially but there are a few 2020/2021 2TB M1 Minis out there for reasonable prices. Question - am I likely to notice a difference in the speed? Nothing I do is particularly processor-heavy (mainly Cubase and Sibelius music software) and I was perfectly happy with my old iMac 27 for years, so I'm thinking I'd probably be OK. But if I'm overlooking anything..would welcome opinions. Thanks