/gamerule doMobSpawning false

This should give you what you're looking for I think. It only stops natural spawns and structures and invasions both have their own spawners so it sounds like it would work.

MilkMC ^{Ask me a question, Fandom User.}