This would probably be less of an issue if they weren't also blatantly hostile to immigration increases.
This is certainly not true anymore (if it ever really was beyond rhetoric). In 2023, Switzerland had the 18th highest rate of net migration per capita of any country in the world, and has consistently been in the world top 20 on that metric for the past two decades. Consequently, 30% of its population are immigrants; in Europe, only Luxembourg, Liechtenstein, and Monaco rank higher.
I suppose that's a fair, but they do still regularly make the SVP the largest party.