Limited company advice

Keep reading on here, weekly about going ltd or umbrella, then also how bad these are, then how bad the agency’s are that force you to do this, and you should only go paye,
So my take on this would be, if nobody worked for agency self employed, and only went to those offering paye, the scam artists, shoosters would disappear . Or is that to easy, and not a perfect world…