Agency work can’t be that bad - as after all, so many firms seem to have policies in place for preventing people “leaving on purpose and coming back there on agency”.
If you resign a full time job, you’ll likely be banned from site there. The “Agency Gamble” in this case is “Can you find enough decent work elsewhere to where you’ve been a lot of late?”