Update: I "unlaunched" the page, that wasn't an option before. It seems to completely delist it. Hopefully that'll prevent Patreon from unfreezing the campaign again.
If necessary, I'll re-launch the page and refund people, in the event Patreon does not do that automatically. I don't seem to have access to the Patron list without a launched page.
Update #2: All recently billed Patrons have been refunded.