Solved!
I changed my BIOS settings so that the AMD GPU is the default one (Weirdly, the reason I changed it in the first place was because of issues with the Live disk). This then spat out some garbage graphics.
I then booted using the LTS kernel which has gotten me to desktop and everything seems to work fine!