From what I'm able to tell from a quick search USB 3.0 support isn't as mature in VirtualBox as USB 2.0/1.1, it probably supports it as a USB device in itself but try switching the USB mode just for the installation process and see what happens (and then switch it back after you've finished installation).
Not actually replicated this myself since I don't even have a USB 3.0 port on my desktop, but I'd take a shot at that. Installation will obviously be slower than if it worked in the first place but it would probably work fine afterwards...