If you don't have powerful enough CPU, then probably not. 10-bit H264 isn't a common industry format (unfortunately, it got popular only in the anime crowd, and they are already moving towards 10-bit HEVC), and thus virtually no GPU has hardware support for it, that's why VAAPI doesn't work here. Basically, you don't have any options except software decoding for such videos, so powerful CPU is a strict requirement here.
But I see that you use gpu-hq
profile in mpv, which is geared towards powerful PCs and turns on some pretty demanding settings. Maybe you can try less demanding profile?