vorato I use DisplayPort if that matters
That might very well be the issue. Unfortunately Nvidia has introduced a bug in their driver some versions ago, that makes it crash in connection with DisplayPort.
See e.g. here
Should be fixed as soon as the 470 version lands. I expect this Friday Sync. You can follow this to see when it's commited.
In the meantime, if you don't want to wait, you could switch to either the nvidia-beta-driver or nvidia-developer-driver, which aren't affected.