From my understanding, with Nvidia there's no shared memory on Linux, so when your VRAM maxes out, you get a crash or your game will run in single digit frames.
There is nothing to be done except lowering textures and other VRAM intensive settings, and hoping that one day Nvidia fixes the no shared memory issue.
(I'm assuming you have a Nvidia GPU solely based on those low VRAM numbers)