That is a problem of Diablo IV, because it was made for consoles, not for pc. On console it render game from GPU to SSD, while on pc it render game from GPU to CPU to SSD and that is causing stuttering, lags, freezes and game crushes. Because it uses free VRAM till it become full and then full VRAM start causing problems to CPU and the whole system.
Blizzard have told to provide fix using new method of rendering provided by DirectX 12, but it was never used before by any games and it may take time to provide it.
Solutions:
1. You may downscale your texture quality from Ultra/High to Medium that will takes more time before freezes will appear or change texture quality and return it back in the game, that will also cause clearing VRAM cache.
2. You may restart your game when ping started getting higher from 50 to 110 and more - that is the main signal that your VRAM is full and it will cause freezes.
3. You may use combination of keys Ctrl+Shift+Windows+B to force clearing VRAM cache.
For me, when I stream on medium quality texture quality freeze was appearing in about 1 hour or a bit later, but yesterday it was appearing in about 30 minutes. So it is terrible optimization of the game and I am still looking for solution, because now I can't even play 1 hour, before freeze appears.
I hope my information will help you :)