Though with quantisation you can get it down to like 30GB of vram or less.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Though with quantisation you can get it down to like 30GB of vram or less.