I was curious, do you run Stable Diffusion locally? On someone else’s server? What kind of computer do you need to run SD locally?
I was curious, do you run Stable Diffusion locally? On someone else’s server? What kind of computer do you need to run SD locally?
You can run llama.cpp on the CPU with reasonable speeds making full use of normal RAM to run much larger models.
As for 10GB in SD, I run into lack of VRAM quite constantly when overdoing it, e.g. 1024x768 with multiple ControlNets and some other stuff is pretty much guaranteed to overflow it. I have to reduce the resolution when making use of ControlNet. Dreambooth training didn’t even work at all for me due to lack of VRAM (might be possible to work around, but at least the defaults weren’t usable).
10GB is still very much usable with SD, but one has to be aware of the limitations. The new SDXL will also increase the VRAM requirements a good bit.