I do myself, on albeit 5 year old hardware that struggles on my home server, but with decent GPUs with decent amounts of Vram running in the thousands, it isn’t accessible to most even with the inclination.
I’m running both image and text generative AIs on an 8 year old PC with a $250 nvidia 3060. There is some latency but it is very usable. I use them as the brains of a private discord bot. Granted, it’s not going to be enough to start a business but it has paid for the video card with image credits and donations.
So yeah, it can be expensive but it’s still reasonable to run it on budget/used hardware for personal or small scale implementations.
I do myself, on albeit 5 year old hardware that struggles on my home server, but with decent GPUs with decent amounts of Vram running in the thousands, it isn’t accessible to most even with the inclination.
https://www.usatoday.com/story/money/personalfinance/2024/01/25/emergency-expense-savings-study/72356517007/
AI is open source, but running it is an expensive proposition, Raspberry Pis need not apply.
The owners can buy all they like without a thought though to use against us for their gain.
I’m running both image and text generative AIs on an 8 year old PC with a $250 nvidia 3060. There is some latency but it is very usable. I use them as the brains of a private discord bot. Granted, it’s not going to be enough to start a business but it has paid for the video card with image credits and donations.
So yeah, it can be expensive but it’s still reasonable to run it on budget/used hardware for personal or small scale implementations.