If you have older hardware which is causing problems during your experiments with LLM models . Check the blog, I have covered various tips and tricks i have used for running privateGPT on a 6-7 year older CPU.
Especially interesting for folks who have CPU’s at disposal but not GPU’s.
https://blog.anantshri.info/privategpt-and-cpus-with-no-avx2/
#GPT #AI #LLM #CPUonlyAI #hardware #selfhost