Wanna start a business with AI Agents? Go here: https://www.skool.com/new-society
Devs, I’m hiring! Apply here: https://www.vectal.ai/jobs
Try Vectal for FREE: https://www.vectal.ai/
Follow me on Instagram – https://www.instagram.com/davidondrej1/
Follow me on Twitter – https://x.com/DavidOndrej1
Host your n8n agents on Hostinger: https://www.hostinger.com/david
Subscribe if you’re serious about AI.
Links:
https://github.com/sammcj/gollama
https://artificialanalysis.ai/models/open-source/small
Timestamps:
0:00 – 3:06 Why should I run LLMs locally?
3:06 – 8:43 Ollama
8:43 – 13:48 Downloading a model
13:48 – 21:20 LM Studio
21:20 – 24:51 Best local models?
24:51 – 25:30 How to choose a model
25:30 – 28:15 Quantization
How to run an AI model locally – beginners guide
