I'm not doing a whole lot of coding yet with AI, but I am starting to run local AI, such as running
Ollama with qwen3.5:2b. My main use case is just a quick chatbot, and this seems to be about the minimum possible to get that experience. According to gemma 4 12b (run via nano-gpt for local use you hit diminishing returns after ~30b for a conversational model like i want. I have submitted a couple of features to the meshcore open app and gotten them accepted but I was using Kimi K3 for that and I was using it from nano-gpt.
I'm not doing a whole lot of coding yet with AI, but I am starting to run local AI, such as running
Ollama with qwen3.5:2b. My main use case is just a quick chatbot, and this seems to be about the minimum possible to get that experience. According to gemma 4 12b (run via nano-gpt for local use you hit diminishing returns after ~30b for a conversational model like i want. I have submitted a couple of features to the meshcore open app and gotten them accepted but I was using Kimi K3 for that and I was using it from nano-gpt.