Comment by DesaiAshu

Comment by DesaiAshu 2 days ago

2 replies

On device models (deepseek-coder, etc) are very good // better than the old way of using stack overflow on the internet. I have been quite productive on long haul flights without internet!

You're an engineer, your goal is to figure stuff out using the best tools in front of you

Humans are resilient, they reliably perform (and throw great parties) in all sorts of chaotic conditions. Perhaps the thing that separates us most from AI is our ability to bring out our best selves when baseline conditions worsen

Gallows4574 2 days ago

I know this gets asked all the time, but what is your preferred workflow when using local models? I was pretty deep into it early on, with Tabby and Continue.dev, but once I started using Claude Code with Opus it was hard to go back. I do the same as you, and still use them on flights and whatnot, but I think my implementation could be improved.

Bnjoroge 2 days ago

on-device models are still a tier or two below most frontier models(really opus 4.5).