Thanks. I don’t understand web UI enough. Thought it had to be hosted somewhere. I’ll try it out.
I just want to use it for general web search, data processing and maybe some light automation. In the beginning I just wanna understand how it all works and how to set it up so small model is fine.
When using llama.cpp, does it pass your prompts through a web server to process? Any privacy concerns?
Sounds like I’m looking at a few grand to run something decent. I’ll need to do more research before I commit to that big of a purchase, but your machine sounds nice!
Are there any small models you recommend that can run on 16GB DDR4 and an i7? No dedicated graphics card with separate VRAM. Maybe I’ll just experiment with something v small first.
Yeah it’s rough, but depends on your job and where you work. If you’re remote you have a lot of affordable, albeit undesirable, places to live in the US. If you’re working in a metro area you likely won’t be able to afford anything decent in the immediate areas around you.
If top of your price range means you’ve already calculated for what would happen if your income was jeopardized, then go for it. If top is living beyond your means, then probably not a good idea any time.
Thanks. I don’t understand web UI enough. Thought it had to be hosted somewhere. I’ll try it out.
I just want to use it for general web search, data processing and maybe some light automation. In the beginning I just wanna understand how it all works and how to set it up so small model is fine.