This is my final reply in this thread. The developer has said their piece, and I have said mine. Now you've waded in - so let me set the record straight.
I am a developer. I had genuine interest in this project. I read the Hister documentation and inspected parts of the repository because the documentation did not clearly answer several basic questions I had:
- How SQLite, Bleve, and stored HTML relate.
- Whether TTL or storage quotas exist.
- How browser-history deletion affects stored data.
- How previews differ from a real web archive.
- What multi-user isolation actually covers.
Yes, I used AI to assemble a plain-language summary and labelled it accordingly. Not everyone keeps the Hister codebase in their head, not everyone talks in code review and if I had these questions, I'm willing to bet others did too. The AI wrote for a lay audience because I didn't ask it to do QA, I asked it to ELI-5.
The summary contained errors. Fine. That's AI for you. However, if neither I nor the AI could find clear answers after cloning the repo, that supports my point about opacity.
At no point did I request a line-by-line audit. “Points 2 and 5 are wrong” would have answered the question.
Declining would also have been reasonable. Hell, side stepping it would have been fine too. Instead the dev decided to note the inaccuracies and rudely brush them off.
Both you and the dev seem to be under the impression !selfhosted is a one way distribution channel.
The developer came here, invited questions, then turned the raw prawn when questions arrived.
I didn't go to their their Github. I didn't abuse them. I genuinely wanted to know more about their project and share it, perhaps even work to help improve it.
They - and now you, ostensibly a happy clapper for Hister - came here.
Your claims about my effort and intent are assumptions followed by personal abuse.
Try and walk a mile in someone else's shoes before calling them low effort and shitty next time.
Still fine tuning this. I'm finding that Grug has a particular affinity for larger -b and -ub sizes. I'm now able to hit 90-110 tok/s prefil (upto 155 tok/s fresh). Specific details below
All this on a Quadro P1000 4GB card.
In-sane.
-m "%MODEL_PATH%" ^ -t 8 ^ -tb 8 ^ -ngl 99 ^ --n-cpu-moe 38 ^ --flash-attn on ^ --no-mmap ^ --mlock ^ -c 16384 ^ -b 2048 ^ -ub 2048 ^ -np 1 ^ --host 0.0.0.0 ^ --port %PORT% ^ --ui-mcp-proxyPS: Interestingly, dropping cache precision away from FP16 reduced tok/s generation by 18%. I don't know why. I'm just fine tuning MTP now to see if I can eke out a few more tok/s, as MTP enabled grug-v2 just dropped
https://huggingface.co/ProCreations/grug-35b-mtp-gguf
PPS: Sadly also discovered my Tesla card has intermittent electrical fault. Took some troubleshooting to figure it out, but the long and short of it is you probably shouldn't buy second-hand server cards off Ebay. Oh well, $100. On the upside, tweaking throttlestop, re-pasting and re-seating greatly improved thermals.