- Posts
- 39
- Comments
- 304
- Joined
- 3 yr. ago
- Posts
- 39
- Comments
- 304
- Joined
- 3 yr. ago
You can try to use VSCode + roo to intelligently chunk it autonomously. Get a API key from your llm provider of choice, put your data into a text file, Edit the roo agent personalites thats set to coding by default. Instead add and select a custom summarizer persona, for roo to use then tell it to summarize the text file.
As other commenter said your workflow requires more than what LLMs are currently capable of.
Summarization capability in LLMs is an equation of LLMs capacity for coherence over long conversational scaling operated on by the LLMs ability to navigate and distill internal structural mappings of conceptual & contextual archetype patterns as discrete objects across a continuous ambiguity sheaf.
This technical jargon that boils down to the idea that an llms summarization capability depends on its parameter size and enough vram for context lengths. Higher parameter and less quantized models maintaining more coherence over long conversations/datasets.
While enterprise llms are able to get up to 128k tokens while maintaining some level of coherence, the local models of medium quantization can handle 16-32k reliably. Theoretically 70b could maybe handle around 64k tokens but even thats stretching it.
Then comes the problem of transformer attention. You can't just put a whole books worth of text into an LLMs input and expect it to inspect any part in real detail. For best results you have to chunk it section by section, chapter by chapter.
So local llms may not be what you're looking for. If you are willing to go enterprise then Claude sonnet and deepseek R1 might be good especially if you set up a API interface.
"No python. Raise the voltage."
- Wish 1: "I wish that my third wish will retroactively become my first wish instead, but I retain all memories from every timeline."
- Wish 2: "I wish that every wish I've made after my first wish never happened, except for my memories of them."
- Wish 2b: Genie... i've come to bargain..." user proceeds to enforce temporal paradox type 1a 'causal-loop' until 'negotiation leveraging favorable terms' for infinite wishes without the monkeys paw BS is complete
- Wish 3: "I wish to break this cycle and return to normal linear time, keeping all accumulated memories."
No, the 100-200$ Galaxy S mid range android phone with half decent RAM, screen size, actual specs and features that enable practical work, social communication, or entertainment consumption with a reasonable price to lifespan cycle ratio is.
You know, something you can actually buy outright, calculate approximately how much value you got by how many years it lasted before breaking, and not get stuck into a never-ending cycle of slowly frog-boiling raising contract rates.
So wheres the brand new retail sold 200$ Iphone budget entry for the plebs to access the IOS ecosystem on the cheap?
Yeah, I thought so. its called market segregation and Apple knows the exact crowd they made a billion dollar industry pleasing.
Any phone thats >500$ and doubley so for >1000$ are for the people who spend hundreds of dollars a month on contracts renewing them continuously every two years convinced its somehow a deal and don't think twice about it. Different flavor of luxury good gotta get that tribalism social posturing in after all.
If you were a true professional in an industry making complete use for videography, audio recording and editing, music production, I could maybe see it.
But lets be real, thats the statistical outlier for apple users you know exactly what 99% of people do with their phones. Check emails, shit posting on the internet, watch youtube, MAYBE record a quick video or picture without knowing how to manually balance anything or even knowing what an ISO is.
Keep in mind most people don't know any better and will happily use acryllic microplastic yarn instead of real organic plant/animal or even a combo without ever considering the implications simply because its cheapest. Hobby crafts people will absolutely buy the cheapest with the biggest bang for your buck and don't consider that they're shedding microplastics all over their home, breathing it into their lungs and in their body. But hey the cat got a cute wittle piece of furniture on the cheap and the microplastics are already here so why not embrace it.
The Iphone is a luxury commodity and like all luxury commodities it marketed for people with little sense and lots of money who are easily separated from the ladder with shiny trinkets. Before the Iphone there was the Rolex and the super-secret clothing designer brands only 1%er yuppies think they know about. Before that people ground up egyptian mummies for medicine/taste and bought expensive jar of nutmeg spice from halfway across the world imported via boat. These kind of people were always going to spend 2000$ on trinkets whether its a 2000$ pocket computer or a 800$ wrist watch is a difference in taste. The real question is why humanity can't shed this consumerist prone archetype what is it about people constantly wanting new shiny things that they don't need and for which the money can go to a better place? Why do modern consumerist not have the ability to tell corporations to fuck off? Why is it that after a quarter century of time to get used to the concept of a computer and an email people tantrum and shriek when their tappy button gets moved 2 inches to the left without knowing how to fix it? Why do we consider this an acceptable baseline for human intelligence and emotional volatility?
ꙮ ᚠ𐎀⁂☙ ⸘⚮𖤍
and then everyone clapped
Sure, whatever nerd.
The secret nerd technique they don't want you to know is to get a big usb stick housing for a proper m.2 SSD stick. Form wise its a slightly chunkier usb stick. Inside is a proper drive you can buy from a reputable source with terrabytes of storage and 3.0 speeds. A reputable SSD drive will easily last a decade.
As far as store bought regular old sandisk will last a long long time.
If I remember George Carlins bit correctly the amount of golf courses in the US took up two rhode islands and a delaware worth of space once counted up. He argued we should turn it into homeless shelters and public housing, and to let the golfers test actual skill at the mini-golf. Actually looking at it semantically I wonder if the word mini-golf exist just to demean it compared to big boy real golf.
arXiv is the standard for researcheres in my field to publish their works as an open collective. I'd like to formally offer it to the scientific community to both prove myself as a proper member of the field even if I never had formal education and maybe get a bit of clout added to a resume portfolio if its real and game-changing.
I know how academics are though so im keeping expectations in check, have to have some healthy skepticism to keep myself in check about this in case its not or only passingly noteworthy.
I have my own website where I do in-depth technical writing and im a community leader in some social media places so worst case scenario ill just add a section to my website and post on the social media places about it. If I make use of the findings to enhance my own systems then Ive proven to myself and the community who adopts them that it works as a functional useful system which is arguably more important and which may snowball.
Your welcome! Its good to have a local DRM free backup of your favorite channels especially the ones you come back to for sleep aid or comfort when stressed. I would download them sooner than later while yt-dlp still works (googles been ramping up its war on adblockers and 3rd party frontends). BTW yt-dlp also works with bandcamp and soundcloud to extract audio :)
It depends on how nerdy you want to get.
Generally no, That checkmark is cloudflares multi-million dollar product that protects half of the internet from bot abuse. If there were a quick and easy work around then the bots would quickly learn and adopt it too. Sadly, it has a real penchant for triggering for regular users when you're using hardened browsers and VPNs as well. It would be nice if network admins cared a little more about sticking it to the man and using bot protection alternatives instead of just proxying through a cloudflare tunnel and calling it a day.
If you're slightly tech savvy and lucky then the site allows web crawlers/indexers or has RSS feeds. This lets you use an RSS feeder or a text scraper like NewsWaffle
What youre describing with saving a cookie to prove your identity is actually do-able, yt-dlp uses this to download age restricted content but getting that cookie extracted into a text file is a non-trivial nerdy thing the average person cant be trusted to do.
points in a direction your mind can't understand, with the finger seeming to disappear as it bisects into a higher plane
"over there to the left after the bathrooms"
The defiance thing itself is induced by being a half-sentient talking ape that doesnt like being told things like "No!" "Thats bad, dont do that!" In terms of their actions. The antivaxers also like to layer in government mistrust and religious faith levels of i-must-be-right but the core of defiance is just that people dont like feeling shitty and have poor instinctual coping methods for it.
Its a fairly universal copout for humans to avoid feelings of shame and embarrassment or punishment. Nobody on the planet likes feeling stupid or in the wrong. So when confronted with these feelings some common stategies are out right lying to others or ourselves, or constructing a delusional warped narrative subjective reality in which they're actually somehow in the right through mental gymnastics, or by rejecting the claim of wrongness through formal argument, or using social dominance plays to forcefully dismiss claims of wrongdoing.
Usually people find a strange mixture of multiple of these strategies in emotional combative arguments and coping with their aftermath.
In an ideal world people would be able to instantly accept blame and fault for wrongdoing, eat he feelings of shame and self improve without trying to weasle their way out of punishment if they think they can get away with it. A properly adjusted adult who has eaten their fair share of humble pie over heir life encroaches on that kind of humility and willingness to update their assumptions given evidence, is able to say "oh shit I was wrong about that, huh? My bad." Or "the science nerds who study these things probably have more authority on the matter than I do, I'll default to their ideas." This however, is not an ideal world.
Children have zero impulse control and are barely sentient enough to construct coherent sentences or internal monologues. Their tiny brains are still developing and so they get a free pass more or less when it comes to being defiant little shits defaulting to instinctual ape copout strategies. all kids have their bad moments and are still learning. The problem is when they never stop defaulting to these things in adulthood.
— try long pressing your phone keyboards hyphen key.
Its an ambiguous slang statement that can mean several different things at once. It requires extra work to ground in a well-defined meaning.
Much in the same way 'going to the bank' could mean a financial institution or a river, 'dropping' something can mean releasing a new thing, stopping support, or physically fumbling an object on the ground. OP could have done a better job disambiguating with either different words or more context.