It sure can! And it supports SO many backends so you can run llama.cpp (pulled directly from the repo and auto updated so you have access to all of the new features right away)
Sorry I took so long to reply, things have been a little hectic with personal/work life
So thats a super interesting feature which might be doable depending on whether or not I opensource this thing (which I might end up doing in the end)...
For now I think it's out of scope...
That being said, I ended up implementing an audience reaction feature today (think IG live emoji thing) along with an accompanying DJ tool (so that the DJ can "see" reactions to a song).
I'll probably implement an audio quality thing next. I noticed that when I'm on mobile and in a bad coverage area (which is everywhere I live), music take a LOOONG time to actually begin playing... really dislike that...
You can definitely give it a shot now, it's done at this point!
Keep in mind the llm can pick and choose between the various tools to call so news may not be called out each time
OK so, I'm almost done with the tool for the AI DJ. Basically we're using searxng to search for audience locale news + using rss feeds to provide the llm with context about specific news categories (Technology for example)
Saw your request and songs are queued for generation! The new station is called Cloud 9 Chill FM
So it supports station jingles but the intent there was just for a "youre listening to so and so station" announcements (same as in regular radio).
I'm not sure about AI podcasts though... maybe like a news station would be useful
Thanks, I really appreciate it! Not all the stations have an AI DJ btw... I should probably add some visual queue in the station browser which shows whether or not one is set. Also, some of the AI DJ actions dont trigger if there arent enough people listening to a station (like polls for example)
ADG for ace step is Adaptive Dual Guidance. try turning that on + make sure you have thinking enabled, I saw a big difference with both those on (more so thinking)
Yeah I completely agree on the lyrics it can generate!
That being said I actually haven't tried using the 4b lm model version just yet. I should probably give that a shot...
so i'm using an open source model which leverages a 3090. I tried to make the app itself as agnostic as possible so I can just plug any API compatible server into each component (track metadata generation, actual song generation, AI DJ script, DJ script and so on). I figured making this thing as flexible as possible would be best overall
Was thinking the same thing, not sure what they think they're going to accomplish with a polygraph.... Maybe it's a scare tactic