thanks for clarifying. it was hard for me to dignify such a comment with a response.
you’re also going to run into hardware acceleration issues trying to run Metal acceleration with a Linux kernel. i don’t really see a need to containerize these workloads these days anyway with tools like uv.
it’s a big pain in my ass at times trying to do web dev work with an aarch64-darwin dev env vs the target x86_64-linux. adding in hardware acceleration issues just sounds painful.
i also just personally don’t like containers. feels like bludgeon of a solution.
semantic search is a great use case. get a good embedding model and setup Postgres with pgvector, and i can semantic search my Obsidian D&D notes