Debug silent ASR failure in Gradio read-along app
Takeaway: Next time I'd paste the log and ask directly for exception logging around the ASR wrapper instead of first asking 'what's happening,' since that's exactly what we ended up doing anyway.
Stack · 2 sessions
llama-cpp-python sessions with coding agents
2 sessions on llama-cpp-python with a coding agent: the agent failed at least once in 1, and 1 finished without a human stepping in.
Add local GGUF inference path and hybrid Modal/local toggle for read-along app
Takeaway: Next time I'd ask for the environment sanitization (Conda vs .venv Torch conflicts) to be handled up front, since that same libtorch_python.so issue bit me twice, once during GGUF conversion and again during local_inference.py testing.