Tag
LLM.
Latest
FastFlowLM: Systemd memlock Limits.
Fix mmap(err=-11) in FastFlowLM by overriding systemd's 8 MB DefaultLimitMEMLOCK. Learn why PAM limits fail for user services.
Read the article →
All writing
Too Long, Didn't Embed
A field guide to the quiet ways local embedding models fall over, and how to catch them before the bad vectors reach your index.
OpenLLMetry vs. OpenInference: The Observability Stack Your LLM App Needs
Your app looks fine on the surface, but users say it's failing. Traditional logs can't explain why. Enter OpenLLMetry and OpenInference—tools that bring clarity to AI observability by capturing rich, standardized telemetry from your LLM stack.
A Software Engineer's Guide to LLM Observability and Evaluation
LLM observability is key for reliable AI apps. Traditional monitoring misses semantic errors. This guide covers four essentials: tracing, evaluation, prompt management, and analytics to build robust generative AI solutions.
No posts match "".