GDPR and data residency once an LLM is in the loop
Where does the model run, where do embeddings and logs sit? The technical list that makes a privacy review of an AI system possible.
Articles on cloud architecture, AI engineering and software development. From projects, not from a textbook.
Where does the model run, where do embeddings and logs sit? The technical list that makes a privacy review of an AI system possible.
Traceability, human oversight, documentation: what an engineer can contribute to the AI Act, and where the legal classification begins.
A prototype needs an API key. Operations need versioned prompts, a pipeline, and someone who owns the run when it breaks.
Context length, reranking and retries drive cost, not the model alone. What I measure per request before an LLM system goes live.
The path from a RAG demo to a system that survives an audit: chunking, hybrid retrieval, reranking, source grounding, evaluation, tenants.
Character-count chunking and vector-only search make hallucinations expected. What hybrid search and reranking change, and what the older RAG article taught wrongly.
A prompt or model change makes quality worse. Nobody notices if evaluation is missing. What I measure in regulated LLM projects.
Without observability nobody knows cost per request and nobody can reconstruct a bad answer. What production LLM systems must log.
A one-customer pilot is not a product for twenty. What tenant isolation means in RAG and agent systems.
When a model invents citations, legal stops the project. LLM traceability needs source grounding, not a better prompt.
A healthcare project with LangChain, OpenAI and Milvus. The pipeline was fast. As a recipe it is dangerous: fixed chunks, vectors only, no reranking.
A legal-communication application moves from WebLogic to Kubernetes. Four years, zero downtime, deployment from one day to 20 minutes.
An MCP server for the healthcare chatbot: what the Model Context Protocol delivers in practice, and where tool descriptions and logging break.
Cookies & tracking. This website uses Google Ads conversion tracking to measure ad effectiveness. This involves setting cookies and transferring data to Google. Reach measurement with Matomo is cookieless. Details in the privacy policy.privacy policy