FIELD NOTES / SOFTWARE & AI
Writing.
Engineering notes on building
dependable AI-enabled systems.
01Retrieval design · 12 MIN READ
Start retrieval design with the question and the data: exact SQL relationships, permission and version boundaries, and where semantic search belongs. Includes a runnable example.
Read the question↓Establish the scope↓Retrieve the evidence
02Evaluation and testing · 11 MIN READ
Test LLM-generated artifacts without requiring identical wording: check structure, policy correctness, coverage, and unsupported claims with a runnable evaluation example.
Different wording↓Same requirements↓Test the behavior.
03Execution reliability · 13 MIN READ
An LLM job saves 13 of 20 rules, then crashes. Here is how I design checkpoints, retries, idempotency, and worker ownership so it can resume safely.
13 results saved↓The server crashes↓Resume the work.
04Change impact analysis · 11 MIN READ
A practical guide to change impact analysis in LLM workflows: classify specification changes, trace dependencies, and plan selective regeneration.
Source changed↓Trace the impact↓Make a decision.