A deterministic harness for fault injection, independent evaluation, trace reconstruction, replay, and statistically defensible reliability claims. Provider integrations plug into explicit seams without weakening the reproducibility boundary.
- 302-test suite
- Six labelled fault classes
- Wilson intervals and McNemar tests
- Secret-safe failure traces
#AI Reliability#LLM Evaluation#Python#Pydantic#SQLite
A preregistration-grade research program testing whether recovery engineering can substitute for model capability while preserving task correctness and transactional safety—and where that substitution breaks as workflow dependency depth increases.
- Three confirmatory hypotheses
- Correctness and unsafe duplication measured jointly
- Total-token cost includes every recovery call
- Positive and negative outcomes specified in advance
#Current Research#Agent Reliability#Experimental Design#FAULTLINE
Invoice → ERP Validation Pipeline
Live ProductionA production pipeline that extracts data from unstructured invoices, matches it against ERP records, and places a deterministic validation gate in front of every write to a live financial system.
- 400+ real invoices validated before cutover
- Supports 300+ invoices per day
- Ambiguous cases escalate instead of guessing
- Two-person review reduced to one
#Production AI#FastAPI#PostgreSQL#ERP#Human Review
Published research and implementation for converting noisy engineering BOMs into ERP-safe manufacturing BOMs using BLOCK / REVIEW / PASS conflict classification and an absolute safety gate before Odoo execution.
- Manual cleaning: ~30 min → under 2 min
- Zero silent merges by specification
- Atomic, rollback-safe ERP push
- Root-cause collapsing prevents derivative blockers
#Published Research#EBOM → MBOM#Odoo#Deterministic Systems
ScholarNote Technical Operations
Production OperationsEnd-to-end technical ownership of a large education platform: monitoring, incident response, database and infrastructure performance, and production reliability.
- 50,000+ users
- 99%+ uptime across 18 months
- Incident response: 45 min → under 5 min
- Page load: 3.2s → 0.8s
#Operations#Observability#Performance#Incident Response
OpenClaw — Gateway Authentication & Token Rotation
Open Source ContributionSecurity-focused open-source work covering gateway exposure, authentication bypass edge cases, token-expiry awareness, and non-breaking secure rotation across request paths.
- Closed authentication-bypass edge cases
- Added token-expiry awareness
- Preserved backwards compatibility
- Shipped through reviewer-driven iteration
#Open Source#Authentication#Security#CI