Skip to content
←Index

Projects

Systems I have designed, built, and defended—from deterministic AI evaluation harnesses to guarded production writes.

A deterministic harness for fault injection, independent evaluation, trace reconstruction, replay, and statistically defensible reliability claims. Provider integrations plug into explicit seams without weakening the reproducibility boundary.

  • 302-test suite
  • Six labelled fault classes
  • Wilson intervals and McNemar tests
  • Secret-safe failure traces
#AI Reliability#LLM Evaluation#Python#Pydantic#SQLite

A preregistration-grade research program testing whether recovery engineering can substitute for model capability while preserving task correctness and transactional safety—and where that substitution breaks as workflow dependency depth increases.

  • Three confirmatory hypotheses
  • Correctness and unsafe duplication measured jointly
  • Total-token cost includes every recovery call
  • Positive and negative outcomes specified in advance
#Current Research#Agent Reliability#Experimental Design#FAULTLINE

Invoice → ERP Validation Pipeline

Live Production

A production pipeline that extracts data from unstructured invoices, matches it against ERP records, and places a deterministic validation gate in front of every write to a live financial system.

  • 400+ real invoices validated before cutover
  • Supports 300+ invoices per day
  • Ambiguous cases escalate instead of guessing
  • Two-person review reduced to one
#Production AI#FastAPI#PostgreSQL#ERP#Human Review

Published research and implementation for converting noisy engineering BOMs into ERP-safe manufacturing BOMs using BLOCK / REVIEW / PASS conflict classification and an absolute safety gate before Odoo execution.

  • Manual cleaning: ~30 min → under 2 min
  • Zero silent merges by specification
  • Atomic, rollback-safe ERP push
  • Root-cause collapsing prevents derivative blockers
#Published Research#EBOM → MBOM#Odoo#Deterministic Systems

ScholarNote Technical Operations

Production Operations

End-to-end technical ownership of a large education platform: monitoring, incident response, database and infrastructure performance, and production reliability.

  • 50,000+ users
  • 99%+ uptime across 18 months
  • Incident response: 45 min → under 5 min
  • Page load: 3.2s → 0.8s
#Operations#Observability#Performance#Incident Response

OpenClaw — Gateway Authentication & Token Rotation

Open Source Contribution

Security-focused open-source work covering gateway exposure, authentication bypass edge cases, token-expiry awareness, and non-breaking secure rotation across request paths.

  • Closed authentication-bypass edge cases
  • Added token-expiry awareness
  • Preserved backwards compatibility
  • Shipped through reviewer-driven iteration
#Open Source#Authentication#Security#CI
Companion (click for thought)