Skip to content
LogoSamir Sawarkar

Selected work

Engineering evidence

Systems I have built, operated, measured, and defended—from deterministic AI evaluation infrastructure to guarded production writes into financial and manufacturing systems.

AI ReliabilityEvaluationProduction AIInfrastructure
Open Source · Ongoing

FAULTLINE — Reliability Workbench for Document-Grounded AI

A deterministic harness for fault injection, independent evaluation, trace reconstruction, replay, and statistically defensible reliability claims. Provider integrations plug into explicit seams without weakening the reproducibility boundary.

302-test suite
Six labelled fault classes
Wilson intervals and McNemar tests
Secret-safe failure traces
AI ReliabilityLLM EvaluationPythonPydanticSQLite
Open case study
Pre-Pilot · v0.2

Capability–Reliability Substitution in Enterprise Agent Systems

A preregistration-grade research program testing whether recovery engineering can substitute for model capability while preserving task correctness and transactional safety—and where that substitution breaks as workflow dependency depth increases.

Three confirmatory hypotheses
Correctness and unsafe duplication measured jointly
Total-token cost includes every recovery call
Positive and negative outcomes specified in advance
Current ResearchAgent ReliabilityExperimental DesignFAULTLINE
Read research design
Live Production

Invoice → ERP Validation Pipeline

A production pipeline that extracts data from unstructured invoices, matches it against ERP records, and places a deterministic validation gate in front of every write to a live financial system.

400+ real invoices validated before cutover
Supports 300+ invoices per day
Ambiguous cases escalate instead of guessing
Two-person review reduced to one
Production AIFastAPIPostgreSQLERPHuman Review
Research Paper

A Deterministic EBOM Validation-First Pipeline with Controlled Transformation for ERP-Integrated Manufacturing Systems

Published research and implementation for converting noisy engineering BOMs into ERP-safe manufacturing BOMs using BLOCK / REVIEW / PASS conflict classification and an absolute safety gate before Odoo execution.

Manual cleaning: ~30 min → under 2 min
Zero silent merges by specification
Atomic, rollback-safe ERP push
Root-cause collapsing prevents derivative blockers
Published ResearchEBOM → MBOMOdooDeterministic Systems
Read research paper
Production Operations

ScholarNote Technical Operations

End-to-end technical ownership of a large education platform: monitoring, incident response, database and infrastructure performance, and production reliability.

50,000+ users
99%+ uptime across 18 months
Incident response: 45 min → under 5 min
Page load: 3.2s → 0.8s
OperationsObservabilityPerformanceIncident Response
Open Source Contribution

OpenClaw — Gateway Authentication & Token Rotation

Security-focused open-source work covering gateway exposure, authentication bypass edge cases, token-expiry awareness, and non-breaking secure rotation across request paths.

Closed authentication-bypass edge cases
Added token-expiry awareness
Preserved backwards compatibility
Shipped through reviewer-driven iteration
Open SourceAuthenticationSecurityCI