We are seeking aĀ Senior AI/ML EngineerĀ to build an evidence-grounded AI capability that verifies generated claims against approved scientific, clinical, regulatory, and reference materials before human review. The system will retrieve relevant evidence, decompose claims into verifiable assertions, evaluate evidence support, and provideĀ traceable decisions with citations. The system must recognize unsupported or contradicted claims andĀ abstain rather than guess.
Build production-gradeĀ Python/NLP pipelinesĀ for claim verification and evidence attribution.
DevelopĀ hybrid retrievalĀ using lexical and vector search to identify relevant evidence.
ImplementĀ claim decomposition, natural language inference (NLI), entailment, andĀ contradiction detection.
Evaluate whether generated claims are genuinely supported by cited evidence.
DesignĀ confidence thresholds, abstention logic, escalation rules, and human-in-the-loopĀ workflows.
Build evaluation datasets with expert annotation guidelines and measureĀ inter-annotatorĀ agreement.
Track false approvals, false rejections, abstentions, and other error categories.
Develop traceable systems that allow decisions to be reconstructed based onĀ model version,Ā evidence, citations, and reviewer actions.
Work with Medical, Legal, Regulatory, and scientific stakeholders to translate reviewĀ requirements into technical solutions.
Required Skills
StrongĀ PythonĀ production engineering.
NLP / LLM / Generative AIĀ development.
RAG, hybrid search, vector search, and lexical retrieval.
Natural Language Inference (NLI), entailment, contradiction detection.
Claim decomposition and evidence attribution.
LLM/model APIs and production evaluation frameworks.
AI/ML evaluation, benchmarking, and error analysis.
Human-in-the-loop AI,Ā confidence scoring and abstention.
Experience with scientific, technical, regulatory, legal, or other high-stakes content.
Experience creatingĀ expert-labeled datasets and annotation guidelines.
Strong understanding ofĀ traceability, citations, and reproducible AI decisions.
Preferred Skills
Knowledge graphsĀ and relationships between claims, evidence, references, products, and indications.
DeterministicĀ rules + ML/LLM decision systems.
Pharmaceutical, biotech, healthcare, regulatory, legal, financial compliance, or scientific
publishing experience.
Familiarity withĀ clinical studies, statistics, scientific literature, and citation practices.
Experience withĀ LangChain, LlamaIndex, Hugging Face, PyTorch, or similar NLP/
LLM frameworks.Ā
Learn more about this Employer on their Career Site
