# Associate Director – RWD Data Engineering — Eli Lilly

- Location: Indianapolis, IN
- Posted pay: $137k–$200k/yr
- Posted: Nov 17, 2026
- Status: open (checked Nov 20, 2026)
- Apply (employer's site): https://careers.lilly.com/us/en/job/LILLUSR115108EXTERNALENUS
- Employer record: https://visajobs.io/company/eli-lilly.md

## Sponsorship history
- Tier: Employer history only
- With this exact title: 0

## Description
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.
Job Description
Purpose:
The Associate Director, RWD Data Engineering is a hands-on technical role that builds and delivers the engineering vision for Lilly’s real-world data (RWD) infrastructure set by the Senior Director – RWD Engineering & Architecture. This individual designs, codes, tests, and deploys the scalable, cloud-native pipelines, data products, and analytic applications that allow HEOR, SDIA, Statisticians, Medical, and Clinical teams to generate evidence faster, more reproducibly, and at greater scientific depth than is possible through traditional vendor engagements.
This role requires deep, practical knowledge of secondary healthcare data, with a particular focus on administrative claims and electronic health records (EHR), and of the Databricks Lakehouse platform used to engineer it. The Associate Director turns raw RWD into validated, analysis-ready data products; automates data ingestion, quality checks, and product creation; and builds AI-enabled tools and analytic applications that put those data products directly in the hands of scientists. This individual applies AI coding assistants and frontier AI models as an everyday part of software development, and is accountable for the correctness, performance, and reproducibility of the code they deliver. The ideal candidate is an expert builder who pairs strong engineering fundamentals with rigor in data quality and a passion for leveraging data to drive business outcomes.
This position reports to the Senior Director – Real World Data Engineering & Architecture within HEOR Central and works in close partnership with CIA, HEOR, SDIA, Statisticians, Medical, and Clinical teams.
Responsibilities:
undefined
Design, develop, and deploy cloud-native data products and high-throughput data pipelines on Databricks that transform raw real-world data into scalable, reliable, analysis-ready assets supporting analytics, reporting, and evidence generation.
Leverage AI coding assistants and agentic development tools (e.g., Claude Code, GitHub Copilot, Cursor, Databricks Assistant) to write, refactor, test, and document Python, SQL, and R code, applying rigorous human review, testing, and validation to every AI-generated contribution.
Deliver assigned RWD data products through the full development lifecycle, from technical requirements and prototyping through production deployment and optimization, ensuring scalability, reliability, performance, and reproducibility within the established Databricks Lakehouse environment.
Build, optimize, and maintain ETL/ELT ingestion and transformation pipelines for large-scale secondary RWD, with a particular focus on administrative claims and complex EHR data, handling data volumes ranging from tens of millions to billions of records.
Build and maintain data assets within the established lakehouse architecture (e.g., medallion bronze/silver/gold patterns) using Databricks, Delta Lake, Unity Catalog, and Databricks Workflows to produce versioned, partitioned, and audit-ready data assets.
Write and maintain reusable, version-controlled transformation logic incorporating healthcare coding and terminology standards (e.g., ICD-10/ICD-9, NDC, RxNorm, SNOMED, CPT/HCPCS, LOINC) to produce domain-level datasets such as demographics, diagnoses, treatments, procedures, encounters, and labs.
Optimize SQL and distributed processing workloads (e.g., Databricks SQL and Spark jobs) for performance and compute cost across very large datasets, reading query plans and applying partitioning, liquid clustering/Z-ordering, predicate pushdown, caching, and other optimization strategies appropriate to analytical workloads.
Translate analytic and research requirements into reproducible data extraction and transformation logic, supporting cohort construction, temporal logic, and consistent reuse of RWD across teams.
Design, implement, and run data quality and validation frameworks for every data product, including automated checks for completeness, conformance, plausibility, and referential integrity; reconciliation of record counts and distributions against source; regression testing between data refreshes; and monitoring and alerting that surface issues before they reach analytical teams.
Apply the team’s version control and CI/CD standards in daily work, including Git branching, pull requests, peer code review, automated unit and data tests, and deployment via Databricks Asset Bundles, ensuring all code is version-controlled, tested, and deployable in a reproducible manner.
Build and deploy interactive analytic applications (e.g., Dash, R Shiny, Streamlit, Databricks Apps) that allow HEOR scientists, statisticians, and medical teams to explore data products, review cohort counts and data quality results, and self-serve common analyses.
Build AI-enabled solutions that operate directly on governed data products using frontier AI models (e.g., Anthropic Claude, OpenAI GPT, Google Gemini) and Databricks Model Serving, such as natural-language query of data products, AI agents that execute data workflows, and retrieval over data dictionaries, code lists, and documentation; evaluate these solutions for accuracy and ensure they meet Lilly’s privacy, security, and responsible-AI requirements.
Collaborate closely with data scientists, statisticians, and other technical partners to understand techni

> History, not a promise: past H-1B filings do not mean an employer will sponsor you or a given role. Data: U.S. DOL OFLC LCA disclosure (FY2024–FY2026 for role counts, certified LCAs) and the USCIS H-1B Employer Data Hub. Not legal advice. Methodology: https://visajobs.io/methodology
