# Senior Director, NLP & Market Research Data Engineering Lead — Eli Lilly

- Location: Indianapolis, IN
- Posted pay: $176k–$257k/yr
- Posted: Nov 16, 2026
- Status: open (checked Nov 21, 2026)
- Apply (employer's site): https://careers.lilly.com/us/en/job/LILLUSR114077EXTERNALENUS
- Employer record: https://visajobs.io/company/eli-lilly.md

## Sponsorship history
- Tier: Employer history only
- With this exact title: 0

## Description
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.
NLP & Market Research Data Engineering Lead
Customer Insights and Analytics (CIA)
At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 50,000+ employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We're looking for people who are determined to make life better for people around the world.
The Customer Insights and Analytics (CIA) organization is Lilly's business-facing insight and analytics capability, uniting Market Research and Analytics into a single, integrated partnership model that helps our business partners make faster, better, more customer-centered decisions.
Organization Overview
Customer Insights and Analytics (CIA) is Lilly's enterprise insight and analytics organization, built in three tiers: Strategic Intelligence teams embedded with each therapeutic area, functional-area Integrated Insights teams that own the insight craft, and foundational teams built for scale. Data Engineering is one of those foundational teams — it builds the governed, AI-ready data foundation once, centrally, so it can be reused across the business as Lilly embeds agentic AI at scale. Within Data Engineering, this role owns the unstructured-data and NLP foundation for Market Research.
Position Overview
The NLP & Market Research Data Engineering Lead builds and runs the engineered data foundation for unstructured and research data — the non-tabular sources that carry the consumer, patient, and HCP “why”: social-listening streams, survey verbatims, qualitative transcripts, call and advisory notes, secondary reports, and medical and scientific text. As Lilly extends its agentic platform beyond structured data, this is the engineering role that delivers the unstructured-data half of the AI-ready foundation for Market Research — the NLP and text pipelines, the enrichment and embedding layer, and the retrieval (RAG) foundation on which research agents and MR analytics depend.
The role sits inside CIA's central Data Engineering function, reporting to the Head of Data Engineering & Risk Mitigation, and is a joint priority of Data Engineering and Agentic Intelligence & Products. It builds the capability centrally, once, and makes it reusable across the business — partnering with the embedded Research & Unstructured Data Product Owners, the Agent Factory, Research Science (which owns social listening and MR methods as central capabilities), the Strategic Intelligence Market Research teams, and the governance and stewardship functions.
This role builds and runs the pipelines, the unstructured-data products, and the retrieval foundation; it does not frame or interpret the research, and it does not own the agents or Skills. Where the Agent Factory builds the agent and the Market Research teams frame the question, this role builds the governed, AI-ready data foundation they both depend on.
Key Objectives
● Build & run the NLP / unstructured-data pipelines. Design and operate production NLP and text pipelines on Databricks (Unity Catalog, Delta) that ingest, parse, structure, and enrich Market Research's unstructured sources across the medallion (bronze → silver → gold).
● Stand up the enrichment & embedding layer. Entity and theme extraction, topic modeling, sentiment, summarization, and embedding / vectorization — turning raw text into structured, queryable, feature-ready signal.
● Own the retrieval / RAG data foundation. Chunking, embedding, vector indexing, and grounding so research agents reason over the full MR evidence base, in partnership with the Agent Factory and Head of AI.
● Make unstructured data AI-ready & governed. Author and steward data contracts (ODCS); ensure PII, consent, classification, and provenance travel with the data into agentic consumption; partner with the Policy-as-Code function to render governance intent as enforced policy (OPA / Rego), with no leakage.
● Establish data quality & evaluation for NLP. Accuracy, coverage, drift, and grounding / hallucination checks (pytest, DLT / Great Expectations), with monitoring and alerting so text data stays trustworthy and auditable.
● Serve Market Research at scale. Engineer the pipelines behind social listening, brand-health, and secondary-MR text analysis, partnering with Research Science and the shared LBI Market Research pool that runs the analysis; establish reference architecture, reusable patterns, and self-service.
● Set technical direction & standards. Own the standards for NLP and unstructured-data engineering across CIA; provide architectural review and gatekeeping for new data flows, integrations, and agent-consumption paths; provide technical direction and mentorship to engineers and the vendor / LBI bench.
● Other key initiatives and special projects as needed.
Leadership
While there are no direct reports today, this person will work through Lilly's teams in India and across teams in CIA and Tech@Lilly to build out the Market Research data products (bronze and silver) needed to power agentic solutions for the teams. Leadership is exercised through technic

> History, not a promise: past H-1B filings do not mean an employer will sponsor you or a given role. Data: U.S. DOL OFLC LCA disclosure (FY2024–FY2026 for role counts, certified LCAs) and the USCIS H-1B Employer Data Hub. Not legal advice. Methodology: https://visajobs.io/methodology
