LTIMindtree

Senior Specialist - Data Engineering

  • Atlanta, GA
  • Posted 16 days ago
  • Staffing / consulting
Apply on LTIMindtree's site ↗Checked today on the employer's career site. We never take applications.

Role Senior Data Engineer AI Extraction Lead Databricks

Experience 6 to 10 Years

Location Atlanta GA Preferred

Technical Skills Primary

Databricks AI Extraction Strong handson experience designing and implementing AIbased information extraction solutions on Databricks for unstructured and semistructured content including PDFs scanned documents emails images forms tables and free text

Document AI and Information Extraction Handson expertise in document parsing OCR document classification field extraction table extraction entity extraction and conversion of document content into structured data

LLMBased Extraction Experience using Large Language Models and Generative AI capabilities to extract classify summarize and structure information from enterprise documents and other content sources

Prompt Engineering and Structured Outputs Ability to design effective prompts define structured output schemas generate reliable JSON responses and apply validation rules to improve extraction accuracy and consistency

Databricks Lakehouse Platform Strong working knowledge of Databricks notebooks WorkflowsJobs Apache Spark PySpark Delta Lake SQL and Unity Catalog

Extraction Pipeline Development Experience building Databricks workflows to ingest documents preprocess content execute AI extraction validate output and persist structured results in Delta Lake or other target systems

Python Development Strong working knowledge of Python including data processing reusable functions JSON handling API integration exception handling logging validation and development of preprocessing and postprocessing components

Apache Spark and PySpark Handson experience using Apache Spark and PySpark for distributed data processing data transformation enrichment validation and largescale extraction workloads

Delta Lake Experience using Delta Lake for reliable storage of extracted data including ACID transactions schema management data versioning incremental processing and performance optimization

Unity Catalog Experience using Unity Catalog for data governance access control lineage metadata management auditability and secure access to source documents and extracted data

API and System Integration Experience integrating Databricks extraction solutions with document repositories enterprise applications APIs operational systems and downstream dataconsumption platforms

Troubleshooting and Observability Ability to troubleshoot extraction failures and Databricks pipeline issues using appropriate monitoring logging validation errorhandling and retry mechanisms

Technical Leadership Ability to lead solution design and implementation establish engineering standards conduct code reviews document implemented solutions and provide technical guidance to engineering teams

Technical Skills Secondary Nice to Have NOT MANDATORY

Optical Character Recognition Platforms Exposure to OCR and documentintelligence services such as Azure AI Document Intelligence AWS Textract Google Document AI Tesseract or equivalent technologies

Databricks GenAI Capabilities Experience with Databricks Model Serving Mosaic AI Vector Search Foundation Model APIs MLflow or related Databricks AI capabilities

RetrievalAugmented Generation Familiarity with embeddings vector databases semantic search chunking strategies and RAGbased documentprocessing solutions

CICD and DevOps Experience with Gitbased development automated testing deployment pipelines environment management Databricks Asset Bundles and CICD practices

Agile Delivery Experience working within Agile or Scrum delivery models and coordinating work across onsite and offshore teams

Soft Skills

Excellent written verbal and stakeholder communication skills

Strong leadership and mentoring capabilities

Strong problemsolving and analytical skills

Ability to translate business requirements into scalable technical solutions

Mandatory Skills : Databricks
Good to Have Skills : Prompt Engineering

Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):

Benefits and Perks:

  • Comprehensive Medical Plan Covering Medical, Dental, Vision

  • Short Term and Long-Term Disability Coverage

  • 401(k) Plan with Company match

  • Life Insurance

  • Vacation Time, Sick Leave, Paid Holidays

  • Paid Paternity and Maternity Leave

    The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

    Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting. LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, sta where such considerations are bona fide occupational qualifications permitted by law.
  • Similar open jobs

    All H-1B data engineer jobs in Georgia →