# Senior Databricks Engineer — CGI

- Location: Remote, United States (remote)
- Posted: Aug 27, 2026
- Status: open (checked Nov 20, 2026)
- Apply (employer's site): https://cgi.njoyn.com/CORP/xweb/xweb.asp?NTKN=c&clid=21001&Page=JobDetails&Jobid=J0826-1823&BRID=1329039&lang=1
- Employer record: https://visajobs.io/company/cgi-technologies-solutions.md

## Sponsorship history
- Tier: Good history
- Occupation (SOC): Software Developers (15-1252)
- …in the whole US: 1,147
- With this exact title: 0
- Median DOL prevailing wage, level I / II: $89k / $110k
- Staffing / consulting firm: 43% of its H-1B applications place workers at client sites (FY2024–FY2026)

## Description
Position Description:
We are seeking an experienced Senior Databricks Engineer to serve as a hands on senior data engineer supporting a greenfield Databricks implementation. The role will design, develop, test, and deploy scalable batch and real time data engineering solutions while reverse engineering existing AWS based data processing to identify transformations, business rules, dependencies, and integration requirements that must be preserved or redesigned within the target Databricks architecture.
The Senior Databricks Engineer will deliver prioritized capabilities while helping establish reusable engineering patterns, development standards, governance, deployment practices, and best practices that improve the scalability, reliability, performance, and maintainability of the Databricks platform
This position can be located remotely anywhere in the U.S. Infrequent travel to Dallas, Texas may be required.
Key Responsibilities
. Design, develop, test, and deploy scalable Databricks data pipelines and transformation workflows as part of a greenfield Databricks implementation.
. Analyze and reverse engineer existing AWS based data processing solutions, including undocumented code and pipeline logic, to identify data transformations, business rules, dependencies, orchestration, and integration requirements that must be preserved or redesigned within Databricks.
. Build, enhance, and maintain Bronze, Silver, and Gold data layers supporting customer data models and downstream consumption requirements.
. Design and implement scalable ingestion solutions using Databricks Auto Loader, including schema management, checkpointing, incremental processing, backfill/reprocessing, and production scale file ingestion patterns.
. Develop and operate Lakeflow Declarative Pipelines (formerly Delta Live Tables) supporting batch and streaming workloads, data quality expectations, quarantine/error handling, pipeline dependencies, monitoring, and recovery.
. Develop real time and batch data processing solutions using Databricks, Structured Streaming, and associated technologies.
. Implement robust transformation logic using Apache Spark, PySpark, Spark SQL, and Delta Lake.
. Design and optimize Delta Lake solutions using appropriate MERGE patterns, Change Data Feed, partitioning/clustering, retention, and optimization strategies.
. Design solutions that support reliable ingestion, transformation, enrichment, and delivery of high volume customer data.
. Design and implement appropriate Unity Catalog governance structures, including catalogs, schemas, volumes, external locations, storage credentials, access controls, lineage, and promotion across development, test, and production environments.
. Develop and support integrations between Databricks, Adobe, AWS services, and other identified downstream systems.
. Analyze existing AWS Glue, Amazon S3, Amazon Redshift, Redshift Spectrum, and supporting AWS services to determine existing processing behavior, embedded business rules, dependencies, security requirements, and target state Databricks implementation.
. Establish reusable Databricks Workflows, deployment as code patterns, frameworks, utilities, and engineering standards appropriate for a greenfield implementation and subsequent development teams.
. Apply Databricks engineering best practices for data quality, performance optimization, scalability, observability, reliability, security, and maintainability.
. Perform performance tuning and optimization of Spark workloads, pipelines, queries, streaming processes, and data structures, including analysis of partitioning, shuffle behavior, join strategies, data skew, and Spark execution characteristics.
. Troubleshoot complex data pipeline, integration, data quality, performance, and production issues and participate in root cause analysis and remediation.
. Develop automated validation and testing approaches to ensure the accuracy, completeness, and reliability of data products.
. Perform legacy to target parity validation, reconcile discrepancies between AWS source processing and rebuilt Databricks pipelines, and confirm that required business rules and data outcomes have been preserved
. Evaluate legacy processing logic to distinguish required business functionality from source platform workarounds, avoiding unnecessary replication of legacy technical constraints within the target architecture.
. Participate in design discussions, peer code reviews, technical reviews, and solution refinement.
. Work within client established development, CI/CD, security, governance, and deployment processes.
. Produce and maintain technical documentation, including data flows, implementation details, development patterns, operational procedures, reverse engineering findings, and troubleshooting guidance.
. Provide hands on knowledge transfer and mentoring to client engineers to strengthen internal Databricks engineering capabilities and enable long term platform ownership.
. Leverage approved AI assisted development tools, where appropriate, to improve development velocity, code quality, testing, documentation, and engineering efficiency.
. Identify and recommend opportunities for automation and engineering improvement that increase delivery speed, solution quality, operational reliability, and recovery from production issues
Required Qualifications:
. 6+ years of data engineering or software engineering experience, including significant experience designing, developing, and supporting enterprise scale data platforms.
. 3+ years of hands on Databricks experience developing and operating production data engineering solutions.
. Demonstrated production experience with Databricks Auto Loader, including incremental cloud object storage ingestion, schema inference and evolution, schema hints, rescued data handling, checkpoint/state management, backfill and reprocessing strategies, and scalable file discovery approaches.
. Demonstrated production experience with Lakeflow Declarativ

> History, not a promise: past H-1B filings do not mean an employer will sponsor you or a given role. Data: U.S. DOL OFLC LCA disclosure (FY2024–FY2026 for role counts, certified LCAs) and the USCIS H-1B Employer Data Hub. Not legal advice. Methodology: https://visajobs.io/methodology
