Compunnel

Databricks AWS Data Engineer

  • Malvern, PA
  • contractor
  • Posted 18 days ago
  • Staffing / consulting
Apply on Compunnel's site ↗Checked yesterday on the employer's career site. We never take applications.

Job Summary
The Databricks AWS Data Engineer will develop and support a new data environment from the ground up, focusing primarily on data pipelines and cloud-based data engineering solutions. The role requires strong development experience with Python, PySpark, and SQL, along with hands-on AWS expertise, particularly AWS Glue and Lambda. The engineer will contribute to building scalable data solutions that support financial data and analytics initiatives.

Key Responsibilities
• Develop and maintain data pipelines using Python, PySpark, and SQL.
• Contribute to building a new data environment from the ground up.
• Design and implement data engineering solutions using AWS services.
• Develop and support data processing workflows using AWS Glue and AWS Lambda.
• Build, maintain, and optimize data pipelines to support data processing and analytics requirements.

Required Qualifications
• Strong hands-on experience with Python and PySpark.
• Strong SQL development skills.
• Mandatory experience with AWS services, particularly AWS Glue and AWS Lambda.
• Experience developing and maintaining data pipelines.
• Ability to participate in technical discussions and whiteboarding exercises.

Similar open jobs

All H-1B data engineer jobs in Pennsylvania →