Job Title : Specialist Data Engineering
Location : Irving,Texas
Job Summary
Seeking a Senior professional with 10 years of experience in Python and Spark SQL to design and optimize scalable big data processing solutions within the DatabricksSparkSQLPython ecosystem
Job Description
Develop and maintain scalable data processing pipelines using Apache Spark with Python and Scala Utilize SparkSQL to analyze large datasets and extract meaningful insights supporting datadriven decision making Collaborate with crossfunctional teams to integrate big data solutions into existing systems Optimize Spark jobs for performance and efficiency in distributed computing environments Ensure data quality and consistency across various data sources Stay updated with the latest advancements in Spark Scala Python and related big data technologies to continuously improve processing capabilities
Roles and Responsibilities
Design develop and deploy complex data processing workflows leveraging Apache Spark Scala Python and SparkSQL Write efficient reusable and maintainable code for Spark applications Troubleshoot and resolve performance bottlenecks in Spark jobs and data pipelines Collaborate with data engineers data scientists and stakeholders to translate business requirements into technical solutions Conduct code reviews and provide mentorship to junior team members on best practices and coding standards Participate in architectural discussions and contribute to the evolution of big data platforms Monitor and maintain the health availability and reliability of Spark clusters and data servicesKarat Interview mandate
Mandatory Skills : Apache Spark, Big Data Hadoop Ecosystem, Python, Python for DATA, SparkSQL
Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):Benefits and Perks:
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer this posting. LTIMindtree or preference, or any other characteristic protected by applicable federal, sta where such considerations are bona fide occupational qualifications permitted by law.