BeachHead Inc.
Senior Data Engineer Specialized in Azure Databricks
Job Description
Advance your career as a Senior Data Engineer specializing in Azure Databricks for a premier financial client. Focus on creating scalable ETL solutions for enterprise-level analytics.
This role demands a seasoned data engineer skilled in developing ETL pipelines that support complex data needs. You will work closely with business and technical teams to ensure data quality while managing scalable solutions on Azure platforms. Your expertise in data modeling will be vital for effective business data applications.
Key Responsibilities:
• Design scalable ETL pipelines from diverse data sources
• Optimize and maintain Databricks pipeline architecture
• Ensure data validation and governance compliance
• Automate data processes using Azure Data Factory
• Collaborate with data science and analytics teams
Requirements:
• 5+ years of ETL development experience
• Proficient in Python, Scala, and PySpark
• Exten...
This role demands a seasoned data engineer skilled in developing ETL pipelines that support complex data needs. You will work closely with business and technical teams to ensure data quality while managing scalable solutions on Azure platforms. Your expertise in data modeling will be vital for effective business data applications.
Key Responsibilities:
• Design scalable ETL pipelines from diverse data sources
• Optimize and maintain Databricks pipeline architecture
• Ensure data validation and governance compliance
• Automate data processes using Azure Data Factory
• Collaborate with data science and analytics teams
Requirements:
• 5+ years of ETL development experience
• Proficient in Python, Scala, and PySpark
• Exten...