BeachHead Inc.
Lead Senior Data Engineer at BeachHead
Job Description
Elevate your career as a Senior Data Engineer at BeachHead, working on a major data platform modernization project. Leverage your Databricks expertise to lead data migration efforts for a top financial client.
In this pivotal role, you'll specialize in Databricks and drive large-scale data transitions within Capital Markets. This opportunity allows you to design advanced data ingestion pipelines and develop high-performance Spark/Scala workflows. Collaborating with technical teams, you'll ensure quality and scalability in delivering efficient data frameworks.
Key Responsibilities:
• Design and develop batch and real-time data ingestion pipelines
• Build and optimize Spark/Scala-based workflows for performance
• Implement streaming solutions using Kafka or APIs
• Develop medallion architecture with best practices
• Ensure data quality through validation and reconciliation
Requirements:
• Extensive hands-on experience with Databricks
• Advanced proficiency i...
In this pivotal role, you'll specialize in Databricks and drive large-scale data transitions within Capital Markets. This opportunity allows you to design advanced data ingestion pipelines and develop high-performance Spark/Scala workflows. Collaborating with technical teams, you'll ensure quality and scalability in delivering efficient data frameworks.
Key Responsibilities:
• Design and develop batch and real-time data ingestion pipelines
• Build and optimize Spark/Scala-based workflows for performance
• Implement streaming solutions using Kafka or APIs
• Develop medallion architecture with best practices
• Ensure data quality through validation and reconciliation
Requirements:
• Extensive hands-on experience with Databricks
• Advanced proficiency i...