EPAM Systems, Inc.
Lead Data DevOps Engineer
Job Description
Join our team as a **Lead Data DevOps Engineer**, where you will play a vital role in ensuring the reliability and scalability of our data infrastructure.
**Responsibilities**
- Ensure workflows in Airflow, Spark, and Flink are optimized for effective data processing
- Maintain and deploy cloud-native infrastructure using AWS and Kubernetes
- Provide infrastructure updates based on stakeholder requirements
- Upgrade data infrastructure to ensure high availability and seamless performance
- Improve system performance and reliability using Datadog
**Requirements**:
- 5+ years of experience in Data DevOps
- Leadership experience of 1+ years
- Proficiency in Amazon Web Services
- Expertise in Apache Airflow
- Understanding of Kubernetes
- Knowledge of Terraform
- Familiarity with CI/CD practices
- Upper-Intermediate English proficiency
**Nice to have**
- Proficiency in Apache Flink
- Understanding of Apache NiFi
- Background in Datab...
**Responsibilities**
- Ensure workflows in Airflow, Spark, and Flink are optimized for effective data processing
- Maintain and deploy cloud-native infrastructure using AWS and Kubernetes
- Provide infrastructure updates based on stakeholder requirements
- Upgrade data infrastructure to ensure high availability and seamless performance
- Improve system performance and reliability using Datadog
**Requirements**:
- 5+ years of experience in Data DevOps
- Leadership experience of 1+ years
- Proficiency in Amazon Web Services
- Expertise in Apache Airflow
- Understanding of Kubernetes
- Knowledge of Terraform
- Familiarity with CI/CD practices
- Upper-Intermediate English proficiency
**Nice to have**
- Proficiency in Apache Flink
- Understanding of Apache NiFi
- Background in Datab...