Senior Apache Airflow Engineer

EPAM is a leading global provider of digital platform engineering and development services. They collaborate with multi-national teams and contribute to innovative projects delivering cutting-edge solutions, offering learning and growth opportunities.

• 5+ years of experience in Python development
• Proficiency in Cloud APIs (REST/RPC)
• Knowledge of DevOps and SysAdmin practices
• Familiarity with Linux and Kubernetes including container image building
• Understanding of Cloud platforms, particularly Google Cloud Platform
• Skills in English communication both spoken and written

Nice to have:

• Expertise in Apache Airflow or similar workflow tools such as Luigi, Oozie, Argo or Apache NiFi
• Background in working with Open Source communities
• Understanding of Cloud Architecture including scalability and IaaS principles
• Google Cloud Certification (e.g. GCP Architect or Data Engineer)

• Develop and maintain custom Airflow Operators, Hooks and Sensors
• Integrate new Airflow versions with Cloud Composer
• Fix bugs and implement improvements within Airflow
• Implement unit and solution testing for Airflow workflows
• Create internal documentation for work artifacts
• Coordinate development activities within the team and support delivery planning
• Collaborate with cross-functional and distributed teams to support delivery and resolve technical issues
• Support junior team members through knowledge sharing, technical guidance and code review
• Participate in technical discussions with clients and coordinate prioritization of development activities