Senior Data Engineer

DCG sp. z o.o. is the employer offering this position located in Gdańsk, Poland.

• Strong experience in data engineering and distributed data processing
• Strong knowledge of SQL-based data transformation
• Hands-on experience with Apache Hadoop, Apache Spark, Oozie, Apache Airflow, Kafka/event-driven architectures, and CI/CD tools (Git, PR workflows, Jenkins)
• Ability to translate business requirements into SQL logic
• Experience providing L3 production support
• Ability to collaborate with Production Assurance teams
• Strong analytical and problem-solving skills
• Strong communication skills, including ability to explain SQL-related issues to business stakeholders
• Very good command of English, both spoken and written

Nice to have:

• Experience with containerisation and orchestration (Kubernetes)
• Experience with Apache Flink

• Develop and maintain data pipelines supporting regulatory reporting for the initiative
• Design and implement distributed data processing solutions using Hadoop and Spark
• Translate complex business requirements into efficient and executable SQL transformations
• Build and maintain SQL-based data transformations for regulatory data processing
• Manage and monitor workflow orchestration using Oozie and Airflow
• Work with event-driven architectures, including Kafka
• Provide L3 support for production systems, including incident analysis and resolution
• Collaborate with Production Assurance teams to ensure system stability
• Communicate technical issues and SQL logic clearly to business stakeholders
• Contribute to CI/CD processes, including Git workflows, pull requests, and Jenkins pipelines
• Ensure high data quality, reliability, and compliance with regulatory requirements