Senior Data Engineer

Ework Group is recruiting for a Senior Data Engineer position based in Wrocław, Poland. The role involves working within an innovative data team focused on data extraction, transformation, and loading (ETL) processes and cloud data tools.

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• 5+ years of experience in data engineering or a related field, with a strong focus on ETL processes and cloud data tools.
• Certified Azure Data Engineer and Databricks Certified Data Engineer.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with MS Cloud SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, SQL, Power BI, SSIS, SSRS.
• Strong knowledge of SQL and experience with relational databases.
• Familiarity with big data technologies and data processing frameworks.
• Excellent problem-solving skills, strong communication abilities, and a collaborative mindset.

• Extract, combine, transform, load, manipulate, and cleanse data from various sources to ensure high-quality datasets for analysis.
• Collaborate with data modelers and business analysts to understand the data model and source-to-staging data mapping.
• Create and integrate data structures suitable for analysis.
• Design and develop Databricks notebooks for extracting data from various input files.
• Configure the Ingestion Framework (IF) tables to utilize the existing framework for loading staging and Data Lake Core (DLC) tables.
• Develop and deploy algorithms in performance-efficient code across analytical and data platforms.
• Build large-scale batch and real-time data pipelines using data processing frameworks in cloud platforms or on-premises environments.
• Leverage best practices in continuous integration and delivery to enhance data workflows.
• Track data consumption patterns, collaborate with data governance and information stewards, and participate in vetting and promoting content for the curated data catalog.
• Recommend and implement automation in existing and future integration flows to improve efficiency.
• Drive advancements in data acquisition, testing, and tooling to enhance data quality.
• Play a key role in requirement analysis and project estimates to ensure alignment with business goals.
• Monitor performance and optimize SQL queries for maximum efficiency.
• Prepare detailed design documents with prototypes and screenshots.
• Work with various cloud data tools such as Azure SQL, Azure Data Factory, and Azure Databricks to ingest and prepare data for analysis as per business requirements.

Expected office presence: hybrid (2–3 days on-site) for the foreseeable future, with on-site 5 days once confirmed possible.