Data Engineer

We operate in the IT sector supporting international companies in regulated industries such as banking, finance, insurance, and pharmaceuticals. We provide comprehensive quality control and implement modern HR platforms for employee management.

• At least 4 years of experience in data engineering, supported by projects carried out in complex corporate environments.
• Expert knowledge of the Databricks platform and Apache Spark, including practical experience with query optimization and cloud cost management.
• Proficiency in designing data integration processes (ETL/ELT) from distributed and complex source systems.
• Advanced knowledge of SQL and relational and non-relational databases, enabling efficient tuning of complex data operations.
• Practical understanding of enterprise realities, including issues related to data security, auditability, and modern access control systems (e.g., Unity Catalog).

• Development of a data platform based on Databricks and Apache Spark, including ensuring performance and tuning computing environments.
• Design, implementation, and optimization of scalable ETL/ELT data pipelines.
• Automation and orchestration of complex enterprise data processing and flow processes.
• Implementation of solutions in accordance with internal CI/CD standards, version control, and Infrastructure as Code practices.
• Collaboration with architecture and security teams to ensure compliance with security regulations and data governance.