Data Engineer

Data Engineer responsible for designing, building, and maintaining infrastructure, tools, and processes enabling the organization to collect, store, process, and analyze large volumes of data.

• Minimum 5 years of experience as a Data Engineer.
• Proficiency in Python and Scala programming.
• Experience working with Spark and messaging systems.
• Knowledge of Hadoop.
• Practical experience with Kubernetes.
• Strong programming skills and knowledge of software engineering best practices.
• Experience with version control systems (preferred Git).
• Ability to communicate with clients, identify needs, and propose solutions.

• Develop and maintain ETL and data processing platforms using Python, Scala, Spark, HDFS, and Hive.
• Develop applications supporting data access for business users with Airflow, JupyterHub, Trino, Superset, and MLFlow using Kubernetes, Docker, ArgoCD.
• Automate CI/CD processes using GitLab-CI.
• Monitor platform using Prometheus.
• Research, develop, and maintain platform components.
• Execute strategic policies related to technologies and work organization.