Senior Data Engineer

Dział: IT

• Minimum 6 years of commercial experience programming in Python or Go.
• Experience with at least one of the following tools: Apache Airflow, Spark, Beam, NiFi, Flink.
• Proficiency in SQL (specifically PostgreSQL) and NoSQL key-value, document, time-series, and columnar data warehouses.
• Writing code according to Clean Code principles.
• Experience with queue engines.
• Knowledge of common formats, algorithms, and data structures.

Nice to have:

• Experience working with public clouds (Google Cloud preferred, others negotiable).
• Knowledge of CI/CD technologies and Infrastructure as Code tools like Terraform and Ansible.

• Work on creating a global analytical platform focused on scalability and cost.
• Design and develop data pipelines (batch and streaming).
• Create and maintain data contracts, quality tests, and metrics (freshness, completeness, accuracy).
• Design algorithms (deduplication, windowing, segmentation) and data structures optimized for thousands of events per second.
• Collect, analyze, and synthesize requirements from product teams, analysts, and Data Science.
• Promote data-driven culture within the organization.
• Create documentation and propose new solutions and directions for development.