Senior Data Engineer with Python
33 000 - 45 000 PLN/ mies.
SeniorFull-time
#323594·Dodano 21 dni temu·29
Źródło: LinkGroupTech Stack / Keywords
PythonETLCloudAWSGCPAzureData LakeDocker
Wymagania
- Solid experience in data engineering, preferably with batch processing or ETL workflows
- Strong hands-on experience with Python (Python-first mindset)
- Experience in ingesting and processing data (e.g., collecting, transforming, and loading data into storage systems such as data lakes)
- Good understanding of working with large-scale and high-volume datasets
- Knowledge of designing and optimizing data processing workflows
- Familiarity with cloud environments (AWS, GCP, or Azure)
- Strong analytical thinking and problem-solving skills
Nice to have:
- Experience working with financial or market data
- Familiarity with columnar storage formats (e.g., Parquet)
- Knowledge of modern data lake or data platform concepts
- Experience with containerization (e.g., Docker, Kubernetes)
- Exposure to timeseries data or low-latency data processing
Obowiązki
- Design, build, and maintain data pipelines for processing large-scale datasets
- Develop solutions for data ingestion, transformation, and storage using Python
- Work with structured and unstructured data from various external and internal sources
- Optimize data workflows to ensure performance, scalability, and reliability
- Collaborate with engineering and business teams to understand data needs and deliver solutions
- Ensure data quality through validation, monitoring, and error handling mechanisms
- Contribute to the development of modern data platforms and architectures
Oferta
- Opportunity to work with large-scale data systems
- Exposure to modern data technologies and cloud environments
- Collaborative and engineering-driven culture
- Flexible working conditions
linkgroup
272 aktywne oferty