Data Engineer
~20 200 - 28 600 PLN/ mies.B2B (netto)
MidFull-time·B2B
#298597·Dodano 2 miesiące temu·49
Źródło: SOLID.JobsTech Stack / Keywords
AWSPythonSparkHadoop
Firma i stanowisko
Firma apreel powstała w kwietniu 2010 roku. W miarę rozwoju firmy i równolegle ze wzrostem poziomu zaufania klientów, jej działalność poszerzyła się o usługi Outsourcingu Specjalistów IT. Dziś to właśnie ten obszar stanowi główny filar działalności apreel.
Wymagania
- 5+ years working experience as a Data Engineer
- Expert in designing and developing robust Data Pipelines using technologies such as Apache Spark and Hadoop ecosystem
- Strong background in cloud infrastructure, especially AWS
- Hands-on experience with data lakes and modern data warehouses, including orchestration, security, and network
- Proven programming experience with Scala and Python
- Working knowledge of DBT (models, tests, documentation)
- General understanding of Tableau or similar BI tools
- Experience with relational databases, data warehouses, and advanced SQL queries
- Experience with CI/CD, bash scripting, and deployment/release best practices
- Practical experience with Docker and working knowledge of Kubernetes
- Collaborate with analysts and stakeholders to understand data requirements and provide efficient data solutions
- Contribute to development and maintenance of data governance and security practices
- Excellent written and verbal communication skills in English
- Solution-oriented with excellent attention to detail
Nice to have:
- Spark
- Hadoop
Obowiązki
- Manage and scale BI data infrastructure by developing and maintaining data pipelines from ingestion through to storage
- Model data using solid data lake/warehouse concepts and optimize performance (partitioning, file formats, performance tuning)
- Champion standards, processes and best practices in the team
- Implement least-privilege IAM, encryption, data classification, PII handling, and auditability
- Contribute to data governance policies
- Conduct data analysis experiments and provide bespoke solutions to stakeholders
- Collaborate with analysts and domain stakeholders to translate requirements into robust data solutions
- Review code and mentor peers
- Bring previous experiences and ideas to introduce new tools, topics, and methodologies
Oferta
- Salary: 20200-28600 PLN monthly
- B2B contract
- Flexible working hours
- 100% remote work
Elastyczne godziny
apreel
198 aktywnych ofert