Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Andersen is a global software development company with over 18 years of experience supporting businesses worldwide in their digital transformation. Headquartered in Poland, the company operates development centers across multiple countries and offers end-to-end IT services including custom software development, API integration, system architecture, legacy modernization, and long-term support. They specialize in AI, Machine Learning, Data Science, Big Data, and Visual Technologies, delivering tailored, scalable, and secure digital products. Andersen has a team of over 3,700 experts and has completed 1,000+ projects across various industries such as Healthcare, FinTech, Logistic, Automotive, Manufacturing, E-commerce, Multimedia & Entertainment.
Wymagania
- 3+ years of experience as a Data Engineer.
- Strong SQL skills including complex queries and window functions.
- Advanced proficiency in Python.
- Extensive experience with Greenplum, including distributed architecture, MPP systems, distribution keys, partitioning, query optimization, execution plan analysis, VACUUM/ANALYZE, and append-optimized and column-oriented tables.
- Experience with data warehouse systems and data modeling principles including Data Vault and star/snowflake schemas.
- Experience with orchestration tools such as Airflow or similar.
- Experience with Git and CI/CD pipeline participation including code reviews.
- Ability to read and analyze source system documentation and collaborate with source system owners.
- Ability to write clear and well-structured technical specifications.
- English language proficiency from Intermediate and above.
Obowiązki
- Developing ETL/ELT pipelines for data ingestion and transformation based on system analyst specifications.
- Implementing data mart prototypes in Greenplum by refactoring SQL, implementing incremental loading, and ensuring idempotency.
- Optimizing queries and data marts in Greenplum, including selecting distribution keys, implementing partitioning, analyzing query plans (EXPLAIN ANALYZE), mitigating data skew and motion, and configuring resource queues/groups.
- Configuring pipeline orchestration, monitoring, and alerting.
- Performing data quality checks and ensuring SLAs for data mart freshness.
Benefity
- Salary range: 7,400–11,200 PLN net per month (B2B).
- Flexible working hours.
- 100% remote work.
Andersen Lab
41 aktywnych ofert