[C3T] Data Platform Engineer (Metadata, DQ)
Brak informacji o wynagrodzeniu
SeniorFull-time
#435491·Dodano 3 miesiące temu·1
Źródło: Software MindTech Stack / Keywords
DataHubApache AtlasAmundsenGreat ExpectationsSodaDeequPythonSQLAWSGitHub
Firma i stanowisko
Software Mind develops solutions for global companies, including tech giants and unicorns. The company builds cross-functional engineering teams focusing on ownership and creativity, operating in a culture valuing openness, respect, grit, and enjoyment.
Wymagania
- Minimum 3–5 years of experience as a Data Engineer / Data Platform Engineer or in a related role.
- Proven experience building and maintaining production data pipelines (ETL/ELT).
- Experience with Metadata Management / Data Catalog tools (e.g., DataHub, Apache Atlas, Amundsen).
- Experience with Data Quality tools (e.g., Great Expectations, Soda, Deequ).
- Knowledge of event-driven architecture.
- Experience in environments with established Data Governance or Master Data Management processes.
- Strong proficiency in Python (APIs, automation, integrations) and SQL.
- Hands-on experience working in an AWS environment.
- Solid knowledge of CI/CD practices and GitHub.
- Experience implementing data validation, data testing, or data quality control mechanisms within pipelines.
- Experience with system integrations (REST API, GraphQL, or similar).
- Understanding of Data Governance, Metadata Management, Data Lineage, and Data Quality concepts.
- Ability to work independently in a project-based environment.
- Good communication skills in both Polish and English.
Obowiązki
- Implement, configure, and maintain the Metadata Management platform and Data Quality environment.
- Integrate the solution with the lakehouse, data warehouse, domain systems, and analytical tools.
- Automate metadata ingestion, data lineage, data quality monitoring, and DQ reporting.
- Implement and maintain the metamodel and technical mechanisms for enforcing data quality rules.
- Develop and extend integrations between Data Quality and Metadata Management solutions.
- Monitor the stability, performance, and security of the environment.
- Collaborate with Data Governance, Data Engineering, and business teams to roll out standards and drive practical adoption of the data catalog and DQ mechanisms.
- Produce technical documentation and provide user support.
Benefity
- Flexible employment and remote work.
- International projects with leading global clients.
- International business trips.
- Language classes.
- Internal & external training.
- Private healthcare and insurance.
- Multisport card.
- Well-being initiatives.
Elastyczne godziny
Kursy językowe
Szkolenia wewnętrzne
Opieka zdrowotna
Ubezpieczenie
Karta sportowa
SOFTWARE MIND
25 aktywnych ofert