[C3T] Data Platform Engineer (Metadata, DQ)

Brak informacji o wynagrodzeniu
SeniorFull-time
#435491·Dodano 3 miesiące temu·1
Źródło: Software Mind
Aplikuj teraz

Tech Stack / Keywords

DataHubApache AtlasAmundsenGreat ExpectationsSodaDeequPythonSQLAWSGitHub

Firma i stanowisko

Software Mind develops solutions for global companies, including tech giants and unicorns. The company builds cross-functional engineering teams focusing on ownership and creativity, operating in a culture valuing openness, respect, grit, and enjoyment.

Wymagania

  • Minimum 3–5 years of experience as a Data Engineer / Data Platform Engineer or in a related role.
  • Proven experience building and maintaining production data pipelines (ETL/ELT).
  • Experience with Metadata Management / Data Catalog tools (e.g., DataHub, Apache Atlas, Amundsen).
  • Experience with Data Quality tools (e.g., Great Expectations, Soda, Deequ).
  • Knowledge of event-driven architecture.
  • Experience in environments with established Data Governance or Master Data Management processes.
  • Strong proficiency in Python (APIs, automation, integrations) and SQL.
  • Hands-on experience working in an AWS environment.
  • Solid knowledge of CI/CD practices and GitHub.
  • Experience implementing data validation, data testing, or data quality control mechanisms within pipelines.
  • Experience with system integrations (REST API, GraphQL, or similar).
  • Understanding of Data Governance, Metadata Management, Data Lineage, and Data Quality concepts.
  • Ability to work independently in a project-based environment.
  • Good communication skills in both Polish and English.

Obowiązki

  • Implement, configure, and maintain the Metadata Management platform and Data Quality environment.
  • Integrate the solution with the lakehouse, data warehouse, domain systems, and analytical tools.
  • Automate metadata ingestion, data lineage, data quality monitoring, and DQ reporting.
  • Implement and maintain the metamodel and technical mechanisms for enforcing data quality rules.
  • Develop and extend integrations between Data Quality and Metadata Management solutions.
  • Monitor the stability, performance, and security of the environment.
  • Collaborate with Data Governance, Data Engineering, and business teams to roll out standards and drive practical adoption of the data catalog and DQ mechanisms.
  • Produce technical documentation and provide user support.

Benefity

  • Flexible employment and remote work.
  • International projects with leading global clients.
  • International business trips.
  • Language classes.
  • Internal & external training.
  • Private healthcare and insurance.
  • Multisport card.
  • Well-being initiatives.
Elastyczne godziny
Kursy językowe
Szkolenia wewnętrzne
Opieka zdrowotna
Ubezpieczenie
Karta sportowa
SOFTWARE MIND

SOFTWARE MIND

25 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz