Ingestion Data Engineer

Experis to światowy lider rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz ciekawe projekty IT skierowane zarówno do ekspertów z wieloletnim doświadczeniem, jak i osób, które dopiero zaczynają swoją przygodę w branży IT.

• Strong hands-on experience with Python (including debugging and performance optimization)
• Solid understanding of Azure Data Engineering concepts
• Practical experience with Azure Data Factory (ADF), Azure Databricks (ADB), Python / PySpark, SQL
• Proven experience in building and maintaining data pipelines and data processing workflows on Azure
• Experience working in agile, cross-functional teams
• Ability to work in dynamic environments and quickly adapt to changing requirements

Nice to have:

• Experience with near real-time data processing
• Familiarity with large-scale enterprise data platforms
• Exposure to data product thinking and data marketplace concepts

• Identify and propose opportunities to continuously improve Data Marketplace data assets and services
• Participate in design and development of data ingestion pipelines with a focus on stability, optimization, and traceability
• Develop, test, and maintain data pipelines and processing workflows
• Build resilient, fault-tolerant, and modular solutions ensuring high availability
• Support near real-time data processing and consumer interaction capabilities
• Contribute to documentation, reporting, and knowledge sharing
• Research and implement new tools, methods, and processes to enhance data products
• Collaborate across teams to ensure seamless transitions between ingestion, consumption, and activation layers