Nowa
Senior Data Integration Engineer (Airflow, Snowflake)
Brak informacji o wynagrodzeniu
SeniorFull-time
#344250·Dodano wczoraj·0
Źródło: EPAM SystemsTech Stack / Keywords
PythonApache AirflowSnowflakeWeb Services
Firma i stanowisko
We are seeking a Senior Data Integration Engineer (Airflow, Snowflake) to design and implement a robust data factory that powers AI-driven investment intelligence. In this role, you will architect scalable data integration solutions, build advanced graph-based data layers and ensure secure, high-quality data management across the platform.
Wymagania
- 3+ years of experience in data integration and engineering
- Strong proficiency in Snowflake and Airflow
- Deep knowledge of GraphRAG, Graph Data Structures and Data Sharding concepts
- Background in Data Architecture/Design with experience across various market data sources
- Expertise in integrating with heavy AI-driven and assisted architecture
- Capability to share knowledge with EPAM and client teams on Cypher, Graph and RAG traversals
- English proficiency at B2 level or higher
Nice to have:
- Familiarity with AWS for cloud-based solutions
Obowiązki
- Identify and integrate structured, unstructured and semi-structured data sources
- Implement role-based access control (RBAC) and develop logical data models, ensuring compliance and data lineage
- Document business transformations and establish data quality approaches and rules
- Create a comprehensive data catalog and register data assets with metadata, focusing on sensitivity and security
- Translate and implement the architectural blueprint for the Data Factory, encompassing acquisition, preparation and consumption
- Ensure robust data management and quality to support automated investment processes and AI-driven analytics
- Implement a Neo4j-powered Knowledge Graph as the central data layer for investment intelligence, linking research, strategies and portfolio actions into a lineage graph for decision traceability
- Develop and maintain a multi-dimensional asset ontology for flexible categorization and cross-dimensional analysis
- Integrate temporal versioning to support time-aware queries and historical context preservation
- Incorporate GraphRAG for transforming unstructured documents into queryable graph entities with source attribution
- Implement property-based access control for secure, multi-tenant data visibility and query-level protection
- Oversee real-time data ingestion pipelines and the implementation of scalable data warehousing solutions using Snowflake
Oferta
- Engineering community of industry professionals
- Friendly team and enjoyable working environment
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities
- Outstanding career roadmap
- Leadership development, career advising, soft skills, and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
- English classes
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
- Referral bonuses
- Corporate, social and well-being events
Elastyczne godziny
Płatny urlop
Dofinansowanie szkoleń
Budżet konferencyjny
Szkolenia wewnętrzne
Kursy językowe
Opieka zdrowotna
Karta sportowa
Premie
Udziały pracownicze
Darmowe przekąski
EPAM Systems
220 aktywnych ofert