Senior Data Engineer (GCP / AI Platform)
Tech Stack / Keywords
Firma i stanowisko
Mobile Wave Solutions is a professional services company specializing in software development as a service. The company has a team of over 120 engineers delivering scalable, high-quality software to global clients.
Wymagania
- 6+ years of Data Engineering experience including at least one end-to-end greenfield warehouse/platform build.
- Expert SQL and deep PostgreSQL experience.
- Strong experience with cloud data warehouses, ideally BigQuery.
- Proficient in ELT/ETL design using dbt and modern orchestrators like Airflow, Cloud Composer, or Dagster.
- Hands-on experience with GCP data stack: BigQuery, Datastream, Dataflow, Pub/Sub, Cloud Storage.
- Proficient in Python for building data pipelines and tooling.
- Experience with LLM/AI data pipelines: embeddings, vector stores (e.g., pgvector, Vertex AI Vector Search, Pinecone), RAG plumbing, feature stores.
- Strong knowledge of data quality, lineage, observability, and PII governance.
Nice to have:
- Experience ingesting data from .NET/C# and tracking events from React/React Native clients.
- Experience with streaming/CDC at scale and near-real-time serving.
- Experience with ML feature engineering, MLOps, or the Vertex AI ecosystem.
- Background in Fintech, payments, or charitable-giving/nonprofit domains.
- Direct experience building data layers that production LLM agents depend on.
Obowiązki
- Design and build the first analytical data platform on GCP including warehouse, ingestion, transformation, and orchestration.
- Build ELT/CDC data pipelines from production Postgres and .NET/C# services using Datastream, Dataflow, Pub/Sub, and dbt.
- Set up orchestration and CI/CD workflows using Cloud Composer/Airflow or Dagster, along with automated testing.
- Create dimensional data models and a semantic/metrics layer for dashboards, data analysts, and internal Claude agents.
- Develop and maintain the AI data layer including retrieval substrate, embeddings pipelines, and vector storage for RAG data plumbing.
- Implement data governance including validation, lineage, observability, and PII controls.
- Collaborate with AI Systems Engineer and .NET backend team for product event instrumentation and customer insights.
Inne informacje
Please be informed that the data controller is MWS (hereinafter "controller"). You have the right to request access to your personal data, their rectification, erasure or restriction of processing, the right to object to processing, as well as the right to data portability and to lodge a complaint to the supervisory authority. Personal data will be processed for the purpose of the recruitment process. Provision of data to the extent resulting from the Act of 26 June 1974 Labour Code is mandatory. In the remaining scope, providing data is voluntary. Refusal to provide mandatory data may result in the impossibility to carry out the recruitment process. The Administrator processes mandatory data on the basis of a legal obligation incumbent upon him/her, while with regard to additional data, the basis for processing is consent. Personal data will be processed until the recruitment procedure is completed and for the period of the possibility of asserting potential claims, and in the case of consent to participate in future recruitment procedures - until the withdrawal of such consent. Consent to the processing of personal data can be withdrawn at any time. The recipient of the data is the Just Join IT service and other entities to whom we have entrusted the processing of data in connection with recruitment.
Mobile Wave Solutions
2 aktywne oferty