Senior Data Engineer (AI Consumer Intelligence Platform)

Brak informacji o wynagrodzeniu
SeniorFull-time·B2B
#400420·Dodano 17 dni temu·2
Źródło: justjoin.it
Aplikuj teraz

Tech Stack / Keywords

NLPPySparkAzureKubernetesDatabricksSQLPython

Firma i stanowisko

We are a rapidly growing consumer intelligence platform used by leading global brands such as Coca-Cola, Unilever, and Bayer.

Wymagania

Experience:

  • 5+ years building and maintaining production ETL/ELT data pipelines
  • 2+ years working with text/NLP data (tokenization, embeddings, multilingual processing)
  • 3+ years of data products shipped to production serving active business users

Technical Skills:

  • 4+ years production experience with Python
  • 2+ years with PySpark or Spark plus strong Python background
  • 3+ years with SQL including complex queries and performance optimization
  • 1+ years production use of Databricks (notebooks, Delta Lake, job scheduling)
  • 2+ years with Azure or equivalent cloud platform experience
  • Experience deploying containerized applications to Kubernetes

Education:

  • Bachelor's degree in Computer Science, Data Science, Engineering, or related quantitative field

Preferred Qualifications:

  • Experience with Databricks Delta Lake architecture and Unity Catalog
  • Depth in Azure ecosystem: Data Factory, Databricks, Blob Storage, DevOps
  • LLM integration experience including OpenAI, Anthropic, or Azure OpenAI API
  • LLM fine-tuning experience
  • Familiarity with observability tools: DataDog, Grafana, Azure Monitor
  • Experience processing 1B+ records at scale
  • Multilingual text processing with Unicode and tokenization for 3+ languages
  • Familiarity with NLP libraries: Spacy, NLTK, CoreNLP, TextBlob
  • Experience in consumer insights, CPG/FMCG, or advertising technology
  • Experience at early-stage, high-growth companies

Obowiązki

  • Design, build, and maintain production data pipelines processing 10M+ text records daily across multiple languages
  • Architect scalable NLP data infrastructure using PySpark, Databricks, and Azure services
  • Integrate Large Language Model APIs into production pipelines for text analysis and enrichment
  • Establish DataOps standards including CI/CD, testing frameworks, and deployment automation
  • Implement observability and alerting for pipeline health, data quality, and system performance
  • Collaborate with data scientists to productionize ML models and NLP systems
  • Define data governance frameworks and quality SLAs for enterprise client delivery
  • Mentor team members and contribute to technical hiring as the team scales

Benefity

  • Long-term growth opportunity
  • Fully remote with 4+ hour overlap with U.S. Eastern Time Zone desired
  • Work with a modern stack utilizing cutting-edge NLP/ML technologies at scale
  • High ownership and impact shaping architecture decisions for a platform serving Fortune 500 clients
  • Growth trajectory with clear path to technical leadership

Inne informacje

Please be informed that the data controller is Kratos Growth (hereinafter "controller"). You have the right to request access to your personal data, their rectification, erasure or restriction of processing, the right to object to processing, as well as the right to data portability and to lodge a complaint to the supervisory authority. Personal data will be processed for the purpose of the recruitment process. Provision of data to the extent resulting from the Act of 26 June 1974 Labour Code is mandatory. In the remaining scope, providing data is voluntary. Refusal to provide mandatory data may result in the impossibility to carry out the recruitment process. The Administrator processes mandatory data on the basis of a legal obligation incumbent upon him/her, while with regard to additional data, the basis for processing is consent. Personal data will be processed until the recruitment procedure is completed and for the period of the possibility of asserting potential claims, and in the case of consent to participate in future recruitment procedures - until the withdrawal of such consent. Consent to the processing of personal data can be withdrawn at any time. The recipient of the data is the Just Join IT service and other entities to whom we have entrusted the processing of data in connection with recruitment.

Kratos Growth

Kratos Growth

2 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz