Senior Data Engineer (AI Focus)

Virtusa helps its Clients by becoming a true extension of their software and data development capabilities. Through comprehensive and self-governing teams, they enable Clients to focus on their business while ensuring software products and data tools scale with outstanding quality. The role is for a project with a client from the high-tech area, with consultants working remotely from Poland.

• Proficiency in Python and SQL.
• Experience with Java or Scala is a plus.
• Hands-on experience with Big Data frameworks like Apache Spark, Flink, or Kafka.
• Experience supporting AI projects, including handling embeddings, managing datasets for LLM fine-tuning, or working with tools like LangChain or LlamaIndex.
• Comfortable with Infrastructure as Code tools such as Terraform or Docker/Kubernetes.

• Design and scale data architectures specifically tailored for Machine Learning lifecycles, including feature stores, vector databases, and model training pipelines.
• Architect, build, and maintain robust ETL/ELT pipelines handling structured and unstructured data with a focus on low latency and high reliability.
• Implement automated testing and monitoring for data integrity to ensure high-quality data for AI models.

This is a project for consultants working remotely from Poland.