Senior Data Engineer (AI Focus)

Virtusa helps its Clients by becoming a true extension of their software and data development capabilities. Through the readily set up, comprehensive, and self-governing teams, they let Clients focus on their business while ensuring software products and data tools scale up accordingly and with outstanding quality.

• Proficiency in Python and SQL.
• Experience with Java or Scala is a plus.
• Hands-on experience with Big Data frameworks like Apache Spark, Flink, or Kafka.
• Experience supporting AI projects (e.g., handling embeddings, managing datasets for LLM fine-tuning, or working with tools like LangChain or LlamaIndex).
• Comfortable with Infrastructure as Code tools such as Terraform or Docker/Kubernetes.

AI Data Infrastructure:

• Design and scale data architectures specifically tailored for Machine Learning (ML) lifecycles, including feature stores, vector databases, and model training pipelines.

Pipeline Engineering:

• Architect, build, and maintain robust ETL/ELT pipelines that handle structured and unstructured data with a focus on low latency and high reliability.

Data Governance & Quality:

• Implement automated testing and monitoring for data integrity, ensuring that "garbage in, garbage out" is never a reality for AI models.

This is a project for consultants working remotely from Poland.