Senior Data Engineer

Exadel is an AI-first global tech company with over 25 years of engineering leadership, 2,000+ team members, and 500+ active projects supporting Fortune 500 clients including HBO, Microsoft, Google, and Starbucks. The client is an international transportation technology company focused on scalable digital solutions for modern rail operations, developing internal platforms and automation tools to improve operational efficiency in a fast-paced environment.

• BS/MS in Computer Science with 10+ years of experience in distributed systems, data engineering, or software engineering
• Strong coding skills in Python, Java, and Scala
• Experience with SQL and NoSQL databases including BigQuery, Teradata, MySql, Postgres, and Cassandra
• Experience with big data technologies such as Hadoop, Hive, and Apache Spark
• Experience with Airflow or other orchestration tools
• Expertise in troubleshooting ETL, data lineage, data quality issues, and backfills
• Experience in batch and streaming data pipelines
• Experience with GCP or AWS Cloud technologies related to data processing at scale
• Experience designing and supporting production services with tight SLAs
• Experience with distributed applications including logging, metrics, monitoring, and alerting tools such as Elasticsearch and Wavefront
• Understanding of testing methodologies, CI/CD, and industry best practices

Nice to have:

• Strong Python coding skills
• Experience with Google Data Streams and Google Dataproc
• Experience with change data capture (CDC) technologies
• Familiarity with modern data warehouse technologies like Delta Lake

• Design and develop high-volume batch and streaming data ingestion pipelines and frameworks spanning AWS and GCP data platforms
• Conceive, code, and launch next-generation data ingestion and curation platforms
• Participate in defining requirements, system, and data architectural discussions
• Technically lead and mentor junior engineers on software development and data engineering lifecycle best practices
• Collaborate with cross-functional agile teams including software engineers, data engineers, ML experts, and data analysts to build new product features

Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available for individuals with disabilities. The job description is not exhaustive and duties may evolve based on business needs.