Senior Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Exadel is an AI-first global tech company with over 25 years of engineering leadership, employing more than 2,000 team members and managing 500+ active projects for Fortune 500 clients such as HBO, Microsoft, Google, and Starbucks. The client is a leading provider of vehicle lifecycle solutions headquartered in Chicago, connecting a network of insurance companies, repair facilities, parts suppliers, and data providers to enhance productivity and customer experience in the transportation industry.
Wymagania
- Strong proficiency in Python and SQL
- Experience with Spark or similar distributed processing technologies
- Deep experience with AWS data services including Glue, S3, Step Functions, Athena, EMR, DynamoDB, and SQS
- Experience working with data streaming technologies such as Kafka and Spark Streaming
- Experience in data modeling, preferably in finance or insurance
- Familiarity with MongoDB and document-oriented data sources
- Experience with data lake patterns including medallion architecture, schema management, and incremental processing
- Comfort with Infrastructure as Code tools like CloudFormation or Terraform
- Ability to debug data quality issues across distributed systems
- Experience implementing data quality frameworks such as Great Expectations to ensure pipeline reliability and data integrity
Nice to have:
- Experience in subrogation, claims processing, insurance, or financial technology
Obowiązki
- Design, build, and optimize ETL/ELT pipelines that transform customer and internal data into actionable datasets
- Partner with Markets and Product teams to develop reporting tools and dashboards that guide business strategy and serve customer needs
- Build and maintain data lakes and feature stores used by ML Engineering team to develop ML solutions for subrogation
Oferta
- International projects
- In-office, hybrid, or remote flexibility
- Medical healthcare
- Recognition program
- Ongoing learning and reimbursement
- Well-being program
- Team events and local benefits
- Sports compensation
- Referral bonuses
- Top-tier equipment provision
Inne informacje
Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available to enable individuals with disabilities to perform essential functions. Duties and responsibilities may evolve based on business needs.
Exadel
108 aktywnych ofert