Middle Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Exadel is an AI-first global tech company with over 25 years of engineering leadership, employing 2,000+ team members and working on 500+ active projects for Fortune 500 clients including HBO, Microsoft, Google, and Starbucks. The client is a leading provider of vehicle lifecycle solutions headquartered in Chicago, connecting a network of insurance companies, repair facilities, and parts suppliers to deliver advanced mobile, artificial intelligence, and car technologies.
Wymagania
- Proficiency in Python and SQL
- Experience with Spark or similar distributed processing technologies
- Experience with AWS data services: Glue, S3, Step Functions, Athena, EMR, DynamoDB, SQS
- Experience working with data streaming technologies such as Kafka and Spark Streaming
- Familiarity with MongoDB and document-oriented data sources
- Experience with data lake patterns including medallion architecture (bronze/silver/gold), schema management, and incremental processing
- Comfortable with Infrastructure as Code (CloudFormation or Terraform)
- Ability to debug data quality issues in distributed systems
- Experience implementing data quality frameworks like Great Expectations
Nice to have:
- Experience in subrogation, claims processing, insurance, or financial technology
Obowiązki
- Design, build, and optimize ETL/ELT pipelines that transform customer and internal data into actionable datasets
- Partner with Markets and Product teams to develop reporting tools and dashboards
- Build and maintain data lakes and feature stores used by the ML Engineering team for subrogation solutions
Benefity
- International projects
- In-office, hybrid, or remote work flexibility
- Medical healthcare
- Recognition program
- Ongoing learning and reimbursement
- Well-being program
- Team events and local benefits
- Sports compensation
- Referral bonuses
- Top-tier equipment provision
Inne informacje
Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available to enable individuals with disabilities to perform essential functions. Duties and responsibilities may evolve based on business needs.
Exadel
37 aktywnych ofert