Lead Data Engineer (AWS+Snowflake)

Acaisoft is a software house collaborating with one of the biggest consumer insights providers in the U.S., delivering solutions involving data engineering and privacy features for multi-party collaboration.

• 6+ years of experience as a Data Engineer or Data Scientist
• Team Lead experience or leadership potential and readiness
• Proficiency in SQL, Python, and AWS (including Lambda, Airflow, Redshift)
• Solid knowledge of the Snowflake ecosystem including SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and complex SQL stored procedures

Nice to have:

• Experience with AI concepts such as Generative AI chatbots, agent training, various LLMs, and prompt engineering
• Working knowledge of Databricks
• Expertise in building and maintaining APIs; Swagger/OpenAPI spec, Node, and Next.js

• Work with a wide range of AWS services to integrate and deploy cloud components
• Build and maintain scalable data pipelines processing financial data directly into Redshift
• Assess downstream impacts on processing flows
• Perform root cause analysis and implement preventive measures
• Implement and enforce data security measures protecting sensitive data including PII and financial data
• Extract, transform, clean, and interpret large data volumes (200BIL+ records) using SQL and Python
• Set technical priorities and support the team in resolving complex incidents
• Collaborate with the client's technical leads to streamline processes and optimize efficiency
• Report work progress, milestones, and updates to the client-side manager

Ability to work partially within the U.S. time zone during onboarding with calls up to 9:30 PM CET thrice a week; later availability up to 6/7:00 PM CET is required.