Senior/Lead Data Engineer (ADB)

Exadel is an AI-first global tech company with over 25 years of engineering leadership and more than 2,000 team members working on 500+ active projects for Fortune 500 clients such as HBO, Microsoft, Google, and Starbucks. The client for this role is one of the Big Four accounting firms, headquartered in London, operating in 150+ countries with 460,000+ professionals delivering audit, tax, consulting, and advisory services. The team focuses on designing, developing, and deploying innovative enterprise technology and AI-driven tools to support tax service delivery.

• Extensive professional hands-on experience in software development
• Practical experience developing SQL stored procedures and migrating them into Spark SQL or PySpark environments
• Expertise using PySpark on Databricks, including Delta tables, cluster management, and workflow automation
• Proven track record optimizing Spark performance in production projects
• Strong proficiency in Python for complex data manipulation using libraries like Polars or Pandas
• Solid understanding of columnar data formats, especially Parquet and Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving skills with attention to detail
• Balanced approach to standardized processes and flexibility to meet project goals
• Solid understanding of microservices architecture and its scalable implementation

Nice to have:

• Experience with Azure Cloud services and related SaaS offerings (Service Bus, Data Lake, Blob Storage, Redis)
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools like Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure high code quality
• Work independently and collaboratively within the team
• Communicate clear instructions and manage day-to-day operations flow
• Regularly communicate with the client
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices
• Optimize code for performance and scalability
• Collaborate with cross-functional teams to deliver software solutions
• Identify and resolve technical issues ensuring reliability and performance
• Create and maintain comprehensive documentation for code, processes, and workflows

Exadel is an Equal Opportunity Employer committed to diversity and inclusion. Reasonable accommodations are available for individuals with disabilities. The job description may evolve based on business needs. Compensation details are shared early in the recruitment process; offers are binding only upon signed contracts.