Senior/Lead Data Engineer (ADB)

Exadel is an AI-first global tech company with over 25 years of engineering leadership, more than 2,000 team members, and 500+ active projects supporting Fortune 500 clients such as HBO, Microsoft, Google, and Starbucks. The client for this role is one of the Big Four accounting firms, headquartered in London, operating in 150+ countries with 460,000+ professionals delivering services in audit, tax, consulting, and advisory. The team involved designs, develops, and deploys innovative enterprise technology and AI-driven tools to support tax services delivery, combining expertise in tax, software engineering, change management, and project management.

• Extensive professional hands-on experience in software development
• Practical experience developing SQL stored procedures and migrating them to Spark SQL or PySpark environments
• Extensive expertise using PySpark on Databricks, including Delta tables, cluster management, and workflow automation
• Proven track record of optimizing Spark performance in production
• Strong proficiency in Python for complex data manipulation with libraries like Polars or Pandas
• Solid understanding of columnar data storage formats, especially Parquet, and practical use of Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving skills with detail orientation
• Practical approach balancing standardized processes with flexibility
• Solid understanding of microservices architecture and its implementation in scalable systems

Nice to have:

• Experience with Azure Cloud services and SaaS offerings like Service Bus, Data Lake, Blob Storage, Redis
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to maintain high code quality
• Work independently and collaboratively with team members
• Communicate clear instructions and manage day-to-day operations flow
• Regular communication with the client
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices
• Optimize code for performance and scalability
• Collaborate with cross-functional teams to deliver software solutions
• Identify and resolve technical issues ensuring application reliability
• Create and maintain documentation for code, processes, and workflows

Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available for individuals with disabilities. Duties and responsibilities may evolve based on business needs. Compensation details are shared early in recruitment. The offer is not binding until a signed contract is in place.