Senior Data Engineer (ADB)

Exadel is an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients including HBO, Microsoft, Google, and Starbucks. The client is one of the Big Four accounting firms, headquartered in London, operating in 150+ countries with 460,000+ professionals delivering audit, tax, consulting, and advisory services. The team focuses on designing, developing, and deploying innovative enterprise technology and AI-driven tools to support tax services delivery.

• Solid hands-on experience in software development
• Practical experience developing SQL stored procedures and migrating them to Spark SQL or PySpark environments
• Extensive expertise using PySpark on Databricks, including Delta tables, cluster management, and workflow automation
• Proven track record of optimizing Spark performance in production-level projects
• Strong proficiency in Python for complex data manipulation using libraries like Polars or Pandas
• Solid understanding of columnar data storage formats, particularly Parquet and Delta Tables
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving abilities with attention to detail
• Practical and pragmatic approach balancing standardized processes with flexibility
• Solid understanding of microservices architecture and implementation in scalable systems

Nice to have:

• Experience with Azure Cloud services, including SaaS offerings like Service Bus, Data Lake, Blob Storage, and Redis
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to maintain high code quality
• Work independently and collaboratively within the team
• Communicate clear instructions to team members and manage daily operations
• Regularly communicate with the client
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code
• Optimize code for performance and scalability
• Collaborate with cross-functional teams to deliver high-quality software solutions
• Identify and resolve technical issues ensuring application reliability
• Create and maintain comprehensive documentation for code, processes, and workflows

Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available for individuals with disabilities. The job description is not exhaustive and may evolve based on business needs. Compensation details are shared early in recruitment. The offer is not binding until a signed contract is in place.