Senior Data Engineer (ADB, Spark)

Exadel is a global AI-first technology company with over 25 years of engineering leadership and more than 2,000 team members. The client is a Big Four accounting firm headquartered in London, operating in over 150 countries with 460,000+ professionals providing audit, tax, consulting, and advisory services. The Data Engineer role involves working on a team that designs, develops, and deploys innovative enterprise technology and AI-driven tools to support tax service delivery.

• Proven hands-on software development experience
• Experience developing SQL stored procedures and migrating them to Spark SQL or PySpark
• Extensive expertise using PySpark on Databricks, including Delta tables and cluster management
• Proven track record of optimizing Spark performance in production
• Strong proficiency in Python, particularly with libraries like Polars or Pandas for complex data manipulation
• Solid understanding of columnar data storage formats, especially Parquet and Delta Tables
• Expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving skills
• Practical approach balancing standardized processes with flexibility
• Solid understanding of microservices architecture and its scalable implementation

Nice to have:

• Experience with Azure Cloud services and SaaS offerings like Service Bus, Data Lake, Blob Storage, Redis
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure high code quality
• Work independently and collaboratively with team members
• Communicate clear instructions and manage day-to-day operations
• Communicate regularly with the client
• Design, develop, and maintain scalable Spark applications
• Write clean, maintainable, and efficient code
• Optimize code for performance and scalability
• Collaborate with cross-functional teams to deliver software solutions
• Identify and resolve technical issues
• Create and maintain documentation for code, processes, and workflows

Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available for individuals with disabilities. Job duties and responsibilities may evolve based on business needs. Compensation details are shared early in recruitment to comply with EU Pay Transparency. The offer is not binding until a signed contract is in place.