Senior Data Engineer (ADB)

Exadel is an AI-first global tech company with over 25 years of engineering leadership, 2,000+ team members, and 500+ active projects serving Fortune 500 clients like HBO, Microsoft, Google, and Starbucks. The client is one of the Big Four accounting firms with a worldwide professional services network delivering audit, tax, consulting, and advisory services. The team focuses on designing, developing, and deploying enterprise technology and AI-driven tools to support tax services.

• Solid hands-on experience in software development
• Practical experience developing SQL stored procedures and migrating them to Spark SQL or PySpark environments
• Extensive expertise using PySpark on Databricks, including Delta tables, cluster management, and workflow automation
• Proven track record of optimizing Spark performance in production projects
• Strong proficiency in Python for complex data manipulation using libraries like Polars or Pandas
• Solid understanding of columnar data storage formats, particularly Parquet and Delta Tables
• Expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving skills with detail-oriented mindset
• Practical approach balancing standardized processes with flexibility to meet project goals
• Solid understanding of microservices architecture and its implementation in scalable systems

Nice to have:

• Experience with Azure Cloud services or other major cloud platforms including Service Bus, Data Lake, Blob Storage, Redis
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure adherence to guidelines and maintain code quality
• Work independently and collaboratively within the team
• Communicate clear instructions and manage day-to-day operations
• Communicate regularly with the client
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code
• Optimize code for performance and scalability with efficient data handling
• Collaborate with cross-functional teams to deliver software solutions
• Identify and resolve technical issues to maintain reliability and performance
• Create and maintain comprehensive documentation for code, processes, and workflows

Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available for individuals with disabilities. The job description is not exhaustive; duties may evolve with business needs. Compensation details are shared early in recruitment; the offer is not binding until a signed contract is in place.