Senior Data Engineer (Python/Azure)

The team designs, develops, and deploys innovative enterprise technology and AI-driven tools to support tax service delivery. It combines expertise in tax, software engineering, change management, and project management, working on tool design, deployment, training development, and engagement management.

• 5+ years of hands-on experience in software development
• Extensive experience with Apache Spark, including platforms like Databricks, Azure Synapse, and Azure Fabric
• Proficient in Python, with strong skills in data manipulation using Pandas and Polars
• Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Table
• Proven expertise in data processing, analysis, and transformation workflows
• Strong analytical and problem-solving abilities with a detail-oriented mindset
• Practical approach balancing standardized processes with flexibility to meet project goals
• Excellent organizational skills for self-management, prioritization, and meeting deadlines
• Solid understanding of microservices architecture and its implementation in scalable systems

Nice to have:

• Experience with Azure Cloud Services or other major cloud platforms, including SaaS offerings such as Service Bus, Data Lake, Blob Storage, Redis
• Familiarity with FastAPI
• Expertise in containerization and orchestration tools such as Docker and Kubernetes

• Define and enforce best practices and coding standards across the project
• Conduct thorough code reviews to ensure adherence to guidelines and maintain high code quality
• Work independently and collaboratively within the team
• Communicate clear instructions to team members and manage day-to-day operations
• Communicate regularly with the client
• Design, develop, and maintain robust and scalable Spark applications
• Write clean, maintainable, and efficient code following best practices
• Optimize code for performance and scalability, ensuring efficient data handling
• Work closely with cross-functional teams to deliver high-quality software solutions
• Identify and resolve technical issues ensuring application reliability and performance
• Create and maintain comprehensive documentation for code, processes, and workflows