PySpark Engineer + Palantir – Fully Remote

• Commercial experience with PySpark and Python
• Strong background in data engineering
• Hands-on experience designing, developing and optimising ETL/ELT pipelines
• Experience building data flows from source systems to data lake environments
• Good understanding of distributed data processing
• Experience working with data lake platforms
• Ability to create clear technical and code documentation
• Experience working in Scrum teams
• Familiarity with Azure DevOps and/or Jira
• Experience using Confluence
• English proficiency allowing effective collaboration in an international environment
• Ability to work independently and take ownership of assigned tasks

Nice to have:

• Hands-on experience with Palantir Foundry
• Experience migrating data pipelines between platforms
• Previous involvement in large-scale data lake transformation projects

• Designing, developing and optimising ETL/ELT pipelines using PySpark and Python
• Building end-to-end data flows from source systems to data lake structures
• Migrating existing data processes to Palantir Foundry
• Developing scalable and reliable data engineering solutions
• Monitoring and improving pipeline performance
• Ensuring data quality and processing reliability
• Creating and maintaining technical documentation
• Estimating tasks and delivering assigned tickets on time
• Collaborating with data engineers, architects, and business stakeholders in an international Scrum team