Senior Data Engineer/ Tech Lead

ITFS company offers a position located in Wrocław in a hybrid working mode (3 days per week at the client's office). The role is in the IT sector and involves working in the banking industry.

• Master's degree in computer science or related fields
• Minimum 12 years of engineering experience in IT
• At least 5 years of experience with Databricks, Python, Spark, Delta Lake, DLT, and GitLab
• Experience in the banking industry
• Experience building scalable data pipelines and processing large data volumes in batch and stream modes
• Practical knowledge of using AI tools in the SDLC
• Experience with Big Data, data warehouses, and Data Lake environments
• Programming databases using SQL, PL/SQL, PostgreSQL, Azure SQL
• Extensive experience with cloud technologies (Azure), Unix/Linux systems, and shell scripting
• Ability to design applications meeting high throughput and low latency requirements
• Experience in automating functional tests and implementing CI/CD processes
• Excellent leadership and teamwork skills
• English language proficiency at minimum B2 level

• Design and develop scalable batch and streaming data pipelines for near real-time analytics
• Create application architectures considering non-functional requirements (NFR) for high throughput and low latency in data processing
• Implement AI-based solutions supporting the software development lifecycle (SDLC)
• Rapidly build and iteratively improve prototypes following best software engineering practices
• Build automated functional tests and CI/CD pipelines using GitLab and standard market tools
• Work in cloud environment (Azure) and write shell scripts in Unix/Linux environments