Senior Data Engineer (Databricks)

ITFS is a consulting company from the Tricity area with a branch in Warsaw. It focuses primarily on IT specialist recruitment and creating project-based Software Houses for clients from Poland and Western Europe.

• Minimum 5 years of experience in Data Engineering.
• Experience in at least two projects implemented in Databricks as a Data Engineer.
• Very good knowledge of PySpark, Python, and Spark SQL.
• Knowledge of Databricks features: Databricks Asset Bundles, Structured Streaming, Auto Loader, Azure Data Lake Storage, Databricks Jobs, Notebooks, REST API, Delta tables.
• Ability to communicate effectively with clients and stakeholders.
• English language proficiency at minimum B2 level.
• Knowledge of Azure, Databricks, Python, and PySpark.
• Languages: Polish and English.

• Designing and developing solutions in the Databricks environment.
• Building and optimizing data pipelines using PySpark, Python, and Spark SQL.
• Creating ETL/ELT processes and solutions based on Structured Streaming, Auto Loader, and Delta Tables.
• Integrating data and working with Azure Data Lake Storage.
• Creating and maintaining Databricks Jobs, Notebooks, and REST API integrations.
• Participating in code reviews, testing, and creating technical documentation.
• Supporting the team through mentoring, knowledge sharing, and collaboration with developers.