Big Data Developer

IIG is a team of experts working on various projects with institutions such as the Ministry of Finance, the Polish Volleyball Association, the Central IT Center, the National Cloud Operator, and the Ministry of Justice.

• Minimum 5 years practical experience programming in Scala, Python, or Java
• Commercial experience working with distributed systems
• At least 3 years of experience with Big Data solutions, especially Apache Spark and Apache Iceberg
• Experience with NoSQL databases such as MongoDB, Cassandra, HBase, or similar
• Commercial experience optimizing processing large data sets
• Experience with large-scale system integration projects
• Experience with RDBMS and strong knowledge of SQL
• Desired knowledge and experience with integration services RESTful and SOAP/ESB
• Practical knowledge of the Linux environment and scripting languages
• Experience in containerization, including modifying Dockerfile, and basic knowledge of Kubernetes
• Ability to create software from algorithm description to solution implementation
• Fluency in the Polish language, both verbal and written

• Creating and optimizing solutions based on the Python language
• Working in a Kubernetes environment, specifically using Spark Operator, Jupyter, and Airflow
• Developing Big Data solutions using Apache Spark (PySpark)
• Providing technical support for unit, integration, and UAT tests
• Documenting code and data flow

Fluency in Polish language allowing verbal and written communication is required.