Senior Big Data

Lumicode Sp. z o.o. is part of the Pentacomp Group, a producer of IT solutions and provider of professional IT services for large enterprises and the public sector. Pentacomp has nearly 30 years of market presence and many completed projects, offering innovative IT solutions.

• Minimum 5 years of practical programming experience in Scala, Python, or Java.
• Commercial experience with distributed systems.
• At least 3 years of experience with Big Data technologies, especially Apache Spark and Apache Iceberg.
• Experience in optimizing processing of large datasets.
• Experience with large-scale system integration projects.
• Commercial experience with relational databases (RDBMS) and strong knowledge of SQL.
• Practical knowledge of the Linux environment and scripting languages.
• Experience with containerization, including modifying Dockerfile, and basic knowledge of Kubernetes.

• Create and optimize solutions based on Python.
• Work in a Kubernetes environment using Spark Operator, Jupyter, and Airflow.
• Develop Big Data solutions using Apache Spark and PySpark.
• Provide technical support for unit, integration, and UAT testing.
• Document code and data flows.

In submitting the application form and CV, the candidate consents to the processing of personal data by Lumicode sp. z o.o. for the recruitment process. The company complies with GDPR regulations, ensuring data protection and rights including access, correction, deletion, and withdrawal of consent. Personal data will not be transferred to third countries or international organizations. The data will be stored until the expiration of claims related to the recruitment process or until withdrawal of consent for future recruitments.