Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Team Connect is a leading IT service provider in Poland operating in nearshore and offshore models. Since 2008, they have been successfully creating and developing software for their clients, specializing in Agile and DevOps methodologies, developing backend, frontend, and mobile applications. This role is for a client in the technology sector.
Wymagania
- Higher education (Bachelor's or Master's) in computer science, operations research, mathematics, applied computer science, or related field.
- Minimum 3–4 years of relevant professional experience.
- Experience working with large datasets from various sources.
- Very good programming skills, preferably in Python.
- Experience with containerization using Docker and container orchestration with Kubernetes.
- Experience in cloud application development, preferably on Google Cloud Platform and Microsoft Azure.
- Ability to effectively solve problems, debug, diagnose errors, and design solutions for complex technical issues.
- Experience designing, building, and maintaining ETL processes and data pipelines using orchestration tools like Apache Airflow or Kubeflow.
- Knowledge of DevOps practices including CI/CD and Git-based workflows.
- Comfortable working in Unix/Linux environments.
- Practical experience designing, creating, and maintaining REST API interfaces.
- Familiarity with machine learning and deep learning concepts, and experience deploying and monitoring models.
Nice to have:
- Experience with Keras, TensorFlow, and/or PyTorch.
- Deep knowledge of key machine learning algorithms.
- Knowledge of business terminology and processes in the oil & gas industry.
- Experience with IoT and Edge Computing technologies.
- Contributions to open source projects.
- Familiarity with data engineering tools such as Flink, Spark, Kafka.
- Experience with Big Data technologies (Spark, Hadoop, Storm, Hive, Pig) and NoSQL databases.
Obowiązki
- Create production-ready code.
- Efficiently utilize GPU and CPU resources for ML-related workloads.
- Design, automate, and orchestrate DevOps/MLOps processes in a cloud environment.
- Develop reusable tools and frameworks for monitoring, optimizing, and maintaining ML-based solutions.
- Design and implement ETL data engineering processes.
- Analyze business problems and collaborate with teams to ensure scalability, continuity, and timely delivery.
- Conduct internal workshops, participate in industry meetings, conferences, and public presentations.
- Continuously develop competencies by following the latest trends in AI/ML and related technologies.
Inne informacje
The administrator of personal data is Team Connect located in Warsaw, ul. Wołodyjowskiego 58. Applicants have rights concerning their personal data under the law. Providing data required by the Labor Code is mandatory; refusal may result in ineligibility for recruitment. Additional data are processed based on consent, which can be withdrawn anytime. Data are processed for recruitment purposes and possible future proceedings. Data recipients include Just Join IT and other entities involved in recruitment processing.
Team Connect Sp. z o.o.
21 aktywnych ofert