Trainee Data Engineer

Vertex Recruitments is offering a position for trainees interested in beginning their career in Data Engineering, focusing on Big Data, cloud technologies, and modern data processing.

• Basic knowledge of SQL and relational databases.
• Basic knowledge of Python and programming.
• Understanding of data processing concepts like ETL/ELT.
• Basic knowledge of Data Lake and data storage.
• Interest in Big Data and willingness to learn technologies like Spark / PySpark and Databricks.
• Basic knowledge or interest in at least one public cloud (AWS, GCP, or Azure).
• Basic knowledge of CI/CD processes.
• Knowledge of Apache Kafka is an advantage.
• Curiosity and eagerness to learn new technologies and find solutions.

• Work with data: learn to acquire, process, and transform data and build basic data pipelines.
• Develop programming skills in Python for data work and automation.
• Create queries and aggregate data using SQL and work with relational databases.
• Learn about data storage solutions including Data Warehouse and Data Lakehouse.
• Use Apache Spark / PySpark for processing large distributed datasets.
• Utilize Databricks platform for data processing, analysis, and management.
• Manage pipelines with Apache Airflow and support testing and deployment with CI/CD processes.
• Explore cloud solutions (AWS, GCP, or Azure) and Infrastructure as Code concepts using Terraform.
• Learn containerization with Docker and basics of Kubernetes.
• Understand data streaming using Apache Kafka.