Data Engineer (Google Cloud)

DCG is a company that connects business needs with people's ambitions, helping candidates find suitable environments for growth and assisting companies in building effective teams. They focus on close collaboration and listening to create lasting and valuable relationships.

• Knowledge of building ETL/ELT data pipelines
• Experience in building and designing Data Lake and Data Warehouse solutions
• Familiarity with event-driven architecture technologies such as Kafka and Pub/Sub
• Understanding of Big Data solutions utilizing GenAI capabilities
• Knowledge of Google BigQuery
• Experience with Kubernetes, preferably Google Kubernetes Engine and OpenShift
• Knowledge of relational databases Oracle and PostgreSQL including design, construction, and tuning
• Proficiency in Python and/or Rust
• Good knowledge of Apache Airflow

Nice to have:

• Knowledge of data mesh concepts, vector and graph databases
• Familiarity with Apache Spark (preferably GCP Data Proc), Apache Beam (preferably GCP DataFlow), AutomateNow, Informatica Power Center
• 4 years of experience in a similar position

• Build Data Lake and Data Warehouse solutions and data feeding processes both online and offline
• Design and implement IT solutions for data feeding
• Analyze data and prepare logical and physical models
• Tune SQL queries on relational and warehouse databases in on-premises and GCP environments
• Create offline and online data flows using on-premises and GCP tools
• Develop data loading solutions in Python and Rust for structured and unstructured data
• Prepare thematic datamarts on relational and columnar databases
• Develop concepts and implement solutions based on business requirements
• Resolve incidents and participate in problem-solving
• Support testing and deployment of changes in data feeding processes
• Support servicing of deployed software
• Work according to the DevSecOps model