Data Engineer AWS/GCP/Azure

Link Group specializes in building tech teams for Fortune 500 companies and startups. They connect professionals with opportunities suited to their skills and career aspirations. The project focuses on designing and implementing scalable data pipelines and infrastructure on cloud platforms for the finance and stock exchange industry.

• At least 3+ years of experience in data engineering.
• Strong expertise in one or more cloud platforms: AWS, GCP, or Azure.
• Proficiency in programming languages like Python, SQL, or Java/Scala.
• Hands-on experience with big data tools such as Hadoop, Spark, or Kafka.
• Experience with data warehouses like Snowflake, BigQuery, or Redshift.
• Familiarity with Infrastructure as Code tools like Terraform or CloudFormation.
• Knowledge of CI/CD pipelines and containerization tools like Docker and Kubernetes.
• Strong problem-solving and debugging skills.
• Good command of English.

Nice to have:

• Experience with real-time streaming data solutions such as Kafka Streams, Kinesis.
• Knowledge of machine learning pipelines and data science workflows.
• Familiarity with data governance and compliance frameworks (e.g., GDPR, CCPA).
• Certification in AWS, GCP, or Azure.
• Academic background in Computer Science, Data Engineering, or related field.

• Design, build, and maintain scalable data pipelines and cloud-based infrastructure.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
• Optimize data workflows for performance, scalability, and cost-efficiency.
• Implement ETL/ELT processes to clean, transform, and store data.
• Ensure data security, compliance, and best practices across cloud environments.
• Monitor and troubleshoot data pipelines and resolve issues efficiently.