Data Engineer (AWS/GCP/Azure)

At Link Group, we specialize in building tech teams for Fortune 500 companies and startups. The project focuses on designing and implementing data pipelines and infrastructure on cloud platforms for the finance/stock exchange industry.

• At least 3+ years of experience in data engineering.
• Strong expertise in one or more cloud platforms: AWS, GCP, or Azure.
• Proficiency in programming languages like Python, SQL, or Java/Scala.
• Hands-on experience with big data tools such as Hadoop, Spark, or Kafka.
• Experience with data warehouses like Snowflake, BigQuery, or Redshift.
• Familiarity with Infrastructure as Code tools like Terraform or CloudFormation.
• Knowledge of CI/CD pipelines and containerization tools like Docker and Kubernetes.
• Strong problem-solving and debugging skills.
• Good command of English.

Nice to have:

• Experience with real-time streaming data solutions (e.g., Kafka Streams, Kinesis).
• Knowledge of machine learning pipelines and data science workflows.
• Familiarity with data governance and compliance frameworks (e.g., GDPR, CCPA).
• Certification in AWS, GCP, or Azure.
• Academic background in Computer Science, Data Engineering, or a related field.

• Design, build, and maintain scalable data pipelines and cloud-based infrastructure.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
• Optimize data workflows for performance, scalability, and cost-efficiency.
• Implement ETL/ELT processes to clean, transform, and store data.
• Ensure data security, compliance, and best practices across cloud environments.
• Monitor and troubleshoot data pipelines and resolve issues efficiently.