Big Data Engineer

Brak informacji o wynagrodzeniu

NieokreśloneZdalnieFull-time

#466353·Dodano dziś·0

Źródło: LinkGroup

Aplikuj teraz

Tech Stack / Keywords

Apache Spark SQL PythonETL/ELTAzure AWS DatabricksDelta LakeParquetGit

Podsumowanie oferty

Build and maintain scalable data pipelines to support analytics and ML work. The role focuses on ETL/ELT, Apache Spark optimization, and preparing data for analytics and ML use cases.

Wymagania

Strong SQL and data modeling skills.
Experience with Apache Spark (DataFrame API, Spark SQL, performance tuning).
Python for data engineering and basic data science tasks.
Experience building and maintaining ETL/ELT pipelines.
Experience working with large-scale structured and semi-structured data.
Knowledge of data lake concepts (Parquet, Delta Lake, partitioning).
Git and CI/CD fundamentals.
Experience with cloud data platforms (Azure, AWS); most of the work is on Azure.
Basic statistics, data analysis, and data quality practices.
Troubleshooting and performance optimization.
Good communication and stakeholder collaboration skills.

Nice to have:

Databricks experience.
Exposure to ML projects.

Obowiązki

Design, build, and maintain ETL/ELT pipelines for large-scale data.
Optimize Apache Spark jobs for performance and reliability.
Prepare data for analytics and ML use cases.
Work with stakeholders to understand data needs.

Link Group

551 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz