Lingaro
Lingaro
New

Azure Data Engineering Architect - Freelance (Part-time)

Brak informacji o wynagrodzeniu
SeniorPart-time
#453677·Dodano 2 dni temu·1
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

AzurePythonETLPySparkData engineeringSQLBig data

Firma i stanowisko

Lingaro is an established global technology partner operating since 2008 with over 1,600 professionals across 7 global locations.

Wymagania

  • Proven work experience as a Data Engineering Architect or a similar role in the Data & Analytics area.
  • Strong understanding of data engineering concepts including data modeling, ETL processes, data pipelines, and data governance.
  • Expertise in designing and implementing scalable and efficient data processing frameworks.
  • In-depth knowledge of data technologies and tools such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark).
  • Experience selecting and integrating technologies to meet business requirements and long-term data strategy.
  • Ability to translate business needs into data engineering solutions.
  • Strong analytical and problem-solving skills.
  • Proficiency in Python, PySpark, SQL.
  • Familiarity with cloud platforms and services including AWS, GCP, or Azure with experience in designing cloud data solutions.
  • Knowledge of data governance principles, data privacy, and security regulations.
  • Excellent communication and collaboration skills.
  • Experience leading and mentoring data engineering teams.
  • Familiarity with agile methodologies.
  • Continuous learning mindset to stay updated with data engineering advancements.
  • Strong project management skills including prioritization and timeline management.
  • Strong understanding of distributed computing principles such as parallel processing, data partitioning, and fault-tolerance.
  • Bachelor's degree in Computer Science, Information Technology, or related field; Master's degree preferred.

Obowiązki

  • Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions.
  • Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices.
  • Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity.
  • Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis.
  • Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions.
  • Ensure that data engineering solutions align with the organization's long-term data strategy and goals.
  • Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures.
  • Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting.
  • Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables.
  • Support the team throughout the implementation process, answering questions and addressing issues as they arise.
  • Oversee the implementation of the solution, ensuring it conforms to design documents and technical specifications.
  • Stay updated with emerging trends and technologies in data engineering, recommending and implementing innovative solutions as appropriate.
  • Conduct performance analysis and optimization of data engineering systems, identifying and resolving bottlenecks and inefficiencies.
  • Ensure data quality and integrity throughout the data engineering processes, implementing appropriate validation and monitoring mechanisms.
  • Collaborate with cross-functional teams to integrate data.

Benefity

  • Flexible collaboration model and working hours.
  • Remote work policy allowing work from inspiring locations.
  • Autonomy to choose the way of working.
  • Equipment typically provided by the company or access to virtual machines.
  • Part-time freelance agreement (up to 50% full-time workload).

Inne informacje

Open-ended freelance agreement requiring active sole proprietorship (B2B) throughout the engagement. Position is remote and part-time with flexible hours.

Lingaro

Lingaro

8 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz