Data Engineer / Apache Airflow Specialist

Brak informacji o wynagrodzeniu
SeniorFull-time
#246262·Dodano 10 miesięcy temu·28
Źródło: Intetics
Aplikuj teraz

Tech Stack / Keywords

Apache AirflowPythonFlaskElasticsearchUnixLinuxOraclePostgreSQL

Firma i stanowisko

Intetics Inc. is a global technology company providing custom software application development, distributed professional teams, software product quality assessment, and "all-things-digital" solutions. Based on its proprietary business model of Remote In-Sourcing®, advanced Technical Debt Reduction Platform (TETRA™), and measurable quality management platform (Predictive Software Engineering), Intetics enables clients to achieve measurable business results.

Wymagania

  • ≥ 3 years of Apache Airflow DAG orchestration.
  • ≥ 5 years of Python (ETL focus), with Flask API experience as a plus.
  • ≥ 3 years of Elasticsearch (data indexing & optimization).
  • ≥ 3 years of Unix/Linux scripting & operations.
  • ≥ 3 years with Oracle or PostgreSQL (ideally both).
  • ≥ 3 years of GitLab pipelines (build/test/deploy).
  • Advanced English and a technical degree.

Nice to have:

  • Experience with Great Expectations or similar data-quality tools.
  • Airflow on Kubernetes.
  • Proven performance tuning experience.

Obowiązki

Technical Responsibilities and Skills:

  • Develop, orchestrate, and maintain complex Apache Airflow DAGs for ETL and data-processing pipelines.
  • Build and optimize Python-based ETL scripts, integrating with Flask APIs when needed.
  • Design and manage Elasticsearch indexing and performance tuning workflows.
  • Handle Unix/Linux scripting and operations for automation and monitoring.
  • Work with Oracle and PostgreSQL databases for large-scale data processing.
  • Implement and maintain GitLab CI/CD pipelines for build, test, and deploy stages.
  • Collaborate with the project team to ensure scalability, reliability, and quality of data solutions.
Intetics

Intetics

26 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz