Data Engineer / Apache Airflow Specialist
Brak informacji o wynagrodzeniu
SeniorFull-time
#246262·Dodano 10 miesięcy temu·28
Źródło: InteticsTech Stack / Keywords
Apache AirflowPythonFlaskElasticsearchUnixLinuxOraclePostgreSQL
Firma i stanowisko
Intetics Inc. is a global technology company providing custom software application development, distributed professional teams, software product quality assessment, and "all-things-digital" solutions. Based on its proprietary business model of Remote In-Sourcing®, advanced Technical Debt Reduction Platform (TETRA™), and measurable quality management platform (Predictive Software Engineering), Intetics enables clients to achieve measurable business results.
Wymagania
- ≥ 3 years of Apache Airflow DAG orchestration.
- ≥ 5 years of Python (ETL focus), with Flask API experience as a plus.
- ≥ 3 years of Elasticsearch (data indexing & optimization).
- ≥ 3 years of Unix/Linux scripting & operations.
- ≥ 3 years with Oracle or PostgreSQL (ideally both).
- ≥ 3 years of GitLab pipelines (build/test/deploy).
- Advanced English and a technical degree.
Nice to have:
- Experience with Great Expectations or similar data-quality tools.
- Airflow on Kubernetes.
- Proven performance tuning experience.
Obowiązki
Technical Responsibilities and Skills:
- Develop, orchestrate, and maintain complex Apache Airflow DAGs for ETL and data-processing pipelines.
- Build and optimize Python-based ETL scripts, integrating with Flask APIs when needed.
- Design and manage Elasticsearch indexing and performance tuning workflows.
- Handle Unix/Linux scripting and operations for automation and monitoring.
- Work with Oracle and PostgreSQL databases for large-scale data processing.
- Implement and maintain GitLab CI/CD pipelines for build, test, and deploy stages.
- Collaborate with the project team to ensure scalability, reliability, and quality of data solutions.
Intetics
26 aktywnych ofert