Azure Data Engineer
Tech Stack / Keywords
Firma i stanowisko
INFOPLUS TECHNOLOGIES is hiring for an experienced Azure Databricks Data Engineer to design, configure, and develop HR solutions with focus on quality, automation, and scalable design, applying modern software engineering practices across the full delivery lifecycle.
Wymagania
- 8-10 years of hands-on experience in data engineering
- Ability to translate working solutions into implementable packages or build new solutions using Azure platform
- High proficiency in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL/Postgres, and Azure analytics services
- Good understanding of Azure identity mechanisms (SPN, SAMI, UAMI etc.)
- Experience designing large data distribution, integration with service-oriented architecture, data mesh, data lake, and analytics solutions using Azure data services
- Proficient coding experience using Spark (Python/Scala) and SQL
- Hands-on experience with scripting languages like Linux or PowerShell
- Prior ETL development experience using tools like Informatica, SSIS, Talend
- Knowledge of Kafka streaming and Azure Infrastructure is good to have
- Proven work experience in cloud, preferably MS Azure, within agile SDLC leveraging modern programming languages, DevOps, and test-driven development
- Exposure to Docker and Git
- Hands-on experience with pipeline orchestration tools like Apache Airflow, Autosys, Control-M (preferred Apache Airflow)
- Proficient with version control and CI/CD using GitLab/Github and Fork/Pull Model
- Knowledge of DevOps tools like GitLab CI/CD pipelines, YAML, Terraform, ARM, Puppet; knowledge of Azure Function App, Logic App is a plus
- Experience with Agile methodologies (SCRUM, XP, Kanban)
- Relevant bachelor’s degree or equivalent
- Excellent English communication skills for presentations and technical writing
Obowiązki
- Design, develop, and improve digital products and technology services for clients and employees
- Apply modern software engineering practices across the full delivery lifecycle including automated testing, deployment, and production support
- Work within an agile SDLC environment to deliver high-quality data solutions
Inne informacje
Please be informed that the data controller is Infoplus Technology___ (hereinafter "controller"). You have the right to request access to your personal data, their rectification, erasure or restriction of processing, the right to object to processing, as well as the right to data portability and to lodge a complaint to the supervisory authority. Personal data will be processed for the purpose of the recruitment process. Provision of data to the extent resulting from the Act of 26 June 1974 Labour Code is mandatory. In the remaining scope, providing data is voluntary. Refusal to provide mandatory data may result in the impossibility to carry out the recruitment process. The Administrator processes mandatory data on the basis of a legal obligation incumbent upon him/her, while with regard to additional data, the basis for processing is consent. Personal data will be processed until the recruitment procedure is completed and for the period of the possibility of asserting potential claims, and in the case of consent to participate in future recruitment procedures - until the withdrawal of such consent. Consent to the processing of personal data can be withdrawn at any time. The recipient of the data is the Just Join IT service and other entities to whom we have entrusted the processing of data in connection with recruitment.
INFOPLUS TECHNOLOGIES
21 aktywnych ofert