Senior Big Data Engineer
217.3k - 461.7k PLN217 300 - 461 700 PLN/ rok.UoP
SeniorFull-time·Umowa o pracę
#372257·Dodano dziś·0
Źródło: IQVIATech Stack / Keywords
Big DataETLArchitectureAzure CloudProfilingSQLScalaPython
Firma i stanowisko
IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries.
Wymagania
- 8+ years of experience in data engineering, ETL design, and implementation
- 5+ years of experience with batch processing
- 5+ years of experience in data analysis, profiling, integration, and reporting
- Excellent knowledge of SQL and either Scala or Python (6+ years)
- Strong experience with Cloudera or Databricks big data platforms
- Expertise in distributed systems including Hadoop Hive and Spark
- Experience in optimizing big data pipelines and ETL solutions
- Experience with Azure cloud platform
- Experience with Apache Spark and Kafka
- Proven ability to work effectively in a team environment and act as a technical lead in the field
Obowiązki
- Designing and developing ETL solutions to process large amounts of medical data
- Collaborating actively with the Architect
- Ensuring high quality by supporting the design/redesign of solutions for big data and data warehouse projects
- Delivering project estimations
- Participating in solution architecture research, PoCs, and feasibility assessments
- Cooperating closely with teams and supporting them in collecting requirements, meeting with business stakeholders, and providing consultation in defining/designing data flows
- Continuously improving the data platform and reducing technical debt
- Adjusting/extending the design of conceptual and logical data models leveraging best practices
- Supporting introduction of new tools and migration to Azure cloud
- Delivering the design of physical data models
- Providing mentorship to team members on data engineering
- Executing and participating in development processes
- Defining development standards and promoting best practices
Inne informacje
IQVIA maintains a zero tolerance policy for candidate fraud. All information and credentials submitted must be truthful and complete. False statements, misrepresentations, or material omissions during recruitment will result in disqualification or termination of employment according to applicable law.
IQVIA
29 aktywnych ofert