Nowa
Data Engineer
20 160 - 25 200 PLN/ mies.B2B (netto)
SeniorFull-time·B2B
#337020·Dodano dziś·0
Źródło: theprotocol.itTech Stack / Keywords
PythonSQLMicrosoft Power BIMicrosoft AzureAWSGoogle Cloud PlatformSnowflakeBigQueryRedshiftSynapseAirflowPrefectDagsterAzure Data FactoryApache SparkPySparkSpark SQLHadoopKafkaKinesisPub/SubEvent HubsJavaScalaBashShelldbtTableauLooker
Firma i stanowisko
PTT Consulting specializes in agile IT staffing solutions, providing flexible and scalable services through their body leasing model. Since 2015, they have been connecting businesses with top IT talent across multiple specializations.
Wymagania
- Strong experience in building data platforms (end-to-end, not only pipelines).
- Advanced Python for data processing and pipeline development.
- Strong SQL (CTEs, window functions, query optimization).
- Experience with data integration projects (SEI integration strongly expected).
- Strong knowledge of data modelling (3NF, star/snowflake schemas).
- Experience with Power BI (mandatory) – building dashboards and transforming data for reporting.
- Experience with cloud providers (Azure / AWS / GCP).
- Experience with data warehousing platforms (e.g. Snowflake, BigQuery, Redshift, Synapse).
- Understanding of ETL vs ELT and batch vs near real-time processing.
- Experience building data pipelines and orchestration of workflows (e.g. Airflow, Prefect, Dagster, Azure Data Factory).
- Experience working in multi-team engineering environments.
Nice to have:
- TBM Studio knowledge (highly valued, even 3+ years is a strong advantage).
- Experience with Apache Spark (PySpark / Spark SQL).
- Understanding of Hadoop ecosystem fundamentals.
- Experience with streaming / event-driven data processing (Kafka, Kinesis, Pub/Sub, Event Hubs).
- Programming in Java or Scala.
- Experience with Bash / shell scripting.
- Familiarity with dbt.
- Awareness of BI tools (Tableau, Looker).
- Experience with API / SaaS data integrations.
- Understanding of cloud cost optimization (FinOps).
- Exposure to data governance, compliance, or GRC frameworks.
Obowiązki
- Design, build, and maintain a data platform from scratch.
- Develop and maintain production-grade data pipelines (ETL/ELT) for data ingestion.
- Build data integration pipelines across multiple systems (including SEI integration).
- Design and implement end-to-end data architecture for analytics and reporting.
- Create and maintain data models (3NF, star/snowflake).
- Deliver and support Power BI dashboards and reporting layer (mandatory).
- Ensure data quality, validation, and consistency across pipelines and systems.
- Implement and maintain orchestration, scheduling, dependencies, and failure recovery.
- Monitor and optimize performance, scalability, and cost efficiency.
- Collaborate with DevOps, Data Architects, Business Integration Engineers, and Testers.
- Apply software engineering best practices (version control, CI/CD, testing).
Oferta
- Private medical care
Opieka zdrowotna
PTT Consulting
26 aktywnych ofert