Data Engineer (Senior)
115 - 160 PLN/ godz.B2B
SeniorFull-time·B2B
#432210·Dodano 2 dni temu·3
Źródło: nofluffjobs.comTech Stack / Keywords
PythonSQLETLGitAPIGCPCI/CDTerraformDBTSnowflakeBigQueryAzureAirflowSpark
Firma i stanowisko
Alterdata.io is a service company specializing in data and is looking for a contractor for the role of Senior Data Engineer.
Wymagania
- Commercial experience as a Data Engineer.
- Proficiency in Python.
- Proficiency in SQL: writing queries, optimization, working with databases like PostgreSQL, BigQuery.
- Practical experience designing, implementing, and optimizing complex ETL/ELT processes.
- Experience integrating data from multiple sources (streams, relational databases, files, API).
- Practical experience working with cloud platforms: Google Cloud Platform or Azure.
- Understanding of Data Warehousing, Data Lakes, and Data Lakehouse concepts.
- Experience implementing serverless solutions based on containerized services using Docker.
- Knowledge of version control systems Git and experience with code management platforms (GitHub, GitLab, Bitbucket).
- Self-reliance, proactivity, and ability to solve complex technical problems.
- Good work organization, teamwork, and effective communication skills.
- English language proficiency at minimum C1 level.
- Ability to interpret business goals and translate them into coherent technical tasks.
- Experience managing projects.
- Experience as a technical leader or coordinator of smaller development teams.
Nice to have:
- Knowledge of CI/CD tools (e.g., Jenkins, GitHub Actions, GitLab CI).
- Experience with Infrastructure as Code tools like Terraform.
- Knowledge of real-time data processing tools such as Apache Kafka, Apache Spark, Google Dataflow.
- Experience with tools like dbt, Dataform.
- Knowledge of data integration, storage, processing, and search in environments like Spark, Snowpark, AWS Data Migration Services, Azure DataFactory, Google DataFlow.
- Experience working with BigQuery, Snowflake platforms.
- Experience using AI tools in coding, e.g., Cursor, Claude Code.
Obowiązki
- Designing and developing advanced data architecture based on cloud platforms like GCP, Azure, and Snowflake according to market best practices.
- Designing and implementing highly scalable, efficient, and secure ETL/ELT processes using native cloud services (GCP, Azure).
- Supervising stability and performance of data pipelines in GCP (BigQuery, Pub/Sub, Composer) and Azure, focusing on performance and cost optimization (FinOps).
- Writing clean, modular, maintainable code in Python and SQL while maintaining security, testability, and CI/CD standards.
- Designing and standardizing generic data integration mechanisms from varied sources (API, real-time streams, databases).
- Collaborating with cloud architects, analysts and business stakeholders to translate functional requirements into optimal technical platform architectures.
- Ensuring technical quality via code reviews, providing mentorship to less experienced contractors, and promoting data engineering standards.
- Designing and overseeing architectural documentation and actively participating in improving agile delivery processes within the organization.
Benefity
- Possibility to work from any location (fully remote collaboration).
- A partnership-based and open collaboration culture founded on trust and high autonomy.
- Participation in technologically diversified projects, including international ones, in the Cloud & Data area.
- Knowledge exchange with experienced experts (architects, engineers) and substantive support at every project stage.
Inne informacje
Contract model: B2B (fully remote collaboration). Guaranteed engagement of approximately 160-180 hours monthly. Services to be provided using own computer equipment and basic tools; access to client project licenses provided.
Alterdata.io sp. z o.o.
Pracodawca