Data Engineer (Senior)

Alterdata.io is a data services company looking for a contractor to collaborate in the role of Senior Data Engineer. The role involves working on cloud data platform migration projects, building modern data warehouses (DWH), and designing and optimizing ETL/ELT integration pipelines. The infrastructure built will support BI systems and AI/ML solutions and is based on platforms such as GCP, AWS, Azure, Snowflake, and dbt.

• Commercial experience as a Data Engineer.
• Proficiency in Python.
• Proficiency in SQL including query writing, optimization, and working with databases like PostgreSQL and BigQuery.
• Practical experience designing, implementing, and optimizing complex ETL/ELT processes.
• Experience integrating data from multiple sources such as streams, relational databases, files, and APIs.
• Practical experience working with cloud platforms: Google Cloud Platform or Azure.
• Understanding of Data Warehousing, Data Lakes, and Data Lakehouse concepts.
• Experience implementing serverless solutions based on containerized services using Docker.
• Knowledge of version control system Git and experience with code management platforms like GitHub, GitLab, or Bitbucket.
• Independence, proactivity, and ability to solve complex technical problems.
• Good work organization, teamwork skills, and effective communication.
• English language proficiency at minimum C1 level.
• Ability to interpret business goals and translate them into logical and coherent technical tasks considering project context.
• Experience managing projects.
• Experience as a technical leader or coordinator of small programming teams.

• Design and develop advanced data architecture using cloud platforms such as GCP, Azure, and Snowflake following industry best practices.
• Design and implement scalable, efficient, and secure ETL/ELT processes leveraging native cloud services.
• Oversee data pipeline stability and performance in GCP environments (BigQuery, Pub/Sub, Composer) and Azure, focusing on performance and cost optimization (FinOps).
• Write clean, modular, maintainable code in Python and SQL adhering to security, testability, and CI/CD standards.
• Design and standardize generic data integration mechanisms from diverse sources including APIs, real-time streams, and databases.
• Collaborate with cloud architects, analysts, and business stakeholders to translate functional requirements into optimal technical data platform architecture.
• Maintain technical quality through code review, mentoring less experienced contractors, and promoting data engineering standards.
• Design and supervise architectural documentation and actively participate in improving agile delivery processes.

Nice to have:

• Experience with CI/CD tools such as Jenkins, GitHub Actions, and GitLab CI.
• Experience with Terraform or other Infrastructure as Code tools.
• Experience with real-time data processing tools like Apache Kafka, Apache Spark, and Google Dataflow.
• Experience with data transformation tools such as DBT and Dataform.
• Knowledge of data integration, storage, processing, and search tools in platforms like Spark, Snowpark, AWS Data Migration Services, Azure DataFactory, and Google DataFlow.
• Experience working with BigQuery and Snowflake.
• Experience using AI tools for code work like Cursor and Claude Code.