Senior Data Engineer (Python | Databricks | Cloud)

1dea is an IT consulting company specializing in advanced, scalable Cloud & Big Data architectures for major clients, operating on AWS, Azure, and GCP platforms. The team focuses on full software development lifecycle (SDLC) and integrates modern data frameworks with DevOps practices.

• Commercial experience in data engineering with practical knowledge of Databricks.
• Strong programming skills in Python focused on data automation and transformation.
• Experience with at least one major cloud platform: AWS, Azure, or GCP.
• Good communication skills and very good command of English.

Nice to have:

• Good knowledge of SQL for data modeling and query optimization.
• Experience with PySpark for distributed data processing.
• Familiarity with DevOps practices including CI/CD pipelines and Infrastructure as Code (e.g., Terraform, Bicep).
• Experience with real-time data streaming technologies such as Kafka and Spark Streaming.
• Knowledge of storage solutions like Data Lake, Snowflake, or Synapse.
• Relevant certifications such as Databricks Certified Data Engineer Associate or cloud certifications.

• Designing data solutions in Databricks for processing large and diverse datasets.
• Building and optimizing data pipelines using Python and native cloud tools.
• Collaborating with architects to define and implement best practices in data engineering.
• Maintaining data infrastructure consistency, security, and scalability in cloud environments.