Senior Big Data Developer

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

• Bachelor’s degree in Computer Science, Mathematics or related technical field
• 5+ years experience in software development with Big Data technologies
• Advanced knowledge of Python, Scala, or Java
• Proficient with Spark and Databricks
• Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services
• Demonstrated experience with big data models, databases, and tools
• Strong understanding of different data file formats like JSON, Parquet, Avro
• Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB
• Proficiency in data warehousing solutions, ETL processes
• Proven ability to work within a fast-paced, team-oriented environment
• Detail-oriented with excellent analytical and problem-solving skills
• Knowledge of software development methodologies and best practices
• Exceptional oral and written communication skills in English (B2+)

Nice to have:

• Experience with Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN
• Experience with message queues, especially Kafka
• Production experience in search technologies such as Solr, OpenSearch, or Lucene

• Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP
• Research and utilize Big Data technologies for effective data ingestion
• Process and transform data using tools such as Spark and various Cloud Services
• Understand and execute project-specific business logic through programming languages supported by the primary data platform
• Optimize data retrieval, develop dashboards, and perform data validation
• Collaborate with diverse teams including data scientists, analysts, and IT professionals
• Provide thought leadership on Big Data best practices and technology trends
• Maintain and ensure integrity and security of big data sources and platforms
• Perform troubleshooting, debugging, and upgrading of big data systems and applications