Senior Data Platform Engineer (Fintech)
Brak informacji o wynagrodzeniu
SeniorFull-time·B2B
#342686·Dodano dwa miesiące temu·0
Źródło: RITS Professional ServicesTech Stack / Keywords
ETLCloudAWSGCPKafkaSparkDatabasesETL tools
Firma i stanowisko
We collaborate exclusively with a stable US-based client, a global leader in electronic trading platforms that has operated for over 25 years. The company serves the world’s leading asset managers, central banks, hedge funds, and other institutional investors — facilitating around 30 trillion USD in trades every month across its electronic marketplaces.
Wymagania
- Experience as Data Platform Engineering or SRE
- Strong software engineering experience and working with Python
- Experience building ETL and stream processing tools and frameworks using Kafka, Spark, Flink, Airflow/Prefect
- Strong experience working with SQL and databases/engines such as MySQL, PostgreSQL, SQL Server, Snowflake, Redshift, Presto
- Experience with using AWS/GCP (S3/GCS, EC2/GCE, IAM), Kubernetes and Linux in production
- Strong proclivity for automation and DevOps practices
- Experience with managing increasing data volume, velocity and variety
- Agile, self-starter and is focused on getting things done
- Strong communicator
Nice to have:
- Familiarity with data science stack: e.g. Jupyter, Pandas, Scikit-learn, Dask, Pytorch, MLFlow, Kubeflow
- Financial Services experience
Obowiązki
- Build and run data platform using such technologies as public cloud infrastructure (AWS and GCP), Kafka, Spark, databases and containers
- Develop data platform based on open source software and Cloud services
- Build and run ETL tools and frameworks to onboard data into the platform, define schema, build DAG processing pipelines and monitor data quality
- Help develop machine learning development framework and pipelines
- Manage and run mission crucial production services
Inne informacje
Work mode: 100% Remote in NYC time zone (at least 5/6 hours of overlap with NYC)
RITS Professional Services
108 aktywnych ofert