Gcore

Python Inference Engineer

16.5k PLN16 500 PLN/ mies./ mies.UoPUmowa o pracę (brutto)

SeniorZdalnie·KrakówFull-time·Umowa o pracę

#455958·Dodano 23 dni temu·1

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

PythonvLLMSGLangPyTorch LinuxTensorRT-LLMNVIDIA GPU stackInfiniBandCUDAInference

Firma i stanowisko

Gcore is a global provider of infrastructure and software solutions for AI, cloud, network, and security, with 210+ edge locations, 50+ cloud regions, and thousands of GPUs. The company collaborates with technology partners such as Intel, NVIDIA, Dell, and Equinix, and supports digital products worldwide. The role is within the Edge Cloud&AI Team.

Wymagania

5+ years of experience writing reliable, well-tested production code.
Strong Python skills and experience designing production systems.
Hands-on experience with PyTorch and deploying machine learning models.
Experience with Linux, Docker, and Kubernetes.
Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.
Ability to debug complex problems across software, infrastructure, and hardware.
Strong sense of developer experience.
Genuine interest in inference engineering; motivation to learn.
Good communication and collaboration skills.

Nice to have:

Experience with vLLM, SGLang, NVIDIA Dynamo, TensorRT-LLM, or similar inference frameworks.
Experience running GPU workloads in production.
Knowledge of inference techniques such as quantization, continuous batching, speculative decoding, prefix caching, chunked prefill, or LoRA serving.
Experience with CUDA, Triton, TensorRT, or other GPU programming tools.
Experience profiling and improving model latency, throughput, memory use, or GPU utilization.
Experience with distributed inference, multi-GPU systems, scheduling, or autoscaling.
Contributions to open-source ML, inference, or infrastructure projects.

Obowiązki

Build and improve the inference layer of the Gcore Inference platform.
Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
Bring new language and multimodal models into production.
Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.
Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.
Contribute improvements to open-source inference projects when appropriate.

Benefity

Competitive compensation
Flexible working hours and hybrid or remote options
Work from anywhere in the world for up to 45 days per year
Private medical insurance for you and your family (may vary by location)
Extra paid vacation and sick leave days (may vary by location)
Support for life’s important moments and celebrations
Language courses
Modern, welcoming offices with snacks, drinks, and entertainment (may vary by location)
Team sports and social activities (may vary by location)

Elastyczne godziny

Opieka zdrowotna

Kursy językowe

Darmowe przekąski

Inne informacje

We provide equal opportunity to all applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity, gender expression, national origin, disability, or any other legally protected characteristics.

Gcore

7 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz