Sr. Software Engineer, Inference

CoreWeave is The Essential Cloud for AI™, delivering a platform of technology, tools, and teams enabling innovators to build and scale AI. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. The role is within the AI/ML Platform Services team of CoreWeave Europe, located in Warsaw, Poland.

• Bachelor’s or Master’s degree in Computer Science or related field, or equivalent experience.
• 3+ years professional experience building distributed systems or high-performance cloud services.
• Strong software development skills in Python or Go.
• Deep familiarity with networked systems and performance optimization.
• Hands-on experience with Kubernetes at production scale including automated CI/CD and observability stacks like Prometheus, Grafana, OpenTelemetry.
• Practical knowledge of inference internals: batching strategies, caching, mixed precision (BF16/FP8), streaming token delivery.
• Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven engineering.
• Experience defining and owning SLIs/SLOs, capacity planning, autoscaling policies, and post-incident remediation.

Nice to have:

• Experience with low-level systems and HPC components (e.g., C++, CUDA kernels, NCCL/SHARP, RDMA/NUMA, GPU interconnect topologies).
• Contributions to inference frameworks like vLLM, Triton, TensorRT-LLM, Ray Serve, or TorchServe.
• Experience leading multi-team technical initiatives or engaging with enterprise customers on platform launches.

• Lead technical designs and raise engineering standards across multiple services.
• Own critical infrastructure areas including request routing, adaptive scheduling, cost-per-token analytics, and GPU resource isolation.
• Implement advanced optimizations such as micro-batch schedulers, speculative decoding, and KV-cache reuse.
• Partner with product, orchestration, and hardware teams to evolve the Kubernetes-native inference platform.
• Lead design reviews and decompose multi-service work into clear milestones.
• Refine capacity planning, autoscaling policies, and mentor engineers across the team.

Employment offers are conditional upon passing a basic criminal record check in compliance with GDPR. This position requires access to export controlled information; applicants must be a U.S. person or eligible to access export-controlled data following U.S. Government regulations. CoreWeave is an equal opportunity employer, considering all qualified applicants without discrimination. CoreWeave does not accept speculative CVs; unsolicited CVs become the property of CoreWeave with no claims for fees. Privacy notice applies for UK and EU applicants regarding data handling.