Machine Learning Researcher / Engineer (Foundation Models)

Pathway is building LiveAI™ systems that think and learn in real time as humans do. Their mission is to deeply understand how and why large language models work, fundamentally changing the way LLM models think. The team is composed of AI luminaries including CTO Jan Chorowski, who collaborated with Geoff Hinton, and CSO Adrian Kosowski, a theoretical computer scientist with a PhD at age 20. The company has raised over $15M and has offices in Palo Alto, CA, Paris, France, and Wroclaw, Poland.

• Published a lead or significant author paper at NeurIPS, ICLR, or ICML, or
• Contributed significantly to a newsworthy large language model training using multiple GPUs, or
• Worked at least 6 months in a leading Machine Learning research center, or
• ICPC World Finalist, or IOI, IMO, or IPhO medalist in High School.
• Deep learning researcher with experience in Language Models and/or RL; Vision or Robotics ML backgrounds also welcome.
• Experienced in hands-on experiments and model training using PyTorch, Jax, or Tensorflow.
• Good understanding of GPU architecture, memory design, and communication.
• Knowledge of graph algorithms.
• Familiarity with model monitoring, git, build systems, and CI/CD.
• Fluent in English.

Bonus Points:

• Knowledge of distributed training approaches.
• Familiarity with Triton.
• Track record in algorithms and data science contests.
• Demonstrated code portfolio.

• Perform (distributed) model training.
• Help improve/adapt model architectures based on experiment results.
• Design new tasks and experiments.
• Optionally oversee activities of team members involved in data preparation.