Senior AI Engineer

Brak informacji o wynagrodzeniu

SeniorZdalnieFull-time

#464354·Dodano 5 dni temu·0

Źródło: Ruby Labs

Aplikuj teraz

Tech Stack / Keywords

TypeScript Node.js Next.js PlaywrightBrowserbaseCloudflare WorkersLangfuseOpenRouterPostgresRAGAS

Podsumowanie oferty

Own and scale the AI layer of a core D2C subscription product, building production LLM features and browser automation from experiment through release. Work with a TypeScript stack and build browser automations using Playwright and Browserbase.

Wymagania

5+ years of software engineering experience with Node.js, TypeScript, Next.js, and Postgres, including edge or serverless runtimes such as Cloudflare Workers.
Production browser automation experience with Playwright and Browserbase or similar, including resilient selectors, retries, and failure handling at scale.
Production experience with dynamic prompting, where content depends on input variables and injected context.
Production experience with structured outputs, including JSON mode, function calling, and Zod/JSON schemas.
Experience with unified LLM APIs or AI gateways such as OpenRouter or Cloudflare AI Gateway, including rate limits, fallbacks, and cost-effective model selection.
LLM observability with Langfuse or similar, including tracing, test datasets, and scoring integration.
Evaluation methodology using RAGAS or custom LLM-as-a-judge systems.
Decide using benchmarks and trace data rather than intuition; convert generation logs into actionable metrics, build feedback loops, own outcomes through production, and validate LLM output before trusting it.

Obowiązki

Prompt Systems & Structured Outputs:

Design dynamic prompt templates with conditional logic and context injection to maximise generation quality.
Enforce predictable outputs using JSON mode, function calling, Zod/JSON schemas, validators, and repair loops.
Own complex LLM workflows using LangChain, LlamaIndex, or custom solutions, integrating them into application logic.

Browser Automation:

Build and maintain browser automation using Browserbase Functions and Playwright to traverse web flows reliably.
Classify screens with a model during each traversal and decide what the model handles versus deterministic code.
Ship automations as frozen, published workers that are versioned, reproducible, and safe to roll back.
Orchestrate runs through Hatchet, with retries, timeouts, and failure traces.

Evaluation & Experimentation:

Build evaluation pipelines with test datasets, LLM-as-a-judge, and RAGAS-style metrics; score responses and screen classifications in Langfuse.
Trace complex LLM chains to find bottlenecks in cost, latency, and context-window usage.
Run A/B experiments across models and prompts through an AI gateway such as OpenRouter or Cloudflare AI Gateway, releasing only on quantitative benchmarks.
Re-evaluate models as new architectures emerge and fine-tune when domain requirements demand it.

Production Ownership:

Take AI features from experiment to live production on Cloudflare Workers and Containers, and remain accountable after release.
Manage rate limits, fallbacks, and model cost so features stay reliable at scale.
Resolve production incidents in owned AI and automation systems with documented root-cause analysis.

Benefity

Unlimited paid time off.
Paid national holidays.
Company-provided MacBook for employees who need one.

Płatny urlop

Płatne święta

Inne informacje

Applicants must be located within approximately ±4 hours of CET.
The interview process includes a recruiter screening (40 minutes), a technical interview (60 minutes), and a final interview (30 minutes). Application review typically takes 3 to 5 days.

Ruby Labs

17 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz