Framna

Expert LLM Engineer (AI Security)

29.6k - 35.5k PLN29 600 - 35 500 PLN/ mies./ mies.B2BB2B (netto)

24.5k - 29.4k PLN24 500 - 29 400 PLN/ mies./ mies.UoPUmowa o pracę (brutto)

SeniorHybryda·GdańskFull-time·B2B·Umowa o pracę

#470354·Dodano 16 dni temu·0

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

LLMAI securityPython

Podsumowanie oferty

Build and scale AI-powered security solutions for a passwordless authentication platform used by millions worldwide. Develop production LLM, RAG and multi-agent systems, and test them against adversarial attacks to strengthen product safeguards.

Wymagania

At least 7 years of experience in software engineering, machine learning engineering, or security engineering, including at least 2 years developing and maintaining production LLM-based solutions.
Good knowledge of Python and experience building maintainable backend components that integrate multiple LLMs with applications, APIs, and data sources.
Experience designing multi-agent architectures, orchestrating agent collaboration, designing and building agent tools, and managing agent fleets, context, and memory.
Hands-on experience building RAG systems and working with embeddings and vector databases.
Experience evaluating LLM response quality and agent behaviour, building evaluation datasets and automated testing pipelines, and understanding data quality, validation, and data leakage.
Experience monitoring LLM and agent activity in customer applications through logging, tracing, and traffic analysis to identify suspicious sources, malicious behaviour, and unauthorised activity.
Experience optimising the performance and costs of LLM-based solutions through model selection, caching, and rate-limit management.
Practical experience investigating vulnerabilities in LLM-based applications and agentic systems through threat modelling and controlled adversarial testing, including identifying potential attack paths, attempting to bypass safeguards, and implementing protections against prompt injection, tool misuse, and abuse.
Experience deploying, operating, and scaling LLM-based solutions.
Very good communication skills in English and Polish.

Nice to have:

Experience in security research or red teaming beyond LLMs.
Familiarity with tools such as garak, promptfoo, or Langfuse.
Familiarity with Docker, CI/CD pipelines, and cloud services for deploying and scaling LLM-based applications.

Obowiązki

Build and scale production solutions using Python and LLMs, including RAG and multi-agent systems.
Work on agent orchestration, tools and integrations, context and memory management, evaluation, and observability, with a focus on quality, reliability, performance, and cost efficiency.
Conduct controlled adversarial testing to investigate how attackers could use or manipulate LLMs and AI agents to bypass product safeguards, including in Android and iOS environments.
Analyse agent activity in customer applications, identify potentially unsafe or unauthorised behaviour, and translate findings into stronger safeguards and product improvements.

Benefity

Regular 1:1s and a mentoring program.
Internal workshops and knowledge sharing across teams.
Flexible working hours, with start times between 7:00 and 10:00.
High-quality equipment, including a MacBook and testing devices.
Individual training budget.
English classes in small groups.
Private medical care through Compensa.
MultiSport.
Team gatherings.

Elastyczne godziny

Szkolenia wewnętrzne

Dofinansowanie szkoleń

Kursy językowe

Opieka zdrowotna

Karta sportowa

Spotkania integracyjne

Framna

8 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz