Sr. Applied AI/ML Scientist (B2B)

NewsWhip by Sprout Social is an AI, Data and Intelligence Business Unit that processes real-time news data including millions of articles and posts daily to provide predictive intelligence used by journalists, PR leaders, and global brands.

• 6+ years experience building and operating production software systems.
• 2+ years of hands-on experience shipping LLM-powered features.
• Strong backend engineering skills (Python preferred).
• Experience with Large Language Model APIs (e.g., OpenAI, Anthropic), transformer techniques.
• Experience with embedding models and similarity search.
• Experience using vector databases such as ChromaDB, Pinecone, Weaviate.
• Knowledge of prompt engineering and structured output techniques.
• Experience with LLM evaluation frameworks and automated testing.
• Familiarity with LLMOps practices including monitoring, versioning, observability tools (Langfuse, Datadog).
• Proven end-to-end ownership of production systems.
• Experience making and defending architectural trade-offs.
• Experience mentoring engineers and leading design reviews.
• Experience collaborating closely with Product and UX.

Preferred Qualifications:

• Bachelor's degree in Data Science, Computer Science, Machine Learning, AI, or related field.
• Experience with AI orchestration frameworks (LangChain, LlamaIndex, LangGraph).
• Familiarity with Model Context Protocol (MCP) or tool-calling architectures.
• Experience building agentic workflows or tool-using systems.
• Knowledge of semantic search and content retrieval systems.
• Experience with cloud platforms.
• Background in media analytics, content intelligence, or large-scale text processing.
• Experience in startup or high-growth environments.

Build and Ship LLM-Powered Features:

• Architect and deliver production agentic workflows, both ambient and interactive.
• Own design of LLM-powered content enrichments feeding customer reporting and intelligence.
• Lead technical direction for tool-augmented LLM systems including MCP-compatible services and multi-step reasoning.
• Make architecture decisions regarding retrieval, agent use, fine-tuning, and model selection.
• Define structured prompting standards, output schemas, and reusable patterns.

Drive Quality, Evaluation, and Observability:

• Establish evaluation standards including benchmarks, online experimentation, regression detection, and human review.
• Own guardrails for safety, hallucination reduction, factual grounding, and output consistency.
• Implement observability practices including tracing, cost tracking, latency budgets, quality metrics, and drift monitoring.
• Balance model quality, latency, and cost with accountability.

Retrieval, Embeddings, and Semantic Infrastructure:

• Evolve embedding and semantic search infrastructure including chunking, hybrid search, and re-ranking.
• Improve retrieval relevance within the agentic architecture.

Lead Technically and Influence Cross-Functionally:

• Partner with Product and UX to translate AI ideas into shipped features.
• Lead technical design discussions and represent AI team in architecture decisions.
• Provide mentorship and code review to engineers.
• Evaluate emerging models, frameworks, and techniques for stack inclusion.

This role accommodates candidates preferring remote work within Poland or office work in Kraków. Reasonable accommodations for the interview process are available on request via email. The company follows GDPR data processing principles. Use of AI in hiring is disclosed via an external link. Salary ranges are disclosed transparently reflecting geographic zone, experience, and skills.