Senior AI Machine Learning Engineer

BlackLine is a technology-based company founded in 2001 that provides cloud software automating and controlling the financial close process. The company focuses on modernizing finance and accounting functions to enhance operational effectiveness, delivering innovative enterprise solutions in finance automation.

• Proven experience developing and deploying applications using foundation models (e.g., GPT-4o/o3, Claude Opus 4.x, Sonnet 4.x, Llama 3.x).
• Strong understanding of AI Engineering principles distinct from traditional Machine Learning Engineering.
• Hands-on experience with prompt engineering, including few-shot, zero-shot learning, and defensive prompt design.
• Practical knowledge of Retrieval-Augmented Generation (RAG) architecture.
• Experience with fine-tuning Large Language Models and understanding when to use fine-tuning versus RAG.
• Experience building and evaluating AI agents performing complex multi-step tasks.
• Familiarity with foundation model evaluation and designing evaluation pipelines.
• Proficiency in Python or C# and relevant libraries/frameworks such as Hugging Face Transformers, LangChain, LangGraph, PyTorch.

Nice to have:

• Experience with AgenticOS patterns like memory management, tool registries, agent lifecycle orchestration, inter-agent communication.
• Knowledge of inference optimization techniques including quantization.
• Expertise in multi-modal generative models (text, image, audio).
• Deep understanding of dataset engineering: data curation, augmentation, synthesis.
• Experience in designing and building end-to-end Generative AI systems with model orchestration and deployment.
• Hands-on experience with LLMOps lifecycle management tools and platforms.
• Experience with Model Composition (MCP) techniques combining multiple specialized models or AI agents.
• Knowledge of Responsible AI principles and implementing guardrails, safety filters, ethical considerations.
• Familiarity with applying AI in regulated financial domains.

• Design, build, and deploy production-grade applications leveraging foundation models.
• Develop and implement evaluation methodologies for open-ended AI systems.
• Apply model adaptation techniques such as prompt engineering, Retrieval-Augmented Generation (RAG), and fine-tuning.
• Create and manage datasets for training and fine-tuning models.
• Build and deploy AI agents to automate complex financial workflows.
• Optimize AI application performance focusing on latency and cost.
• Collaborate with cross-functional teams to implement AI-powered solutions addressing CFO office challenges.

Candidates must be able to work at least 3 days per week in the Krakow office if located locally. BlackLine is an equal opportunity employer committed to inclusivity and providing reasonable accommodations during the application process.