Data Science & Quantitative AI Evaluation Specialist

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, they help companies build high-performing teams by matching them with professionals who truly fit their needs.

• At least one year of professional experience at a recognized company in technology, finance, or research, with some of that experience gained within the past three years.
• Foundational knowledge of data science, statistics, machine learning, or quantitative analysis.
• Strong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoning.
• Excellent written English and the ability to explain technical and statistical concepts clearly.
• Ability to evaluate complex problems systematically and provide accurate, well-supported feedback.
• Current residence in an English-speaking country.

• Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solving.
• Create expert-level prompts, datasets, and reference solutions for AI training and evaluation.
• Identify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoning.
• Assess the correctness, reliability, and clarity of analytical approaches and conclusions.
• Provide structured, evidence-based feedback to help improve AI model capabilities.
• Apply consistent evaluation criteria and communicate technical findings clearly.

Candidate must currently reside in an English-speaking country.