Gramian Consulting Group

AI Conversation Evaluation & Context Research Specialist

Brak informacji o wynagrodzeniu

MidZdalnieFull-time

#464103·Dodano 9 dni temu·5

Źródło: Gramian Consulting Group

Aplikuj teraz

Tech Stack / Keywords

AIHCI

Podsumowanie oferty

Evaluate conversations between people and AI models for AI conversation evaluation research. Assess whether the model gathered sufficient context, identify missed clarification opportunities, and provide structured feedback to improve conversational quality.

Wymagania

At least 3–5 years of direct professional experience in one or more of the listed domains.
Strong analytical and interviewing skills, and the ability to distinguish essential, decision-changing information from less relevant details.

Licensed Social Work:

Master's degree in Social Work (MSW) or an equivalent graduate-level qualification.
LCSW, LICSW, LMSW, or an equivalent applicable social work credential or license.
Experience in client assessment, case review, interviewing, counseling, or related social-work practice.

Counseling, Therapy, or Psychology:

Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy credential; or a PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work.

Qualitative Research, HCI, or Communication:

MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.
Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
Ability to analyze conversations systematically and identify missing context or patterns in human communication.

Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields:

Relevant professional qualification, credential, or demonstrated subject-matter expertise.
At least 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway.
Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work.
Ability to gather context, understand individual or organizational needs, and provide informed recommendations.

Obowiązki

Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, everyday planning, wellbeing, and other real-world decisions.
Evaluate whether the AI gathered sufficient context before providing advice, recommendations, or proposed solutions.
Identify missing information and suggest relevant follow-up questions to improve response quality.
Assess whether additional context would materially change a recommendation or decision.
Distinguish information that could change an outcome from non-essential or descriptive details.
Conduct qualitative reviews using structured evaluation guidelines and document findings consistently.
Identify missed opportunities for clarification, contextual understanding, and information gathering.
Consider personal, psychological, social, financial, practical, and organizational factors when evaluating conversations.
Collaborate with research teams to maintain consistent evaluation standards and high-quality assessments.
Complete assigned tasks accurately within project timelines.

Gramian Consulting Group

17 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz