AI prompt and quality engineer - coinmarketcap

Job Title:

AI Prompt and Quality Engineer

Location: Remote – Kuala Lumpur, Malaysia

Employment Type: Full-Time

About the Role:

CoinMarketCap is hiring an AI Prompt and Quality Engineer to ensure high-quality performance of our AI chatbot products. This role focuses on monitoring, evaluating, and optimizing chatbot responses to enhance user experience and maintain response accuracy.

Key Responsibilities:

• Quality Assurance: Conduct daily manual sampling and review of chatbot interactions to ensure accuracy, relevance, and naturalness
• Issue Tracking: Identify quality issues, analyze root causes, and recommend actionable improvements
• Model Enhancement: Collaborate with engineering teams on prompt tuning, data annotation, and AI parameter adjustments
• Data Analysis: Examine user conversations to uncover insights and inform optimization strategies
• Workflow Improvement: Streamline and standardize QA processes to boost efficiency and consistency

Requirements:

• Technical Skills:
• Knowledge of AI chatbot mechanics and evaluation
• Proficiency in SQL, Excel; basic NLP and ML concepts
• Experience:
• 2+ years in AI QA or chatbot-related roles
• Familiarity with top-tier chatbot platforms
• Soft Skills:
• Detail-oriented, communicative, collaborative, and adaptive to fast-paced settings