AI Quality Engineer

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring an AI Quality Engineer in Kuala Lumpur, Malaysia!

Join us in building a next-generation AI Virtual Companion for Operation Planning & Optimization. Powered by Large Language Models (LLMs) and agentic AI, you'll help create intelligent systems that can reason, retrieve information, and act autonomously.

Role Responsibilities & Job Description:

• Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI’s boundaries and responses.
• LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention.
• Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale.
• Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks.
• Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability.
• Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation.
   

Requirements & Qualifications:

• Bachelor’s degree or above, with 2-5 years in software development and relevant experience specifically within the AI/ML development landscape.
• AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows.
• Programming: Proficiency in Python.
• API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.