Requirements
Bachelor's degree in Computer Science, Information Technology, Software Engineering, AI or a related field. Requires 2+ years of experience in Software Quality Assurance, with specific experience testing AI applications or LLM-based solutions. Familiarity with prompt evaluation, AI workflows, and agentic AI concepts is essential. Experience with automated testing tools and frameworks, API testing, and software testing methodologies is also required, along with strong analytical, troubleshooting, and documentation skills. Knowledge of Python or other scripting languages and experience in Agile development environments are beneficial.
Description
Company Overview:Arabot is MENA's #1 semantic automation platform that brings AI and service fulfillment together to get the job done. Founded in 2016, with lots of exciting business and technical challenges coming every day solved by motivated and bright minds. On joining our team, you will enjoy competitive salary and benefits, great environment and culture!Job Summary:We are looking for a Quality Assurance Engineer specializing in AI solutions to ensure the quality, reliability, and performance of AI-powered applications. The ideal candidate has experience testing LLM-based applications, AI workflows, prompt quality, and automated testing for intelligent systems.Job Description:Develop and execute test strategies for AI and agentic AI applications.Validate AI workflows, prompts, and LLM responses for accuracy, consistency, and reliability.Design automated and manual test cases for AI-powered solutions.Perform functional, integration, regression, and performance testing.Identify, document, and track defects throughout the software development lifecycle.Work closely with AI Engineers and all stake holders to understand business requirements and expected AI behavior.Establish AI quality metrics and contribute to continuous improvement initiatives.Support release validation and production monitoring.Job Specifications:Bachelor's degree in Computer Science, Information Technology, Software Engineering, AI or a related field.2+ years of experience in Software Quality Assurance.Experience testing AI applications or LLM-based solutions.Familiarity with prompt evaluation, AI workflows, and agentic AI concepts.Experience with automated testing tools and frameworks.Knowledge of API testing and software testing methodologies.Strong analytical, troubleshooting, and documentation skills.Good communication and collaboration skills.Experience with AI evaluation frameworks.Knowledge of Python or other scripting languages.Experience working in Agile development environments.