AI Test Engineer

We are seeking a highly motivated and skilled AI Test Engineer to join our growing team. You will play a crucial role in ensuring the quality and robustness of our AI algorithms by rigorously testing their performance and identifying potential weaknesses. Your primary responsibility will be to design and execute comprehensive test plans, including sanity checks, edge case scenarios, and failure mode analysis, to push our algorithms to their limits and uncover hidden flaws. You will also be responsible for triaging algorithm-related defects arising from the field, providing crucial insights into real-world performance. You will be a key contributor in improving the reliability and trustworthiness of our AI-powered products.

Responsibilities

• Design and develop comprehensive test plans for AI algorithms, covering various aspects like functionality, performance, and robustness.
• Execute test cases, including sanity checks, edge case scenarios, and stress tests, to evaluate algorithm performance under different conditions.
• Proactively identify potential failure modes and vulnerabilities in AI algorithms through rigorous testing and analysis.
• Develop and maintain automated test suites for efficient and repeatable testing.
• Analyze test results, identify defects, and report them clearly and concisely to the development team.
• Collaborate closely with AI engineers and data scientists to understand algorithm design and identify areas of potential weakness.
• Stay up-to-date with the latest advancements in AI testing methodologies and tools.
• Contribute to the improvement of our AI testing processes and best practices.
• Document test plans, test cases, and test results thoroughly.
• Triage algorithm-related defects reported from the field, analyzing logs, data, and user feedback to identify root causes and prioritize fixes.
• Work with the development team to reproduce field issues in a controlled environment and develop appropriate tests to prevent regressions.

Requirement

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience of at least 3 yrs in software testing, preferably with a focus on AI or machine learning systems.
• Strong understanding of AI/ML concepts and algorithms.
• Proficiency in Python.
• Experience with test automation frameworks and tools.
• Ability to think critically and creatively to design effective test cases.
• Strong communication and collaboration skills.
• Experience with data analysis and visualization tools.
• Passion for AI and a desire to contribute to the development of robust and reliable AI systems.