Gen-AI QA Engineer
Polus Solutions
- 2 Vacancy
- Trivandrum,Kerala
-
No ratings yet!
- Posted: 2 months, 11 days ago
- Not yet applied
- Job id67b86fb45d5aa3a4275a836a
- Experience3 - 6 years
- SalaryNot disclosed
- Job Applicants0
We are looking for a detail-oriented and experienced Gen-AI QA Engineer to join our team. This role will focus on ensuring the quality and reliability of our natural language processing (NLP) and large language model (LLM) systems, including fine-tuned models, retrieval-augmented generation (RAG) workflows, and enterprise AI integrations
Skills
- Natural Language Processing (NLP)
- LLM
- RAG
- QA Testing
- AI/ML Frameworks
- Cloud Platform
Requirements
- Job Role Gen-AI QA Engineer
- Job Type Full Time
- Workplace Type Onsite
- Industry Software Development
Secondary locations
Not providedAbout
Not provided
Responsibilities
Develop and execute test plans and test cases for NLP and LLM systems, ensuring they meet quality and performance standards.
Apply a strong understanding of AI/ML model testing methodologies, including performance evaluation, error analysis, hallucination detection, and fairness/bias evaluation.
Design and implement test automation for AI/ML applications, ensuring repeatable and scalable validation processes.
Utilize Python and relevant testing frameworks (e.g., pytest, unittest, Selenium) to automate functional and integration tests.
Conduct adversarial testing to identify vulnerabilities and edge cases in AI models.
Perform system integration testing, ensuring seamless interaction between AI models and enterprise applications like Salesforce and SAP.
Validate AI-generated outputs for accuracy, consistency, and compliance with business logic.
Ensure compliance with data privacy regulations, security protocols, and ethical considerations in AI.
Collaborate with data scientists and engineers to identify and resolve issues, improve model quality, and refine testing workflows.
Document and communicate test results, defects, and recommendations to stakeholders.
Other Requirements
- Experience: 3+ years in QA testing, preferably in AI/ML applications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Strong understanding of NLP, LLMs, fine-tuning, and retrieval-augmented generation (RAG).
- Proficiency in Python and relevant testing frameworks (pytest, unittest, Selenium, Robot Framework).
- Experience with ML testing methodologies, including performance benchmarking and error analysis.
- Familiarity with cloud platforms (AWS, GCP, Azure) and distributed systems testing.
- Knowledge of API testing, system integration testing, and experience working with enterprise applications like Salesforce and SAP.
- Understanding of automation testing for AI/ML pipelines.
- Strong analytical skills with attention to detail and problem-solving ability.
- Excellent communication skills to interact with technical teams and stakeholders.
Good to have
- Experience with test automation tools and frameworks for AI/ML applications.
- Contributions to open-source QA projects or publications in the field of AI testing.
- Certifications in QA or software testing (e.g., ISTQB).
- Experience in an Agile development environment.
About the Company
Established in 2009, Polus is a global software solutions and product
development company dedicated towards providing expert software development services and solutions for small, large and medium-sized companies. Polus thrives on process-driven software development and consulting models that meet the needs for a variety of consumers. We offer software and system product development, application development, mobile application development and more. Our methodology focuses on reliability, quick turnaround, and high-value product and we offer both on-site and off-shore options.
We are a team of experienced employees that are experts in developing concise yet advanced software options for all types of customers. Creativity, flexibility, collaboration and personal initiative are core values at Polus, where our self-motivated workforce is always seeking opportunities to further their training and grow.
Our people are our greatest strength. We have developed a team focused on inclusivity and collaboration, meaning that your role is fundamental to the team. Our employees are able to enjoy responsibility, even at an initial stage of profession. We focus on nurturing our employees' careers through each step of the way.