Ai test engineer -testing services

Area(s) of responsibility

Job Title: Senior AI Test Engineer

Experience: 4–5 Years

Location: Hybrid / Onsite

Employment Type: Full-time

Key Responsibilities

• Define and implement end-to-end test strategies for AI-enabled applications.
• Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
• Perform functional, integration, regression, system, and UAT testing.
• Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
• Develop and maintain API automation frameworks.
• Validate AI model responses for:
• Accuracy
• Relevance
• Consistency
• Hallucinations
• Bias
• Toxicity
• Test prompt engineering scenarios and optimize prompt quality.
• Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
• Verify AI guardrails, content moderation, and responsible AI compliance.
• Perform database validation using SQL.
• Conduct performance and load testing for APIs and AI services.
• Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.