Summary
Overview
Work History
Education
Skills
Timeline
Frameworks
Notable Accomplishments
Generic
PRIYA KUMARI

PRIYA KUMARI

GenAI QA Engineer | Sr. Lead Quality Engineer At Brillio Technologies
Pune

Summary

Decisive and performance-driven Quality Engineering professional with 11 years of experience in Software Testing, Automation, AI-led Quality Engineering, and Test Management across Real Estate, BFSI, Healthcare, Retail, and E-commerce domains. Currently leading GenAI-driven QA initiatives, including LLM validation, RAG testing, Prompt validation, Playwright automation, and API quality engineering.

Proven expertise in team leadership, cross-functional collaboration, and stakeholder management, with a track record of delivering high-quality services, mentoring teams, and driving automation strategies that improve test coverage, efficiency, and reliability. Skilled at building robust QA processes, guiding teams through automation framework migrations, and implementing AI-enhanced quality solutions that reduce manual effort and accelerate delivery timelines.

Overview

11
11
years of professional experience

Work History

GenAI - QA Lead

Brillio Technologies
10.2024 - Current

1. Client: Envestnet | Domain : BFSI | Project: GenAI-Powered QA | Website : https://www.envestnet.com/

  • Leading GenAI-driven QA initiatives, including LLM testing, RAG validation, grounding checks, prompt quality evaluation, and hallucination detection, to ensure reliable AI outputs. Validating AI agent behavior, response accuracy, context retention, model stability, and guardrail compliance across GenAI-enabled systems.
  • Designed and implemented a Python-based Playwright automation framework supporting UI and AI workflow testing with parallel execution, modular architecture, and CI/CD integration, reducing regression testing effort by ~60%.
  • Developed and executed structured test strategies for Retrieval-Augmented Generation (RAG) systems including context recall validation, embedding accuracy checks, metadata validation, chunking strategy testing, and retrieval consistency verification.
  • Performed Vector Database testing using Pinecone and FAISS, validating embedding similarity, semantic search accuracy, indexing performance, and retrieval ranking quality.
  • Conducted LangChain workflow validation, ensuring proper orchestration of LLM chains, tool integrations, memory handling, prompt templates, and agent decision flows.
  • Implemented Prompt Engineering and Prompt Testing strategies, validating prompt robustness, response determinism, prompt injection protection, and output quality across multiple scenarios.
  • Executed resilience and chaos testing to validate system fault tolerance and recovery behavior in distributed systems.
  • Increased team productivity by reviewing QA workflows and introducing automation improvements, reducing manual testing effort by ~40%.

Sr.Lead Quality Engineer

Brillio Technologies
10.2021 - 09.2024

2. Client: Realtor | Domain : Real Estate | Project: News & Insights | Website : https://www.realtor.com/

  • Led QA efforts for Realtor ‘News & Insights’, a premier real estate platform with 100M+ monthly active users, ensuring high-quality publication of articles across categories such as buy, sell, rent, finance, living, move, housing trends, home improvement, celebrity real estate, and guides.
  • Collaborate with cross-functional teams to drive quality initiatives, streamline testing processes, and enhance user experience for millions of users.
  • Migrated the automation framework from WebdriverIO to Playwright (JavaScript), improving test coverage and reducing regression testing time by 77%.
  • Present comprehensive test results and metrics to stakeholders, providing actionable insights and recommendations for process improvements.
  • Spearheaded the integration of the automation framework with CI/CD pipelines, accelerating software releases and enhancing process efficiency.
  • Recognized for exceptional contributions in QA leadership, framework migration, and process optimization, achieving over 80% increase in test coverage and significantly improving operational efficiency.

Senior Associate QA L1

Publicis Sapient
03.2020 - 06.2021

3. Client: Lowes | Domain : Ecoommerce | Project: Search | Website : http://lowes.com/

  • Spearheaded the implementation of highly effective automation testing strategies for the 'Search' project at Lowe's Incorporation, a leading e-commerce web portal.
  • Demonstrated seamless collaboration with the development team to ensure comprehensive testing and accomplished an outstanding 70% automation of UI test coverage. This achievement led to a significant reduction in manual testing efforts and a notable improvement in the user experience, leveraging the JavaScript-based WebdriverIO automation framework.
  • Successfully implemented Akamai routing and flag features, leading to a remarkable 60% reduction in manual testing efforts and a notable 39% increase in customer traffic ratio.
  • Played a pivotal role in driving a substantial 23% increase in customer traffic by seamlessly implementing automation testing procedures.

Senior Test Engineer

Yash Technologies Pvt. Ltd.
04.2016 - 03.2020

4. Client: John Deere | Domain : Manufacturing | Project: Authoring Solutions | Website : https://www.deere.com/en/

  • Led the analysis of business specifications and played a pivotal role in publishing catalogs for the Windchill authoring solution project at John Deere, a prominent agricultural equipment manufacturer. Successfully implemented database automation and java-selenium based automation framework to validate 14 distinct CSVs, ensuring precision and optimizing workflows.
  • Achieved substantial contributions in translating catalogs into 41 diverse languages, resulting in an impressive 8.5% growth in dealership production.
  • Streamlined manual task duration from 2 working days to an astonishing 3.5 minutes through the implementation of efficient database automation.
  • Achieved a 60% reduction in software release cycles by optimizing the automation framework and ensuring faster and more reliable test execution.
  • Conducted root cause analysis on defects discovered during testing, enabling quick resolution and minimizing risk of future occurrences.
  • Reproduced defects and documented findings.
  • Streamlined testing processes for increased efficiency in identifying and resolving defects.

Assistant System Engineer

Tata Consultancy Services
03.2014 - 01.2016

5. Client: GlobalMart | Domain : Ecommerce | Project: Smart Retail Sales Optimization | Website: https://globalmartonline.net/

  • Effectively conducted application testing and provided production support for an E-Commerce web portal, enabling improved schemes, gifts, and client counts on sold items. Implemented automation, resulting in an outstanding 78% reduction in manual effort during production.
  • Performed integration testing of a new plug-in on the end-user website, delivering an enhanced user experience and driving a notable 23% increase in customer traffic ratio.

Education

B.Tech. - Electronics & Instrumentation Engg.

Gandhi Institute of Engineering & Technology
Odisha, India
09-2013

Skills

CORE COMPETENCIES TECHNICAL SKILLS

AI-driven automation

LLM testing and evaluation

Vector data validation

Embedding evaluation techniques

Testing for hallucinations

Automation Testing & Functional Testing

Regression testing

Sanity / Smoke Testing

Agile project management

Test management expertise

Quality improvement initiatives

Test case development

Defect Management & Continuous Integration

Cross-Browser Testing

Cross-Functional Leadership & Client Collaboration

Problem-Solving & Customer Satisfaction

Quality Processes & Test Automation Expertise

Automation: Playwright, LangChain ,Cypress, WebdriverIO, Selenium, Protractor

Languages: JavaScript, TypeScript, Python , Java

API Testing: Postman, Rest-Assured,GraphQL

AI / GenAI Tools: Amazon Q, GitHub/Gitlab, Copilot, MCP (Model Context Protocol) ,LangChain

DevOps & CI/CD: Jenkins, CircleCI ,Docker, Kubernetes

Other Tools: Jira, QTest, Zephyr, HP ALM, BrowserStack, ReportPortal,WordPress, Akamai

Databases: SQL

Frameworks: PytestPOM,BDD, Hybrid,TDD,Keyword-driven,Cucumber, TestNG

Certifications:

ISTQB Certified Tester, Foundation Level

Playwright for Test Automation Certification

AWS Certified- Solution Architect Associate

Certified Tester AI Testing(CT-AI)

Timeline

GenAI - QA Lead

Brillio Technologies
10.2024 - Current

Sr.Lead Quality Engineer

Brillio Technologies
10.2021 - 09.2024

Senior Associate QA L1

Publicis Sapient
03.2020 - 06.2021

Senior Test Engineer

Yash Technologies Pvt. Ltd.
04.2016 - 03.2020

Assistant System Engineer

Tata Consultancy Services
03.2014 - 01.2016

B.Tech. - Electronics & Instrumentation Engg.

Gandhi Institute of Engineering & Technology

Frameworks

  • Playwright Automation Framework (POM Design Pattern)
  • Cypress Automation Framework (POM Design Pattern)
  • WebdriverIO Automation Framework (Hybrid Design Pattern)
  • Selenium Automation Framework (POM Design Pattern)

Notable Accomplishments

  • Brillian of the Quarter, 2024
  • Group Excellence Team Award, 2023
  • Special Support on PPE Hiring and Weekend Special Drive, 2022
  • Brillian of the Month, 2022
  • Group Excellence Team Award, 2022
  • Brillio Special Project Contribution, 2021
  • Best Performer of the Year, 2020
  • Extra Mile for Extraordinary Support, 2019
PRIYA KUMARIGenAI QA Engineer | Sr. Lead Quality Engineer At Brillio Technologies