Summary
Overview
Work History
Education
Skills
Timeline
Generic
Sourabh Pandey

Sourabh Pandey

Lead QA Automation Engineer
Pune

Summary

Lead SDET and GenAl Developer with over 8 years of experience across test automation, LLM evaluation, and full-stack Al system design. Proven expertise in building LangGraph-powered multi-agent chatbots, designing RAG pipelines using OpenSearch, and creating Al evaluation frameworks using Kafka and LLMs. At the same time, deeply experienced in building scalable, cloud-ready test automation frameworks for both backend and UI layers using Python, JavaScript, Selenium, TestNG, and PyTest. Strong background in prompt engineering, adversarial red teaming, and productionizing GenAl for enterprise support and QA use cases. Known for bridging the gap between robust testing practices and cutting-edge Al integration.

Overview

8
8
years of professional experience
4
4
years of post-secondary education

Work History

Lead Automation QA Engineer & GenAl Developer

Qualys Inc
Pune
05.2022 - Current
  • Led design of a LangGraph-based multi-agent Al chatbot system handling small talk, product FAQs, platform status, and troubleshooting using OpenAl Function Calling.
  • Developed and productionized a RAG system using OpenSearch and HuggingFace embeddings to retrieve answers from PDFS, HTML, Excel, and KB APIs.
  • Built a Kafka-based Al evaluation pipeline, routing scan messages to an OCI-hosted LLM judge that scores scan results and hallucination risks.
  • Engineered a modular ingestion pipeline (FastAPI-based) to parse documents, chunk them by section headers, and attach metadata for semantic retrieval.
  • Conducted extensive prompt engineering and red teaming, testing OpenAl completions against misuse, bias, and unsafe suggestions.
  • Created fallback and recovery logic for agents using structured-JSON outputs, re-prompt strategies, and summarization flows.
  • Enabled multi-tenant document search support via dynamic-OpenSearch prefixing and user-specific metadata tagging.
  • Built reusable LangChain tool wrappers to connect Al agents with internal APIs, keyword search, status feeds, and scan processors.
  • Designed cloud-ready test automation pipelines for Ul and API layers using Selenium, TestNG, and PyTest.
  • Integrated GenAl feedback into QA regression testing via auto-evaluated test scripts.

Senior SDET Engineer

SAS-R&D
03.2021 - 05.2022
  • Spearheaded test automation initiatives in Fraud and Security, improving fraud detection accuracy.
  • Designed scalable Unit and E2E testing frameworks for Node.js applications using Protractor and Webdriverio.
  • Developed Al-driven test scripts to identify fraud patterns using machine learning models.
  • Served as Scrum Master, guiding Agile best practices and increasing sprint velocity.
  • Conducted training on automation tools, enhancing team proficiency and reducing test execution time.

Test Automation Engineer

Accenture
Pune
05.2017 - 03.2021
  • Designed and implemented scalable test automation frameworks for enterprise applications.
  • Reduced manual testing efforts by 25% through strategic automation and process optimization.
  • Developed automation scripts for regression and performance testing using Selenium and TestNG.
  • Collaborated with developers for early defect detection, improving release cycles and software quality.
  • Led monthly code reviews to ensure best practices in test automation scripting.

Education

B.Tech - Electrical & Electronics Engineering

KIIT University
Bhubaneswar
01.2013 - 01.2017

Skills

  • Git

  • Python

  • Java

  • LangGraph

  • LangChain

  • Multi-agent orchestration

  • OpenAl Function Calling

  • RAG pipelines

  • Semantic indexing (HuggingFace)

  • Selenium

  • TestNG

  • Python (async/FastAPI)

  • Kafka

  • REST APIS

  • Jenkins

  • Docker

  • AWS S3

  • HuggingFace Embeddings

  • LLM Evaluation

  • Prompt Engineering

  • FastAPI

  • Test Automation

  • CI/CD (Jenkins, GitHub Actions)

  • Microservice QA

  • API Testing

Timeline

Lead Automation QA Engineer & GenAl Developer

Qualys Inc
05.2022 - Current

Senior SDET Engineer

SAS-R&D
03.2021 - 05.2022

Test Automation Engineer

Accenture
05.2017 - 03.2021

B.Tech - Electrical & Electronics Engineering

KIIT University
01.2013 - 01.2017

Similar Profiles

CREATE PROFILE
Sourabh PandeyLead QA Automation Engineer