Lead AI Engineer · Raleigh-Durham, NC

Subba Taniparti

I specialize in Retrieval-Augmented Generation (RAG), high-throughput LLM serving infrastructure, and robust MLOps/GenAIOps platforms. Most recently at Mastercard's AI Center of Excellence, I led development and deployment of assistant platform runtimes and prompt guardrails on AWS EKS.

cv·github·linkedin·email

Selected work

  • ApplyRail

    Job portal matching 50K+ postings to international students using Gemini embeddings + pgvector; serves from a single Proxmox node at ~180ms p95.

    Flask Postgres pgvector Gemini Docker
    180ms
    p95 Latency
  • KernServe

    Custom LLM inference runtime optimized for 6GB GPUs utilizing custom CUDA-accelerated kernels, dynamic batching, and INT4 quantization to achieve 45+ tokens/sec on local consumer hardware.

    Python CUDA C++ GGUF PyTorch vLLM
    45+
    tokens/sec
  • RAG-Eval

    Enterprise RAG observability platform calculating semantic similarity, retrieval precision, and answer faithfulness metrics in real-time for Mastercard Assistant Platform (MAP), handling 1.2M monthly queries.

    Python Databricks Splunk Datadog SageMaker
    1.2M
    queries/mo
  • Bio-Segment

    Edge-deployed insect mortality detection model running on GCP IoT Core and SageMaker pipelines, automating computer vision analysis of 100K+ daily farm images with an 18% harvest yield gain.

    AWS GCP Step Functions Airflow BigQuery Dataflow
    18%
    yield gain

Writing

Demo: LLM gateway guardrails

A scripted simulation (no live model behind it), modeled on the guardrail gateways I have worked on, showing how a gateway evaluates inputs against security guardrails and performs real-time context retrieval.

gateway-agent-v1.4.2
SYSTEM ACTIVE
Console initialized. Select a scenario and press "Run Trace".
[email protected]:~$ _

Experience

  • MASTERCARD — Lead AI Engineer – AI Center of Excellence
    Sep 2025 – Present
  • MASTERCARD — Senior Cloud Engineer – AI/ML Enablement & AWS Cloud Platform
    Sep 2022 – Aug 2025
  • BAYER CROP SCIENCE — Senior Data Engineer – ML & Data Science Pipelines
    May 2021 – Present
  • BAYER CROP SCIENCE — Cloud Data Engineer, Contractor
    Apr 2020 – May 2021
  • EQUIFAX — Sr Data Engineer, Contractor
    Feb 2020 – Apr 2020
  • BAYER CROP SCIENCE — Data/Analytics Engineer, Contractor
    June 2018 – Feb 2020
  • ERICSSON INC — API/Data Engineer, Contractor
    Jan. 2016 – Jun. 2018

Contact

Open to Lead and staff AI/ML engineering roles. Best reached by email.

Email LinkedIn GitHub