Curious by default. Driven by impact.

Ronit Shaw

Senior Software Engineer · Generative AI

I bring 8+ years of experience designing and building full-stack solutions and AI platforms at scale, while helping engineers grow.

Always looking for meaningful problems - and good people to solve them with.
Portrait of Ronit Shaw
A builder's mindset. A curious streak.
Profile

At a glance.

Experienced software developer and data scientist with 8+ years designing and building full-stack solutions and AI platforms at scale. I specialize in building production-grade platforms that fuse large language models, deep learning, and thoughtful product design.

Skilled in software development and architecture, DevOps, Kubernetes operations, machine learning, data science, statistics, Python, Golang, and natural language processing/understanding—always with an eye toward scalable engineering excellence.

Impact

Selected accomplishments.

  1. Designed, implemented, and scaled the Model Hosting Framework (MHF), serving 40+ production endpoints at nearly 1M calls per month and 99% availability

  2. Built Tortoni, a scalable AKS-based load balancer across 30 OpenAI endpoints in multiple regions, and published a Python package

  3. Patent co-inventor for a Retrieval-Augmented Generation system enabling context-rich copilots across Azure

  4. Designed multi-agent Azure OpenAI platform processing 30K+ support tickets per day for summarization and RCA

  5. Led SFI Waves 4–6 with ~400 security action items and reduced MHF vulnerability findings from 3,000+ to <50

  6. Built and launched CIS Incident MCP to production and AME; led the Agency Review rollout for a 100-repository scope

  7. Enabled Incident Investigator with ~120 daily active users; incident-intelligence workflows average ~500 tool calls/day, aiming to reduce incident time-to-mitigate

  8. Served on the Global Hackathon judging panel that selected the top 0.7% of projects from 1,100+ submissions

Experience

Built over time.

Microsoft

Senior Software Engineer

MCIS AI Innovation · Previously Azure Core Insights

Jan 2021 – Present New York, NY
  • Designed, implemented, and scaled the Model Hosting Framework (MHF) end to end: a Kubernetes platform serving 40+ production endpoints through a FastAPI gateway for authentication, routing, and streaming, supporting nearly 1M calls per month at 99% availability.
  • Built incident-routing automation with 4 agents covering 66 of 69 CIS queues and approximately 292.8K incidents per year, reducing average time-to-engage by 58% and routing hops by 72%.
  • Shipped DERA and the CARET front end to summarize and root-cause 30K+ support tickets per day for 50+ Azure service PMs; scaled serving across 30+ Azure OpenAI model endpoints.
  • Led the Agency Review rollout for a 100-repository scope, with adoption monitoring and review-evaluation guardrails aimed at consistent feedback and shorter review cycles.
  • Built Tortoni, a scalable AKS-based load balancer across 30 OpenAI endpoints in multiple regions, and published a Python package.
  • Launched CIS Incident MCP in production and AME with 5 incident-intelligence tools for routing, summaries, classification, similarity search, and ownership; enabled Incident Investigator with end-to-end validation and usage telemetry for ~120 daily active users. Incident-intelligence workflows average ~500 tool calls/day, with a goal of reducing incident time-to-mitigate.
  • Serve as Service Security Champion for MCIS AI Innovation; previously completed and drove 500+ security remediations across Azure Core Insights SFI Waves 2–4, helping raise Get Secure Score above 650 across services.
  • Led SFI Waves 4–6 with ~400 security action items during May–October 2025; introduced MHF container-hygiene guardrails that reduced vulnerability findings from 3,000+ to <50.
  • Patent contributor for a Retrieval-Augmented Generation platform blending vector stores, identity enrichment, and agentic code generation to deliver real-time, context-rich answers and executable workflows.
  • Enhanced Wayfinder support recommendations with +3 coverage, +1 accuracy, and 60% latency reduction while modernizing CI/CD for Wayfinder and Service Predictor (12% maintenance cost savings).
  • Shipped Azure Case Submission Autosuggest, Azure Workload Identification (clustering + BERT topic modeling), and an IcM Team Prediction service powered by Azure Cognitive Search running on AKS.
  • Software Development
  • Machine Learning
  • Microsoft Azure
  • Kubernetes
  • Azure OpenAI
  • LLMs
  • Microservices
  • Python
  • C++
  • Data Engineering
  • DevOps
  • NLP

IBM

Cognitive Software Developer / Data Scientist

Jun 2018 – Jan 2021 Emeryville, CA
  • Developed ML and DL pipelines to classify high-dimensional network transfer sessions using semi-supervised learning and ensemble models.
  • Implemented real-time anomaly detection with LSTM and autoencoder architectures to protect mission-critical data flows.
  • Served as backend lead for IBM Aspera Automation, designing software components and API integrations for large enterprise clients.
  • Delivered the Aspera Centralized Control Plane aligned with IBM Cloud Pak for Integration, creating open service brokers and microservices.
  • Partnered with customers and product teams to triage issues, iterate on features, and drive successful production deployments.
  • IBM Cloud
  • Microservices
  • Python
  • Kubernetes
  • Machine Learning
  • Deep Learning
  • Software Architecture
Other experience

Where curiosity took root.

University of California San Diego

Graduate Teaching Assistant

Mar 2017 – Mar 2018 La Jolla, CA
  • Graduate Teaching Assistant for PSYC 60 (Intro to Statistics), CSE 103 (Probability & Statistics), and ECE 109 (Engineering Probability & Statistics).
  • Led discussion sections, office hours, and exam reviews to boost mastery across 200+ students per term.
  • Collaborated with faculty on assignment design, grading rubrics, and course improvements.
  • Python
  • Statistics
  • Teaching

IBM

Machine Learning / Deep Learning Intern, Global Chief Data Office

Jun 2017 – Sep 2017 Silicon Valley Labs
  • Classified Government Owned Entities using IBM's Cognitive Enterprise Data Platform to improve regulatory reporting accuracy.
  • Built NLP pipelines in Python with Gensim, spaCy, and NLTK alongside Gradient Boosting and Random Forest models.
  • Developed TensorFlow CNN architectures with Doc2Vec/Word2Vec embeddings, achieving 97% predictive accuracy and strong F1 scores.
  • Delivered insight-ready dashboards and technical documentation for the Global Chief Data Office.
  • Machine Learning
  • Python
  • Software Development
  • Artificial Intelligence

Mitacs

Student Ambassador, Globalink Program

Jan 2016 – Sep 2016 Canada (Remote)
  • Represented Mitacs Globalink across campus events and webinars, mentoring prospective research scholars
  • Guided international students through application planning, documentation, and program onboarding
  • Partnered with universities and research labs to expand awareness of funded research opportunities
  • Mentorship
  • Public Speaking
  • Program Management

University of Alberta

Summer Research Intern (Mitacs Globalink)

May 2015 – Jul 2015 Canada
  • Implemented and tested a sensor device that measures ankle torque during functional electrical stimulation therapy
  • Built a LabVIEW data acquisition pipeline and MATLAB analytics workflow to quantify response latency for spinal cord injury patients
  • Collaborated with clinicians to translate measurement insights into improved rehabilitation protocols
  • LabVIEW
  • MATLAB
  • Signal Processing

Indian Institute of Science

Summer Research Intern

May 2014 – Jul 2014 Bangalore, India
  • Completed the "Analysis of Exoskeleton Assisted Walking" project using motion-capture data from IMU sensors
  • Developed simulation workflows comparing gait with and without exoskeleton support to identify mobility gains
  • Partnered with biomechanics researchers to translate simulation results into exoskeleton design recommendations
  • Biomechanics
  • Simulation
  • Data Analysis
Security leadership

Security, built in.

Service Security Champion · Microsoft · MCIS AI Innovation ·

Lead service-security and compliance work, building on cross-team Secure Future Initiative leadership in Azure Core Insights.

May – Oct 2025

SFI delivery & container hygiene

Led SFI Waves 4–6 with ~400 security action items. MHF container-hygiene guardrails reduced vulnerability findings across base images and dependencies from 3,000+ to <50.

Oct 2024 – May 2025

Cross-team remediation

Led 75+ SFI action items, including 15+ directly executed. Manager feedback also recognized 500+ security remediations completed and driven across SFI Waves 2–4.

Selected period-specific outcomes. Action items and vulnerability findings are different measures and are not added together.

Community / Judging

Recognizing good ideas.

Completed engagements and confirmed upcoming appointments.

Judge, Microsoft Global Hackathon – Ambient Agent Challenge

Confirmed as a judge for the 2026 Global Hackathon Ambient Agent Topic Challenge. Project evaluation is scheduled for September 23–29, 2026.

Judge, USAII's Global AI Hackathon 2026

Evaluated AI projects on performance, innovation, and technical excellence. Recognized by the United States Artificial Intelligence Institute with a Certificate of Appreciation, issued June 27, 2026.

View certificate

Judge, Global Hackathon – AI Foundry Challenge

Evaluated finalist AI Agent projects prescreened from 1,100+ global entries, contributing to the judging panel's collective selection of the top 0.7% of solutions.

Judge, Code4Hope STEM Hackathon (Sustainability Track)

Evaluated student sustainability projects for the 2025 Code4Hope STEM Hackathon.

Judge, NYU SPS DPB × Microsoft AI Accelerator Challenge

Evaluated student-led AI startups alongside NYU and Microsoft leaders, selecting winners across innovation, impact, and presentation categories.

Read more
Community / Mentoring

Growing together.

Azure Core Mentor Ring Program

Microsoft · FY27 H1 · Six-month cycle

Co-lead a software-engineering mentoring cohort of 10 mentees, supporting early-career engineers through recurring group sessions and ongoing discussion.

  • Guide engineers on career growth, navigating ambiguous projects, and aligning technical work with organizational priorities.
  • Organize ring sessions, prepare discussion topics, and support follow-up questions between meetings.

Microsoft Explore Internship Program

Microsoft · MCIS AI Innovation · Explore pod · 3 interns

Technical mentor for 3 Explore interns in Microsoft's summer 2026 program, supporting onboarding, project planning, and 1:1 engineering guidance.

  • Guided project scoping and technical onboarding, connecting the intern roadmap with existing tools, data sources, and engineering workflows.
  • Provided 1:1 engineering guidance, helped unblock project work, and coordinated intern showcase preparation.
Education

A foundation for what's next.

University of California, San Diego

M.S., Electrical & Computer Engineering (Machine Learning & Intelligent Systems)

2016 – 2018 La Jolla, CA

Indian Institute of Technology, Guwahati

B.Tech., Mechanical Engineering (Minor in Computer Science)

2012 – 2016 Guwahati, India
Skills

The technical toolkit.

Programming Languages

  • Python
  • C++
  • Golang
  • Ruby
  • SQL
  • Bash

AI / ML & NLP

  • Azure OpenAI
  • TensorFlow
  • Keras
  • Scikit-learn
  • BERT
  • LSTM
  • CNNs
  • Autoencoders
  • Retrieval-Augmented Generation
  • Agentic Workflows

Cloud & DevOps

  • Azure Kubernetes Service
  • Azure Cognitive Search
  • Azure DevOps
  • Docker
  • Kubernetes
  • Terraform
  • CI/CD

Data & Orchestration

  • LangChain
  • Pandas
  • NumPy
  • spaCy
  • NLTK
  • Gensim
  • MCP
Continuing education

Always learning.

  • Python: Design Patterns (2021)
  • Python: Advanced Design Patterns (2018)
  • Finance Foundations
  • Cryptocurrency Foundations
  • Learning Bitcoin and Other Cryptocurrencies
  • Building an Ethereum Blockchain App: Introduction Series
View certifications on LinkedIn
Recognition

Honors & awards.

  • Mitacs Globalink Research Internship Award
  • Gold Medalist – National Biotechnology Olympiad
  • Phyllis Pearson Award – High Achievement
A conversation could be the start

Let's build something that matters.

I'm always looking for work that makes a meaningful difference. If you're exploring a useful AI product, a challenging systems problem, or a way to help others grow, I'd love to compare notes and build something together.

LinkedIn is the best way to reach me for a project, a thoughtful technical conversation, or opportunities to mentor, volunteer, or speak.

  • AI with purpose

    Useful products that turn promising ideas into something people can rely on.

  • Reliable systems

    Thoughtful engineering that makes complex things simpler, safer, and more scalable.

  • Shared learning

    Mentoring, exchanging ideas, and helping each other do better work.