Senior ML Engineer / AI Evaluation & Infrastructure

Building reliable AI at scale.

I'm Monidipa Chakraborty. I build evaluation and data systems for coding agents, trustworthy execution environments, and the distributed GPU infrastructure behind modern AI—drawing on 12 years of engineering at Amazon.

Sunnyvale, California·Founding Engineer at AWS SageMaker HyperPod
01 / About

Systems thinking.
Measurable AI.

I work where coding-agent behavior, rigorous evaluation, and infrastructure meet—making complex AI systems more trustworthy and scalable.

I'm a Senior ML Engineer at Amazon Kiro, building production agent-trajectory data pipelines, LLM-assisted labeling, privacy-preserving task taxonomies, and benchmarks used to understand how coding agents perform.

I also work on coding-environment creation and validation, reward-integrity audits, and LLM-judge calibration—catching faulty environments, misleading success signals, and evaluation leakage before they distort results.

Previously, I was a Founding Engineer at AWS SageMaker HyperPod, where I helped build the systems for continuous cluster scaling, desired-state reconciliation, and resilient operations across large GPU fleets.

Across these roles, the common thread is turning hard operational and measurement problems into reliable, well-instrumented systems. I enjoy sharing what I learn through writing and open-source experiments.

02 / Selected work

Systems that make
AI measurable.

From agent-data pipelines and coding-environment quality to GPU infrastructure that operates at cloud scale.

01 / AGENT DATA & EVALUATION

Turning agent behavior into useful signals

Built production trajectory labeling, privacy-aware task taxonomies, and evaluation datasets for coding agents. Combined LLM extraction, embedding-based clustering, and controlled prompt experiments.

LLM labelingBenchmarksIceberg
02 / CODING ENVIRONMENTS

Making evaluations trustworthy

Designed environment creation and pre/post-run validation, audited reward integrity, and uncovered solution leakage that could inflate coding-agent benchmark results.

Environment validationLLM judgesReward integrity
03 / DISTRIBUTED INFRASTRUCTURE

Keeping large GPU systems reliable

As a Founding Engineer at SageMaker HyperPod, helped build cloud-scale cluster workflows, continuous scaling, and resilience mechanisms; later worked across multi-region GPU scheduling, networking, and shared storage.

SageMaker HyperPodEKS / KueueLustre
03 / Experience

From cloud systems
to agent evaluation.

Twelve years of engineering at Amazon, spanning distributed platforms, foundation-model infrastructure, and the systems used to measure AI coding agents.

Mar 2026 — Present
AMAZON / KIRO

Senior ML Engineer

Agent data and evaluation pipelines, privacy-aware task taxonomies, coding-environment quality, reward-integrity audits, and ML platform infrastructure.

May 2023 — Mar 2026
AWS / SAGEMAKER HYPERPOD

Senior Software Engineer · Founding Engineer

Built cluster lifecycle workflows, continuous non-blocking scaling, reconciliation, multi-tenant isolation, and resilience for foundation-model GPU infrastructure.

Jul 2014 — May 2023
AMAZON & AWS

Software Engineering

Built and operated systems across SageMaker Processing and Batch Transform, Just Walk Out, and Prime Video.

04 / GitHub projects

Learning and building
in the open.

Selected public repositories—from reproducible coding-agent benchmarks to hands-on model-building exercises and developer tooling.

01 / CODING-AGENT BENCHMARKS

longcode-bench ↗

An exploratory long-horizon coding benchmark using Harbor and OpenSandbox, including network-isolated verification, pinned environments, and a task-design rubric.

HarborOpenSandboxEvaluation
02 / MACHINE LEARNING FROM FIRST PRINCIPLES

makemore-plus ↗

A hands-on PyTorch learning project inspired by Karpathy's lectures, covering character-level language models, embeddings, batch normalization, and manual gradient checks.

PyTorchLanguage modelsLearning
03 / DEVELOPER TOOLING

dot-files ↗

Reproducible terminal, editor, and shell configurations across Zsh, Helix, Neovim, Ghostty, and other tools, managed with GNU Stow.

ToolingDeveloper experience
Explore my GitHub profile ↗
06 / Connect

Let's talk about hard problems.

Especially agent evaluation, reproducible coding environments, resilient GPU platforms, and making complex systems work in practice.