Chen Hu

Chen Hu

Applied Scientist at Amazon AWS · LLM post-training, agentic RL, large-scale evaluation & inference

About

I work on LLM post-training at Amazon AWS. Most of my time goes into reinforcement learning for coding agents: the RL environments the agent works in, the rewards, large-scale asynchronous RL training on dense and MoE models, the serving stack behind long-horizon agent tasks, and the held-out evaluations that tell us whether a change actually helped.

Before this, I built math and code SFT data checked with formal verification (Lean) and ran SFT training for Amazon Nova, and worked on prompt optimization and hallucination detection for Alexa.

I have a Ph.D. in Civil Engineering, where I built statistical and physics-based models of material failure, and an M.S. in Computer Science, both from the University of Minnesota.

Experience

Applied Scientist — AmazonNov 2024 – Present

AWS Agentic AI · May 2025 – Present

  • Owned the agentic-RL recipe end to end for the AWS Kiro coding agent: an in-house, difficulty-measured corpus of SWE-bench-style RL environments (containerized sandboxes, deduplicated and decontaminated against public benchmarks, used for curriculum training) and test-execution rewards built to resist reward hacking.
  • Trained dense and MoE models with asynchronous GRPO, from small-scale ablations that set the recipe to large production runs on H100/H200 clusters; extended miles (on Ray) to run asynchronous agentic rollouts on KiroRolloutService.
  • Improved the base model by +5.1 points on a SWE-bench-style benchmark and +20.7 on a held-out eval, averaged over multiple runs.
  • Optimized online serving of large MoE models for long-horizon agent tasks with PD disaggregation, speculative decoding, expert parallelism, and KV cache management: +30% throughput.
  • Built math and code SFT data paired with formal verification (Lean), tuned the data mix, and ran the SFT training on Amazon Nova; the data shipped into a production training run.
  • Building an agent that proposes repository properties, formalizes them in Lean, and proves or disproves them in a long-horizon agent loop.

Alexa · Nov 2024 – May 2025

  • Optimized in-context example selection for Alexa LLM prompts: +4.4% accuracy.
  • Built an entropy-based uncertainty signal to flag hallucinations for routing and fallback.
Software Engineer — Itasca Consulting GroupOct 2023 – Oct 2024
  • Developed FLAC3D, a commercial numerical-simulation product, in C++: graphics, computational algorithms, and I/O.
  • Built a GPT-based assistant over the product documentation to answer customer technical questions.
Applied Scientist Intern — Amazon Alexa AIMay 2023 – Aug 2023
  • Built an LLM-based pipeline to predict entity salience in very short documents (Alexa Q&A pairs). Deployed online: +25.7% salient-entity coverage and +2% click-through rate.
Graduate Research Assistant — University of Minnesota2017 – 2023
  • Built physics-based and probabilistic models of material failure: a time-dependent damage model for SiC/SiC composites (nuclear cladding) and size-effect models for quasi-brittle materials, extrapolating lab data to component-level failure risk.
  • Applied statistical modeling and ML to characterize and localize acoustic-emission signals in large experimental datasets.

Tools

PyTorchFSDPDeepSpeedMegatronmilesverlvLLMSGLangNCCLRayKubernetesSlurmPythonC++CUDATritonLean

Publications

Full list on Google Scholar.

Education

Ph.D., Civil Engineering — University of Minnesota2023
M.S., Computer Science — University of Minnesota2023