I am a Software Engineer specializing in AI infrastructure with 10+ years of industry experience spanning large-scale distributed systems at AWS, full-stack MLOps platforms at Uber, and hands-on startup experience building ML infrastructure from the ground up.
Current Role
Tech Lead specializing in multimodal AI infrastructure at a biotech AI research startup. Built the company’s unified ML platform from the ground up, establishing the foundation for AI research and production applications across notebooks, distributed training, large-scale batch inference, real-time inference, and agentic workflows.
- Build data loading pipeline with distributed cache to accelerate multimodal data loading.
- Build distributed training framework in PyTorch with model (FSDP/context) parallelism.
- Build large-scale batch inference system deployed across multiple cloud providers.
- Optimize inference engine optimization with KV cache optimization, SGLang, dynamic batching, and quantization.
- Develop custom CUDA/CUTLASS kernel libraries for both training and inference workloads.
- Build agentic workflows to automate daily engineering and operation tasks.
Previous Experience
At AWS, I led the development of Amazon Transcribe — a real-time speech recognition service — from scratch, building multi-tenant cloud services, real-time bidirectional streaming (HTTP/2, gRPC), and full MLOps training and evaluation pipelines. I led a team to develop applications for specialized domains including medical and call center analytics.
At Uber (Michelangelo team), I engineered a Kubernetes-based control plane for the internal ML platform, designed workflow systems to streamline model lifecycles (training, evaluation, monitoring), and built orchestration frameworks to improve reliability of training pipelines on Spark and Ray.
Background
I started my career in CPU physical design at Broadcom, working on ARM v16 cores — timing closure, place & route, and CAD tooling. This hardware-level understanding of compute architecture informs my systems work today.
I hold a Master’s in Electrical & Computer Engineering from the University of Florida and a Bachelor’s in Micro-electronics from UESTC.