Research agenda

Research

AI capability as a full-stack delivery and cognitive acceleration problem.

Technology is a useful servant but a dangerous master.

Christian Lous Lange

Research thesis

AI is an accelerator of human cognition, not its replacement.

Whether through AI for Science or physical AI, the goal is to expand the boundaries of human knowledge while preserving human agency. Realizing that goal requires bridging abstract intelligence with reliable, low-latency execution.

01

Current research focus

Four connected layers move intelligence from model capability to dependable real-world outcomes.

01

Foundation Models & Post-Training

100B+ parameter LLMs deployed in production.

Led post-training pipelines and tied model evaluation directly to real workflows, with an emphasis on mitigating hallucination and enabling deterministic, safe execution in mission-critical tasks.

  • 100B+ parameters
  • C-Eval #1 · Sep 2023
  • MMBench #1 · Apr 2024
  • Production deployment
02

Inference Systems & Hardware Co-Design

>50% TTFT / TPOT reduction; 100%+ IPD efficiency gain.

Architected PD-disaggregated inference and explored custom kernel generation, activation pruning, and low-bit quantization for efficient execution across heterogeneous clusters.

  • >50% TTFT / TPOT
  • 100%+ IPD efficiency
  • MLSys Challenge #1 · 2026
  • PD-disaggregated inference
03

Multimodal AI & Production Deployment

2B+ parameter VLMs serving 100K+ daily calls.

Embedded vision-language intelligence into industrial and public-service workflows, combining robust routing with the operating discipline required for commercial deployment at scale.

  • 2B+ parameter VLMs
  • 100K+ calls / day
  • 95%+ routing accuracy
  • RMB 50M+ revenue · 2025
04

Foundational Methods & Robustness

50+ publications and 150+ patents.

Research spans stochastic bandits, zeroth-order optimization, graph learning, and noisy-label robustness, grounded in constraints such as gradient noise, limited supervision, and memory bandwidth.

  • 50+ publications
  • 150+ patents
  • Bandits & optimization
  • Robust learning

02

Research throughline

From human intent to measurable impact

  1. 01

    Human inquiry

    Start from a consequential scientific or operational question.

  2. 02

    Model capability

    Post-train and align foundation models for the actual workflow.

  3. 03

    Systems execution

    Co-design inference, kernels, and hardware for reliable low latency.

  4. 04

    Real-world feedback

    Measure accuracy, efficiency, safety, and human outcomes in production.

03

Selected research works

Representative work on memory-efficient attention and lossless, verified decoding.

View all on Google Scholar
CoRR2025

HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMs

Takeaway: Addresses long-context memory bottlenecks by offloading redundant attention blocks while preserving throughput at massive sequence lengths.

KV cacheHeterogeneous attentionLong context
Expert Systems with Applications2025

BiTA: Bi-directional Tuning for Lossless Acceleration in Large Language Models

Takeaway: Uses bidirectional tuning to accelerate inference without degrading output quality, balancing speed with model fidelity.

LLM accelerationLossless speedupDecoding
ACL Findings2024

Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding

Takeaway: Pairs a lightweight verifier with parallel token generation to reduce end-to-end latency on constrained hardware.

Parallel decodingVerificationAuto-correction