Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models. [blog] [checkpoints] 2025.
NVIDIA: Wei Ping (core contributor).
Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning. [project] [blog] 2025.
NVIDIA: Wei Ping (core contributor).
AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling. [project] [checkpoints and training data] 2024.
Zihan Liu*, Yang Chen*, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping.
NVLM: Open Frontier-Class Multimodal LLMs. [project] [checkpoints] [training code] Technical Report. 2024.
Wenliang Dai*, Nayeon Lee*, Boxin Wang*, Zhuolin Yang*, Zihan Liu, Jon Barker, Tuomas Rintamaki, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping*.
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models. [checkpoints] ICLR 2025.
[NV-Embed-v1 ranked No. 1 on the MTEB Benchmark as of May 24, 2024. NV-Embed-v2 reclaimed No.1 as of Aug 30, 2024.]
[We built multimodal retriver MM-Embed (ICLR 2025) based on NV-Embed-v1]
Chankyu Lee, Rajarshi Roy, Mengyao Xu, Jonathan Raiman, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping.
ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities. [project] [checkpoints] ICLR 2025.
Peng Xu, Wei Ping, Xianchao Wu, Zihan Liu, Mohammad Shoeybi, Bryan Catanzaro.
ChatQA: Surpassing GPT-4 on Conversational QA and RAG. [project] [checkpoints] NeurIPS 2024.
Zihan Liu, Wei Ping, Rajarshi Roy, Peng Xu, Chankyu Lee, Mohammad Shoeybi, Bryan Catanzaro.
RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs. NeurIPS 2024.
Yue Yu+, Wei Ping, Zihan Liu, Boxin Wang, Jiaxuan You, Chao Zhang, Mohammad Shoeybi, Bryan Catanzaro.
InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining. [code] [model] ICML 2024.
Boxin Wang+, Wei Ping, Lawrence McAfee, Peng Xu, Bo Li, Mohammad Shoeybi, Bryan Catanzaro.
Retrieval meets Long Context Large Language Models. ICLR 2024.
Peng Xu, Wei Ping, Xianchao Wu, Lawrence McAfee, Chen Zhu, Zihan Liu, Sandeep Subramanian, Evelina Bakhturina, Mohammad Shoeybi, Bryan Catanzaro.
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study. [code] EMNLP 2023.
Boxin Wang+, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi et al.
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning. Findings of EMNLP 2023.
Zhuolin Yang+, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie et al.
BigVGAN: A Universal Neural Vocoder with Large-Scale Training. [demo] [code] ICLR 2023.
Sang-gil Lee+, Wei Ping, Boris Ginsburg, Bryan Catanzaro, Sungroh Yoon.
Factuality Enhanced Language Models for Open-Ended Text Generation. [code] NeurIPS 2022.
Nayeon Lee+, Wei Ping, Peng Xu, Mostofa Patwary, Pascale Fung, Mohammad Shoeybi, Bryan Catanzaro.
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models. [code] NeurIPS 2022.
Boxin Wang+, Wei Ping, Chaowei Xiao, Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Bo Li, Anima Anandkumar, Bryan Catanzaro.
Long-Short Transformer: Efficient transformers for language and vision. [code] NeurIPS 2021.
Chen Zhu+, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro.
DiffWave: A versatile diffusion model for audio synthesis. [project] ICLR 2021 (Oral).
Zhifeng Kong+, Wei Ping, Jiaji Huang, Kexin Zhao, Bryan Catanzaro.
WaveFlow: A compact flow-based model for raw audio. [project] ICML 2020.
Wei Ping, Kainan Peng, Kexin Zhao, Zhao Song.
Non-autoregressive neural text-to-speech. [demo] ICML 2020.
Kainan Peng, Wei Ping, Zhao Song, Kexin Zhao.
ClariNet: Parallel wave generation in end-to-end text-to-speech. [demo] ICLR 2019.
Wei Ping, Kainan Peng, Jitong Chen.
Deep Voice 3: Scaling text-to-speech with convolutional sequence learning. [demo][more samples] ICLR 2018.
Wei Ping, Kainan Peng, Andrew Gibiansky, Sercan O. Arik, Ajay Kannan, Sharan Narang, Jonathan Raiman, John Miller.
Neural voice cloning with a few samples. [demo] NeurIPS 2018.
(α-β) Sercan O. Arik, Jitong Chen, Kainan Peng, Wei Ping, Yanqi Zhou.
Deep Voice 2: Multi-speaker neural text-to-speech. [demo] NeurIPS 2017.
(α-β) Sercan O. Arik, Gregory Diamos, Andrew Gibiansky, John Miller, Kainan Peng, Wei Ping, Jonathan Raiman, Yanqi Zhou.
Learning infinite RBMs with Frank-Wolfe. NeurIPS 2016.
Wei Ping, Qiang Liu, Alexander Ihler.
Decomposition bounds for marginal MAP. NeurIPS 2015.
Wei Ping, Qiang Liu, Alexander Ihler.
Marginal structured SVM with hidden variables. ICML 2014.
Wei Ping, Qiang Liu, Alexander Ihler.
