Search Results - hung-yueh+chiang

3 Results Sort By:
Quamba2: a robust and scalable post-training quantization framework for selective state space models (SSMs)
Quamba2 highlights Supports W4A8 / W4A16 / W4AX / W8A8 for Mamba1 and Mamba2 Achieves 4x memory reduction and 3x generation speedup Enables 8B model inference on Orin Nano 8G at 13 tokens/sec Outperforms W4A8KV4 Llama3-8B in both speed and quality Background Deploying state space models (SSMs), which excel at processing long sequences but demand...
Published: 4/9/2025   |   Inventor(s): Diana Marculescu, Hung-Yueh Chiang, Chi-Chih Chang, Natalia Frumkin, Mohamed Abdelfattah, Kai-Chiang Wu
Keywords(s):  
Category(s): Software > AI, Computer > AI/ML > Language processing
Quamba: Post-training quantization for selective state space models
Background State Space Models (SSMs) are integral to numerous advanced technologies, including natural language processing, robotics, autonomous vehicles, and edge computing systems. As these applications increasingly demand real-time processing and intelligent decision-making on devices with limited computa­tional resources, there is a pressing...
Published: 1/23/2025   |   Inventor(s): Diana Marculescu, Hung-Yueh Chiang, Chi-Chih Chang, Natalia Frumkin, Kai-Chiang Wu
Keywords(s):  
Category(s): Computer > AI/ML, Computer > AI/ML > Language processing, Software > AI > Machine learning
Chance-Constrained Optimization for Treatment of Prostate and Other Cancers in Intensity-Modulated Proton Therapy
The quality of IMPT treatment plans may be drastically diminished by uncertainties such as proton range and patient setup errors. If these uncertainties are not figured into treatment planning, the dose distribution that the patient receives may not be the same as the planned dose distribution. New treatment plans, which include optimized software/programming,...
Published: 2/13/2025   |   Inventor(s): Jianming Liang, Yu An, Wei Liu
Keywords(s):  
Category(s): Computing & Information Technology, Life Science (All LS Techs), Medical Imaging