|
Quamba2: a robust and scalable post-training quantization framework for selective state space models (SSMs)
Quamba2 highlights
Supports W4A8 / W4A16 / W4AX / W8A8 for Mamba1 and Mamba2
Achieves 4x memory reduction and 3x generation speedup
Enables 8B model inference on Orin Nano 8G at 13 tokens/sec
Outperforms W4A8KV4 Llama3-8B in both speed and quality
Background
Deploying state space models (SSMs), which excel at processing long sequences but demand...
Published: 4/9/2025
|
Inventor(s): Diana Marculescu, Hung-Yueh Chiang, Chi-Chih Chang, Natalia Frumkin, Mohamed Abdelfattah, Kai-Chiang Wu
Keywords(s):
Category(s): Software > AI, Computer > AI/ML > Language processing
|
|
Quamba: Post-training quantization for selective state space models
Background
State Space Models (SSMs) are integral to numerous advanced technologies, including natural language processing, robotics, autonomous vehicles, and edge computing systems. As these applications increasingly demand real-time processing and intelligent decision-making on devices with limited computational resources, there is a pressing...
Published: 1/23/2025
|
Inventor(s): Diana Marculescu, Hung-Yueh Chiang, Chi-Chih Chang, Natalia Frumkin, Kai-Chiang Wu
Keywords(s):
Category(s): Computer > AI/ML, Computer > AI/ML > Language processing, Software > AI > Machine learning
|
|
PMU-Embedded Analytics for Online Event Detection and Classification in Power Grids
The energy requirement of the world is increasing exponentially every year. With the power demand sites concentrated in the region with the highest population density, energy production sites must be located remotely. This isolation requires lengthy and complicated grids to be designed and manufactured to transmit power over long distances. Grid failures...
Published: 2/18/2025
|
Inventor(s): Payman Dehghanian, Shiyuan Wang, Li Li
Keywords(s):
Category(s): Technology Classifications > Industrial or Consumer Tech > Energy Infrastructure and Environment
|
|
Twistron Mechanical Energy Harvesters
Mechanical energy harvesters are needed for diverse applications, including self-powered wireless sensors, structural and human health monitoring systems, automotive technologies, and the extraction of energy from ocean waves. Until now, few harvesters have been flexible enough to be used as yarns in textiles, and the performance of such yarns has been...
Published: 6/26/2024
|
Inventor(s): Shi Hyeong Kim, Carter Haines, Na Li, Keon Jung Kim, Tae Jin Mun, Changsoon Choi, Jiangtao Di, Shaoli Fang, Seon Jeong Kim, Ray Baughman
Keywords(s): Automotive, Carbon Nanomaterials, Carbon Nanotubes, Electronics, Energy, Cleantech & Environmental, Engineering & Physical Sciences, Renewable Energy, Sensors & Controls, Textiles, Wireless
Category(s): Nanotechnology
|
|
Intelligent Textiles Prepared from Nanofiber Yarns and Polymer Fiber Actuators
While there has always been a desire for smart textiles, including fabrics which adapt depending on environmental stimuli, it has yet to be effectively accomplished due to the lack of suitable materials. These polymer fiber actuators have enabled the creation of fabrics that can reversibly change properties such as porosity, shape, color and texture....
Published: 4/22/2021
|
Inventor(s): Ray Baughman, Ozer Goktepe, Fatma Goktepe, Na Li, Marcio Lima, Carter Haines, Shaoli Fang
Keywords(s): Engineering & Physical Sciences, Industrial & Manufacturing, Nanotechnology, Polymers, Textiles
Category(s): Materials
|
|
Distributed Feedback Fiber Laser Pumped by Multimode Diode Lasers
Researchers at the University of Arizona College of Optical Sciences and Canada's Carleton University recently succeeded in fabricating high reflectivity (>99%) Fiber Bragg Gratings (FBGs) into phosphate glass fibers using UV light and a phase mask technique. With this new manufacturing technique, fiber lasers can be created as single monolithic...
Published: 4/3/2023
|
Inventor(s): Nasser Peyghambarian, Axel Schülzgen, Li Li, Jacques Albert
Keywords(s):
Category(s): Technology Classifications > Imaging & Optics, Technology Classifications > Imaging & Optics > Lasers & Other Sources
|
|
All-Fiber Multicore Fiber Laser Devices
Researchers at the University of Arizona have developed a compact, power-scalable, alignment-free fiber laser that takes a new approach to stabilizing phase-locked operation of multi-core fiber lasers by completely removing all free space optical components. This high-brightness, all-fiber laser package uses passive optical fiber spliced at both ends...
Published: 4/3/2023
|
Inventor(s): Nasser Peyghambarian, Axel Schülzgen, Li Li
Keywords(s):
Category(s): Technology Classifications > Imaging & Optics, Technology Classifications > Imaging & Optics > Fiber Optics, Technology Classifications > Imaging & Optics > Lasers & Other Sources
|