HyperFree is a hyperspectral foundation model with the abilities of channel adaptive and fine-tuning free, which is suitable for hyperspectral classification(HC), hyperspectral one-class classification(HOCC), hyperspectral anomaly detection(HAD), hyperspectral target detection(HTD) and hyperspectral change detection(HCD) tasks. With further tuning, HyperFree can also be adapted to spectral unmixing, object tracking and image denosing tasks.
Advanced interpretation of hyperspectral remote sensing images benefits many precise Earth observation tasks. Recently, visual foundation models have promoted the remote sensing interpretation but concentrating on RGB and multispectral images. Due to the varied hyperspectral channels, existing foundation models cannot process new sensor types directly and face image-by-image tuning situation, imposing great pressure on hardware and time resources.
Existing remote sensing foundation models (RSFM) would face image-by-image tuning situation, imposing great pressure on hardware and time resources. In constrasy, HyperFree can process any unseen hyperspectral image directly without tuning in five tasks.
 |
 |
Hyper-Seg is built to generate segmented masks automatically for large-scale promptable training. We finally obtained 41900 high-resolution image pairs with size of 512×512×224.
 |
To process varied channel numbers, we design a learned weight dictionary covering full-spectrum from 0.4~2.5 μm, supporting to build the embedding layer dynamically.
HyperFree can complete anomaly detection and change detection in zero-shot manner.
HyperFree can complete multi-class classification, one-class classification and target detection in promptable manner.
HyperFree achieves comparable accuracy to state-of-the-art models in a tuning-free manner (using just one prompt), and outperforms most models after tuning.
 |
 |
RSIDEA is an academic research group formed by researchers engaged in the research of remote sensing. The academic guidance is Professor Zhang Liangpei, and the person in charge is Professor Zhong Yanfei. "RSIDEA" means "intelligent data extraction, analysis and applications of remote sensing". The main research directions of RSIDEA are: hyperspectral remote sensing information processing, high-resolution remote sensing image understanding and geoscience interpretation of multi-source remote sensing data.
wangxinyu@whu.edu.cn
Associate Professor
zhongyanfei@whu.edu.cn
Professor
jingtaoli@whu.edu.cn
PhD Student
2020302131039@whu.edu.cn
Graduate Student
Graduate Student
PhD
Graduate Student
PhD Student
PhD Student
PhD Student
Graduate Student
Graduate Student