LPD: Learnable Prototypes with Diversity Regularization for Weakly Supervised Histopathology Segmentation

Computer Vision & MultiModal AI
Published: arXiv: 2512.05922v1
Authors

Khang Le Anh Mai Vu Thi Kim Trang Vo Ha Thach Ngoc Bui Lam Quang Thanh-Huy Nguyen Minh H. N. Le Zhu Han Chandra Mohan Hien Van Nguyen

Abstract

Weakly supervised semantic segmentation (WSSS) in histopathology reduces pixel-level labeling by learning from image-level labels, but it is hindered by inter-class homogeneity, intra-class heterogeneity, and CAM-induced region shrinkage (global pooling-based class activation maps whose activations highlight only the most distinctive areas and miss nearby class regions). Recent works address these challenges by constructing a clustering prototype bank and then refining masks in a separate stage; however, such two-stage pipelines are costly, sensitive to hyperparameters, and decouple prototype discovery from segmentation learning, limiting their effectiveness and efficiency. We propose a cluster-free, one-stage learnable-prototype framework with diversity regularization to enhance morphological intra-class heterogeneity coverage. Our approach achieves state-of-the-art (SOTA) performance on BCSS-WSSS, outperforming prior methods in mIoU and mDice. Qualitative segmentation maps show sharper boundaries and fewer mislabels, and activation heatmaps further reveal that, compared with clustering-based prototypes, our learnable prototypes cover more diverse and complementary regions within each class, providing consistent qualitative evidence for their effectiveness.

Paper Summary

Problem
Histopathology images are crucial for cancer diagnosis, but annotating them with pixel-level labels is time-consuming and expensive. Weakly supervised semantic segmentation (WSSS) aims to reduce the need for such annotations by using image-level labels. However, current WSSS methods suffer from several challenges, including: - Inter-class homogeneity: different classes can appear similar - Intra-class heterogeneity: a single class can have different patterns - CAM-induced region shrinkage: class activation maps often highlight only the most distinctive areas, missing broader spatial extents These challenges make it difficult to accurately segment histopathology images.
Key Innovation
The authors propose a novel, cluster-free, one-stage learnable-prototype framework for WSSS, called LPD (Learnable Prototypes with Diversity Regularization). LPD enhances morphological intra-class heterogeneity coverage by: - Designing a learnable prototype module with a diversity loss that encourages prototypes to attend to distinct tissue patterns - Introducing a Prototype Diversity Regularizer (PDR) that discourages redundancy among intra-class prototypes LPD achieves state-of-the-art performance on BCSS-WSSS, outperforming prior methods in terms of mIoU and mDice.
Practical Impact
LPD has several practical implications: - Reduced annotation burden: LPD can be trained with image-level labels, reducing the need for pixel-level annotations - Improved accuracy: LPD's diversity-aware prototypes can better capture intra-class heterogeneity and inter-class homogeneity - Efficient optimization: LPD's one-stage framework eliminates multi-stage training, making it more efficient These benefits can lead to faster and more accurate cancer diagnosis, as well as reduced costs associated with annotating histopathology images.
Analogy / Intuitive Explanation
Imagine a histopathology image as a complex puzzle with many different pieces (tissue patterns). Current WSSS methods try to find a few representative pieces (prototypes) that can be used to reconstruct the entire image. However, these methods often focus on the most distinctive pieces, missing the broader spatial extent of the class. LPD's diversity-aware prototypes are like a set of specialized tools that can capture a wide range of tissue patterns, allowing for more accurate and comprehensive image segmentation.
Paper Information
Categories:
cs.CV
Published Date:

arXiv ID:

2512.05922v1

Quick Actions