Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representation
QUESTION — How can the sparsity coefficient in convolutional sparse coding be jointly learned and adapted within a neural network for robust visual representation?
The authors propose a training-adaptive convolutional sparse coding (CSC) framework that unfolds optimization using the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA). By treating the sparsity coefficient as a differentiable variable learned alongside network parameters through an information bottleneck perspective, the system dynamically balances information retention and compression. Additionally, a label-free post-training strategy adjusts compression strength for corrupted inputs while keeping core parameters fixed. Experiments on CIFAR and ImageNet demonstrate competitive clean-data recognition and greatly improved robustness under input perturbations.
Q-M-E · 17 Sept 2026
read the original ↗