Transfer Learning

Preventing Shortcuts in Adapter Training via Providing the Shortcuts

Adapter modules have emerged as a parameter-efficient method for fine-tuning large pre-trained models to downstream tasks. However, adapter training can suffer from shortcut learning, where the model exploits spurious correlations in the training …