A paper is presented at ICASSP 2023: Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation.