FEDS Paper: LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora*
Viviana Luccioli, Rithika Iyengar, Ryan Panley, Flora Haberkorn, Xiaoyu Ge, Leland Crane, Nitish Sinha, and Seung Jung LeeLarge Language Models (LLMs) are highly accurate in classification tasks, however, substantial computational and financial costs hinder their large-scale deployment in dynamic environm