Regret_submission
I submitted my first paper as PhD student at CMU! We derived a new regret metric that automatically identifies prediction errors that induced system-level failures during deployment. Finetuning with only this high-regret data leads to large system-level performance improvements despite only using a small fraction of the total deployment data.