An important question in task transfer learning is to determine task transferability, i.e. assuming a common input domain, estimating to what extent knowledge from a source task can help in learning a target task. Typically, transferability is either measured experimentally or inferred through task relatedness, which is often defined without a clear operational meaning. In this paper, we present a novel metric, H-score, an easily-computable evaluation function that estimates the performance of transferred features form one task to another in classification problems. Inspired by a principled information theoretic approach, H-score has a direct connection to the asymptotic error probability of the decision function based on the transferred feature. This formulation of transferability can further be used to select a suitable set of source tasks in task transfer learning problems or devising efficient transfer learning policies. Experiments using both synthetic and real image data shows that not only our formulation of transferability is meaningful in practice, but also it can generalize to inference problems beyond classification, such as recognition tasks for 3D indoor-scene understanding.

Last edited on November 2^nd 2024 10:12AM (Time Zone: EDT).
Powered by jemdoc + new design.