An Information-Theoretic Metric of Transferability for Task Transfer Learning

Task transfer network

An important question in task transfer learning is to determine task transferability, i.e. assuming a common input domain, estimating to what extent knowledge from a source task can help in learning a target task. Typically, transferability is either measured experimentally or inferred through task relatedness, which is often defined without a clear operational meaning. In this paper, we present a novel metric, H-score, an easily-computable evaluation function that estimates the performance of transferred features form one task to another in classification problems. Inspired by a principled information theoretic approach, H-score has a direct connection to the asymptotic error probability of the decision function based on the transferred feature. This formulation of transferability can further be used to select a suitable set of source tasks in task transfer learning problems or devising efficient transfer learning policies. Experiments using both synthetic and real image data shows that not only our formulation of transferability is meaningful in practice, but also it can generalize to inference problems beyond classification, such as recognition tasks for 3D indoor-scene understanding.


Yajie Bao, Yang Li, Shao-Lun Huang, Lin Zhang, Lizhong Zheng, Amir Zamir and Leonidas Guibas, An Information-Theoretic Metric of Transferability for Task Transfer Learning, 26th IEEE International Conference on Image Processing (ICIP), 2019 pdf ppt
  • Supplementary materials : pdf

author={Y. {Bao} and Y. {Li} and S. {Huang} and L. {Zhang} and L. {Zheng} and A. {Zamir} and L. {Guibas}},
booktitle={2019 IEEE International Conference on Image Processing (ICIP)},
title={An Information-Theoretic Approach to Transferability in Task Transfer Learning},

Data & Code

Project list