Transfer Learning

2016-12-25  本文已影响0人  小小小学渣

Introduction

1.Source and Target, Source Domain and Target Domain.
2.Model and Data Distribution.
3.Categories of Transfer Learning.
4.Finance Data


Transfer Learning in Deep Learning Era

1.Main Architecture


2.Independent Feature at Low Layers and Dependent Feature at High Layers
How transferable are features in deep neural networks?
Test the general and specific features in a CNN networkTest the general and specific features in a CNN network
Result of the testResult of the test
3.A CNN example
Deep Model Based Transfer and Multi-Task Learning forBiological Image AnalysisDeep Model Based Transfer and Multi-Task Learning forBiological Image Analysis
4.Specific Adaption
(1).user vector -> stock vector
User VectorUser Vector
(2).partly update the DNN model (input layer, activations of hidden layer, or the output layer)
(3).speaker-dependent layer.
5.Model Transfer
A weak model can be used to teach a stronger model.
Soft target vs Hard target.

Besides

Taylor, Matthew E., and Peter Stone. "Transfer learning for reinforcement learning domains: A survey." Journal of Machine Learning Research 10.Jul (2009): 1633-1685.

上一篇下一篇

猜你喜欢

热点阅读