阅读背景:

如何在Tensorflow中设置分层学习率?

来源:互联网 

I am wondering if there is a way that I can use different learning rate for different layers like what is in Caffe. I am trying to modify a pre-trained model and use it for other tasks. What I want is to speed up the training for new added layers and keep the trained layers at low learning rate in order to prevent them from being distorted. for example, I have a 5-conv-layer pre-trained model. Now I add a new conv layer and fine tune it. The first 5 layers would have learning rate of 0.00001 and the last one would have 0.001. Any idea how to achieve this?I am wondering if there is a way that I can use




你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: