I'm trying to train a two-stage model in an end-to-end way. However, I want to update the differen