Catastrophic forgetting is when neural networks perform worse on certain tasks following fine-tuning. This can be mitigated by passing some of the original training objective through the network during fine-tuning.
Catastrophic forgetting is when neural networks perform worse on certain tasks following fine-tuning. This can be mitigated by passing some of the original training objective through the network during fine-tuning.