Researchers unveil a “Knowledge Consolidation” mechanism that combats AI’s catastrophic forgetting by using an Exponential Moving Average to transfer learning from a student to a stable teacher model. This breakthrough allows AI systems to continuously acquire new skills while preserving foundational knowledge, fostering truly adaptable intelligence.
Optimized by Seraphinite Accelerator