Miguel Molina-Solana

Meta-few-shot learning algorithms, such as Model Agnostic Meta-Learning (MAML) and Almost No Inner Loop (ANIL), enable machines to learn complex tasks quickly with limited data and based on previous experience. By maintaining the inner loop head of the neural network, ANIL leads to simpler computations and reduces the complexity of MAML. Despite its benefits, ANIL suffers from issues like accuracy variance, slow initial learning, and overfitting, hardening its adaptation and generalization. This work proposes ‘Look Ahead ANIL’ (LaANIL), an enhancement to ANIL for better learning. LaANIL reorganizes ANIL’s internal architecture, integrating parallel computing techniques (to process multiple training examples simultaneously across computing units), and incorporating Nesterov momentum (which accelerates convergence by adjusting the learning rate based on past gradient information and extracting informative features for look-ahead gradient computation). These additional features make our model more state-of-the-art capable and better edge-compatible, and thus improving few-short learning by enabling models to quickly adapt to new information and tasks. LaANIL’s effectiveness is validated on established Meta-few-shot learning datasets, including FC100, CIFAR-FS, Mini-ImageNet, CUBirds-200-2011, and Tiered-ImageNet. The proposed model achieved an increased validation accuracy by 7% \textpm 0.7% and a variance reduction by 44% \textpm4% in 2–way 2–shot classification as well as increased validation by 5% \textpm 0.4% and a variance reduction by 18% \textpm2% in 5–way 5–shot classification on the FC100 dataset and similarly performed well on other datasets.

@article{Tammisetti2024,
  author = {Tammisetti, Vasu and Bierzynski, Kay and Stettinger, Georg and Morales-Santos, Diego~P. and Pegalajar-Cuellar, Manuel and Molina-Solana, Miguel},
  title = {LaANIL: ANIL with Look-Ahead Meta-Optimization and Data-Parallelism},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {8},
  articleno = {1585},
  doi = {10.3390/electronics13081585},
  comment = {},
  timestamp = {36}
}