Discriminative Frontal Face Synthesis by Using Attention and Metric Learning


ÇEVİKALP H., Turgut K., Topal C.

Journal of Signal Processing Systems, 2025 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2025
  • Doi Numarası: 10.1007/s11265-025-01942-1
  • Dergi Adı: Journal of Signal Processing Systems
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Aerospace Database, Aquatic Science & Fisheries Abstracts (ASFA), Communication Abstracts, Compendex, Metadex, Civil Engineering Abstracts
  • Anahtar Kelimeler: Attention module, Deep learning, Face recognition, Frontal face synthesis, Image sets
  • Eskişehir Osmangazi Üniversitesi Adresli: Evet

Özet

This paper introduces a novel approach for obtaining distinctive frontal facial representations from collections of multiple facial images. The primary objective is to ensure that the profound features extracted through a deep Convolutional Neural Network (CNN) from these learned facial representations exhibit notable separability within the feature space. The acquisition of frontal facial representations capable of effectively representing entire sets of images holds significant value as it considerably reduces the number of image samples requiring processing. This acceleration proves especially advantageous during the classification testing phase. The proposed method combines three fundamental components: attention mechanisms, adversarial methodologies, and metric learning strategies. We adopt a U-Net architecture enhanced by attention modules for the facial aggregation network that generates frontal faces that approximate multiple face images within image sets. Furthermore, we employ both a discriminator network and a pre-trained facial classification network to successfully achieve the goals of adversarial and metric learning. The experimental studies on different face recognition datasets demonstrate that using only attention mechanisms and metric learning strategy is sufficient to synthesize discriminative frontal face images yielding high classification accuracies.