---
# System prepended metadata

title: '[Model Inversion Attack by Integration of Deep Generative Models: Privacy-Sensitive Face Generation From a Face Recognition System](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9672188)'

---

# [Model Inversion Attack by Integration of Deep Generative Models: Privacy-Sensitive Face Generation From a Face Recognition System](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9672188)
The authors propose an MIA method integrated with pre-trained deep generative method and utilisesearch domain conecpts for efficient narrowing of search space to face features instead of general image space.This is done in a semi-white box scenario.



### Conventional MIA Problems : 
![](https://i.imgur.com/Jl3mlnO.png)
![](https://i.imgur.com/l23s7Bj.png)

- In convential MIA the image generaed turns out too noisy as the search space is entirety of image space where face features occupy only a small part.

### Deep MIA : 
![](https://i.imgur.com/eSJflL7.png)
- In Deep MIA a pretrained generative model is used which is trained on faces and then is integrated with the conventional MIA.
- This restricts the search space to the face feature vectors.

 **Generative Models :**
 
- Two different generative models have been studied in the paper DCGAN and α-GAN.
- DCGAN has certain drawbacks which are mode-collapse, low diversity of outputs and no image to feature mapping.
- α-GAN on the other had is a fusion of VAE and GAN and can tackle these problems and hence is preferred.

**Seed Vector :**

- The seed vector for pretraining is important and can be set in two methods: random and face based.
- In face based method average of few images from attackers database are taken and converted to seed vector.
- This performs better as random vector sometimes may generate non-face-like images.



### Experiments:
- The datasets used are VGGFace2,CelebA and PubFig.
![](https://i.imgur.com/adysN3z.png)
- VGGFace2 is used to train target system and PubFig is used for evaluation system.
- Gray-scale images are used in this method for faster training, the procedure for RGB image is the same.
- The metrics used for objective evaluation are top-r accuracy and CCDF( Complementary Cumulative Distribution Function ).
- For subjective evaluation 3 parameters were chosen: Naturalness,Similarity and Recognizability.
- The α-GAN with Face seed vector showed the best performance across all metrics.
