---
# System prepended metadata

title: Questions for Research Scientist Technical Interview

---

# Questions for Research Scientist Technical Interview

## Questions from my work (specific to myself)

1. What is the LDA algorithm, in different levels.  
2. Variational Inference, Gibbs Sampling. 
3. Singular Value Decomposition, the math and the proofs.  [DONE]

## Questions from Deep Learning 

 

1. How is RNN helped by LSTMs 
2. What is the improvement of transformers over the whole RNN/LSTM structure 
3. Describe the inner workings of a transformer network  
4. What is multi-headed attention  
5. How does dropout work in training and inference time  
6. What are the different types of optimisation techniques, describe one in detail. What is momentum ? What are the problems with ordinary momentum?  
7. Why do gradients vanish ? 
8. General questions on sequence-to-sequence modelling 
9. What is knowledge distillation? 
10. What are the methods of dimensionality reduction? How do we select features from a large feature space? 