Variational Inference: Foundations and Modern Methods (NIPS 2016 Tutorial)

The probabilistic pipeline:

• Ask a question, make assumptions based on our knowledge to get the model.
• Mix the model and data to discover patterns.
• Explore and make predictions.

The key algorithmic problem is inference (what does this model say about this data?).