AI
Research
Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions
-
Frank
- November 28, 2021
- AI
- artificial intelligence
- Arxiv
- backpropagation through algorithms
- Deep Learning
- deep learning discrete
- discrete backpropagation
- discrete deep learning
- explained
- gradient discrete
- gradient of an algorithm
- imle
- implicit mle
- Machine Learning
- maximum likelihood
- Neural Networks
- Paper
Backpropagation is the workhorse of deep learning, but unfortunately, it only works for continuous functions that are amenable to the chain rule of differentiation. Since discrete algorithms have no continuous derivative, deep networks with such algorithms as part of them cannot be effectively trained using backpropagation. This paper presents a method to incorporate a large […]
Read More