with our free apps for iPhone, iPad and Android

Get Started

Already have an account?

Log In

NLPA Math Review
by Thomas Breuel
# NLPA Math Review

## information theory

### entropy

### joint entropy

### conditional entropy

### mutual information

### noisy channel model

### channel capacity

### relative entropy, Kullback-Leibler divergence

### cross entropy

### perplexity

### entroy of English

## statistics

### basics

### standard distributions

### Bayesian methods

0.0 stars - 0 reviews
range from 0 to 5

probabilities

conditional probabilities

independence, conditional independence

random variables

expectation and variance

joint distributions

conditional distributions

binomial distribution

multinomial distribution

normal distribution

central limit theorem

Bayes theorem

Bayesian parameter estimation

Bayesian updating

Bayesian decision theory