Christopher Bishop has an excellent set (1, 2, and 3) of introductory lectures on "Probabilistic Graphical Models". They are well-motivated and cover topics that include:
- directed and undirected graphs
- conditional independence
- factor graphs
- inference using factor graphs and sum/product rules
