SlideShare a Scribd company logo
Basic Probability
and Statistic
Editor: Nguyen Duc Minh Khoi
Email: ducminhkhoi@gmail.com
Website: https://nguyenducminhkhoi.blogspot.com
Probability: The basics
Probability: The basics (cont.)
• Conditional Probability
• Independence
Probability: The basics (cont.)
• Rule of total Probability:
• Bayes Rule:
• Chain rule
      ii
BAPBPAp |
 
)(
)|()(
|
yP
xyPxP
yxP 
Probability: Random Variable (rv)
– PMF vs. PDF
• Discrete RV
• Continuous RV
Probability: Random Variable (rv)
- Cumulative Density Functions (CDF)
Probability: Expectations
Probability: Expectations (cont.)
• Conditional expectation
Probability: Expectations (cont.)
• Other important Values
• Example:
Probability: Important discrete rv
Probability: Important continuous rv
Probability: Multiple variables
Probability: Multiple variables
(Covariance & Correlation)
Law of large number & Central
Limit Theorem
Statistics
• Give data, how to find the model (pattern) of this
data.
• 2 school of thoughts:
• 𝜃in Bayesian is a rv (have prior p(𝜃));
𝜃 in Classical is unknown constant.
Classical Inference:
Maximum Likelihood Estimator (MLE)
Step: 1. Log; 2. derive; 3. solve for 𝜃
Classical Inference: Other methods
• Linear Regression
Bayesian Inference:
Bayesian Inference (cont.)
References
• http://www.stanford.edu/class/cme308/OldWebsit
e/notes/chap2.pdf
• http://ocw.mit.edu/courses/electrical-engineering-
and-computer-science/6-041sc-probabilistic-
systems-analysis-and-applied-probability-fall-
2013/resource-index/
• Bertsekas, Dimitri P. Introduction to Probability:
Dimitri P. Bertsekas and John N. Tsitsiklis.
Athena scientific, 2002.
Ad

More Related Content

More from University of Technology (19)

Phương pháp học đại học
Phương pháp học đại họcPhương pháp học đại học
Phương pháp học đại học
University of Technology
 
Training Google Drive and Hangouts.pptx
Training Google Drive and Hangouts.pptxTraining Google Drive and Hangouts.pptx
Training Google Drive and Hangouts.pptx
University of Technology
 
Introduction to gsa vietnam
Introduction to gsa vietnamIntroduction to gsa vietnam
Introduction to gsa vietnam
University of Technology
 
Ubuntu – Linux Useful Commands
Ubuntu – Linux Useful CommandsUbuntu – Linux Useful Commands
Ubuntu – Linux Useful Commands
University of Technology
 
Phuong phap hoc tap on thi 2013
Phuong phap hoc tap on thi 2013Phuong phap hoc tap on thi 2013
Phuong phap hoc tap on thi 2013
University of Technology
 
Training basic latex
Training basic latexTraining basic latex
Training basic latex
University of Technology
 
Wordnet Introduction
Wordnet IntroductionWordnet Introduction
Wordnet Introduction
University of Technology
 
Training python (new Updated)
Training python (new Updated)Training python (new Updated)
Training python (new Updated)
University of Technology
 
Introduction to WEB HTML, CSS
Introduction to WEB HTML, CSSIntroduction to WEB HTML, CSS
Introduction to WEB HTML, CSS
University of Technology
 
Python/Django Training
Python/Django TrainingPython/Django Training
Python/Django Training
University of Technology
 
Training android
Training androidTraining android
Training android
University of Technology
 
Design patterns tutorials
Design patterns tutorialsDesign patterns tutorials
Design patterns tutorials
University of Technology
 
Training javascript 2012 hcmut
Training javascript 2012 hcmutTraining javascript 2012 hcmut
Training javascript 2012 hcmut
University of Technology
 
Phương pháp học tập official
Phương pháp học tập officialPhương pháp học tập official
Phương pháp học tập official
University of Technology
 
English Writing Skills
English Writing SkillsEnglish Writing Skills
English Writing Skills
University of Technology
 
Django - basics
Django - basicsDjango - basics
Django - basics
University of Technology
 
Python - the basics
Python - the basicsPython - the basics
Python - the basics
University of Technology
 

Basic probability & statistics