Probability theory: Multivariate random variable, dependent and independent systems of random variables

This is part of the course “Probability Theory and Statistics for Programmers”.

Probability Theory For Programmers

In the article about distribution function, we came to the conclusion that it is possible to find the distribution functions of random variables of a vector by having the distribution function of the system.

the distribution function of random variable

Also, we can find probability density of random variable by knowing probability density of the vector.

probability density of the random variable

By using this formulas we can find distribution function or probability density function of a single random variable. But is it possible by knowing distribution functions of separately taken random variables form distribution function of a system? It turns out that in general case this can’t be done. In order to describe a system of random variables we also need to know relationships between variables. We can describe such relationships by using conditional probability distribution.

A conditional probability distribution of random variable X of a system (X,Y) is such distribution, where other random variable Y took specific value y.

conditional probability of random variable

In some cases, the dependence between variables can be so close that by knowing the value of one random variable you can find the value of other. In other cases dependence between variables so week that you can call them independent.

Random variable Y is independent of random variable X if the distribution of random variable Y independent from what value take X.

the random variable is independent

And if Y depends on X:

the random variable is dependent

For independent continuous random variables we can find probability density by multiplying probability densities of separate random variables:

probability density of the system

Next part ->

Reach the next level of focus and productivity with




Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store