Markov Chain Models

These models and simulations have been tagged “Markov Chain”.

Related tagsOlinick

Insight diagram
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

Clone of SIR (poisoning would be better) Markov Model
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

Clone of SIR (poisoning would be better) Markov Model
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Galla age distribution model.

Thanks Mike! Interesting examples, as always....
Andy Long

Next up: an SIR.
Galla Example
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

Clone of SIR (poisoning would be better) Markov Model
Insight diagram
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
Clone of Flakes no more!
Insight diagram
A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.

Transition matrix:

       R   D
R    .7   .3
D    .4   .6


Clone of Senate
Insight diagram
A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.

Transition matrix:

       R   D
R    .7   .3
D    .4   .6


Clone of Senate
Insight diagram
A simple ABM to model voters switching party allegiances in US elections using a Markov chain.
Voters Voting