Markov Chain Models

These models and simulations have been tagged “Markov Chain”.

Related tagsOlinick

This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
A simple ABM to model voters switching party allegiances in US elections using a Markov chain.
A simple ABM to model voters switching party allegiances in US elections using a Markov chain.
This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Galla age distribution model.  Thanks Mike! Interesting examples, as always.... Andy Long  Next up: an SIR.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Galla age distribution model.

Thanks Mike! Interesting examples, as always....
Andy Long

Next up: an SIR.
This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an example I thought of after reading Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.  Actually it might be be
This is an example I thought of after reading Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

It's an SIR-type model, but one where the equilibrium (ws,wi,wr) is always the same, even as the weights in the transition matrix change.

Actually it might be better to think of this as a poisoning model: the rate of infection is constant, and independent of the existence of an infected population. That's more like disease due to an environmental effect (e.g. lead-poisoning from smelters, or mercury poisoning from the burning of coal). So infected would mean "effected", and "recovered" might be "treated" -- and ultimately released, to be exposed again.

This shows that the equilibrium does not determine the transition probabilities: two different transition matrices can have the same ultimate equilibrium.

There is a constraint on the infection rate that I haven't figured out how to build in:

InfectionRate < Min[1,wi/ws, wr/ws]

I can allow InfectionRate to vary up to 1 if I take
ws < wi
and
ws < wr
However if you violate that, you'll get interesting solutions with negative values of populations. The dynamics are pretty interesting in that case, however! If you want to see them, you'll have to remove the constraints that I put on the parameters in the Recover and LossOfImmunity parameters.

Thanks Mike! Interesting examples, as always....
Andy Long

This is an introductory example from Olinick's book  An Introduction to Mathematical Models in the Social and Life Sciences . ​  Next up: and SIR, and his interesting model of female birth weights.
This is an introductory example from Olinick's book An Introduction to Mathematical Models in the Social and Life Sciences. ​

Next up: and SIR, and his interesting model of female birth weights.
A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.    Transition matrix:            R   D  R    .7   .3  D    .4   .6
A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.

Transition matrix:

       R   D
R    .7   .3
D    .4   .6


A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.    Transition matrix:            R   D  R    .7   .3  D    .4   .6
A simple Markov chain modeling the transfer of power between two parties in the US Senate. Developed using data from FiveThirtyEight.com for the years 1978-2018.

Transition matrix:

       R   D
R    .7   .3
D    .4   .6