↓ Skip to main content
What is this page? Embed badge

Handbook of Markov Decision Processes

Overview of attention for book
Cover of 'Handbook of Markov Decision Processes'

Table of Contents

  1. Altmetric Badge
    Book Overview
  2. Altmetric Badge
    Chapter 1 Introduction
  3. Altmetric Badge
    Chapter 2 Finite State and Action MDPS
  4. Altmetric Badge
    Chapter 3 Bias Optimality
  5. Altmetric Badge
    Chapter 4 Singular Perturbations of Markov Chains and Decision Processes
  6. Altmetric Badge
    Chapter 5 Average Reward Optimization Theory for Denumerable State Spaces
  7. Altmetric Badge
    Chapter 6 Total Reward Criteria
  8. Altmetric Badge
    Chapter 7 Mixed Criteria
  9. Altmetric Badge
    Chapter 8 Blackwell Optimality
  10. Altmetric Badge
    Chapter 9 The Poisson Equation for Countable Markov Chains: Probabilistic Methods and Interpretations
  11. Altmetric Badge
    Chapter 10 Stability, Performance Evaluation, and Optimization
  12. Altmetric Badge
    Chapter 11 Convex Analytic Methods in Markov Decision Processes
  13. Altmetric Badge
    Chapter 12 The Linear Programming Approach
  14. Altmetric Badge
    Chapter 13 Invariant Gambling Problems and Markov Decision Processes
  15. Altmetric Badge
    Chapter 14 Neuro-Dynamic Programming: Overview and Recent Trends
  16. Altmetric Badge
    Chapter 15 Markov Decision Processes in Finance and Dynamic Options
  17. Altmetric Badge
    Chapter 16 Applications of Markov Decision Processes in Communication Networks
  18. Altmetric Badge
    Chapter 17 Water Reservoir Applications of Markov Decision Processes
Attention for Chapter 9: The Poisson Equation for Countable Markov Chains: Probabilistic Methods and Interpretations
Altmetric Badge

Citations

dimensions_citation
227 Dimensions

Readers on

mendeley
4 Mendeley
Summary Dimensions citations
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Chapter title
The Poisson Equation for Countable Markov Chains: Probabilistic Methods and Interpretations
Chapter number 9
Book title
Handbook of Markov Decision Processes
Published by
Springer, Boston, MA, January 2002
DOI 10.1007/978-1-4615-0805-2_9
Book ISBNs
978-1-4613-5248-8, 978-1-4615-0805-2
Authors

Armand M. Makowski, Adam Shwartz, Makowski, Armand M., Shwartz, Adam

View on publisher site
Mendeley readers

Mendeley readers

The data shown below were compiled from readership statistics for 4 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
Unknown 4 100%

Demographic breakdown

Readers by professional status Count As %
Professor 1 25%
Student > Ph. D. Student 1 25%
Researcher 1 25%
Student > Master 1 25%
Readers by discipline Count As %
Mathematics 2 50%
Computer Science 1 25%
Agricultural and Biological Sciences 1 25%

This page is provided by Altmetric.