???ENUM_LANGUAGE_JA???
 
???mainMenu_lnkPrivacyPolicy??? ???mainMenu_lnkPolicy???

???ViewItemPage???

???ViewItemFull_lblItemActions??????List_lblExportOptions???
 
 
???export_btDownload??????export_btEMail???
 ???ViewItemFull_lblSubHeaderLocalTags??????ViewItemFull_btnItemVersions??????ViewItemFull_btnItemView??????ViewItemOverview_lblLinkOverviewPage???
  Explaining Metastable Cooperation in Independent Multi-Agent Boltzmann Q-Learning—A Deterministic Approximation

Goll, D., Barfuss, W., Heitzig, J. (2026): Explaining Metastable Cooperation in Independent Multi-Agent Boltzmann Q-Learning—A Deterministic Approximation. - Applied Sciences, 16, 7, 3524.
https://doi.org/10.3390/app16073524

Item is

 

???ViewItemFull_lblShowGroup??? ???ViewItemFull_lblAll??? ???ViewItemFull_lblHideGroup??? ???ViewItemFull_lblAll???

???ViewItemFull_lblBasic???

???ViewItemFull_lblShowGroup??? ???ViewItemFull_lblHideGroup???
???ViewItemFull_lblCiteItemAs???: https://publications.pik-potsdam.de/pubman/item/item_34231 ???ViewItemFull_lblCiteItemVersionAs???: https://publications.pik-potsdam.de/pubman/item/item_34231_1
???ViewItemFull_lblGenre???: ???ENUM_GENRE_ARTICLE???

???ViewItemMedium_lblSubHeaderFile???

???ViewItemFull_lblShowGroup??? ???ViewItemMedium_lblSubHeaderFile???
???ViewItemFull_lblHideGroup??? ???ViewItemMedium_lblSubHeaderFile???
:
Explaining_Metastable_Cooperation_in_Independent_Multi_Agent_Boltzmann_Q_Learning___A_Deterministic_Approximation.pdf (???ENUM_CONTENTCATEGORY_publisher-version???), 10???ViewItemMedium_lblFileSizeMB???
???ViewItemFull_lblViewFulltext???   ???save???
???ViewItemFull_lblCiteFileAs???:
https://publications.pik-potsdam.de/pubman/item/item_34231_1/component/file_34232/Explaining_Metastable_Cooperation_in_Independent_Multi_Agent_Boltzmann_Q_Learning___A_Deterministic_Approximation.pdf
???ViewItemMedium_lblFileName???:
Explaining_Metastable_Cooperation_in_Independent_Multi_Agent_Boltzmann_Q_Learning___A_Deterministic_Approximation.pdf
???ViewItemMedium_lblFileDescription???:
???lbl_noEntry???
???ViewItemMedium_lblFileOaSatus???:
???ENUM_OA_STATUS_GOLD???
???ViewItemMedium_lblFileVisibility???:
???ENUM_VISIBILITY_PUBLIC???
???ViewItemFull_lblFileMimeTypeSize???:
application/pdf / [MD5]
???ViewItemFull_lblTechnicalMetadata???:
???ViewItemFull_lblViewFulltext???
???ViewItem_lblCopyrightDate???:
???lbl_noEntry???
???ViewItem_lblCopyrightInfo???:
???lbl_noEntry???
???ViewItemFull_lblFileLicense???:
https://creativecommons.org/licenses/by/4.0/

???ViewItemFull_lblSubHeaderLocators???

???ViewItemFull_lblShowGroup???

???ViewItemFull_lblCreators???

???ViewItemFull_lblShowGroup???
???ViewItemFull_lblHideGroup???
 ???ViewItemFull_lblCreators???:
Goll, David1, ???ENUM_CREATORROLE_AUTHOR???
Barfuss, Wolfram1, ???ENUM_CREATORROLE_AUTHOR???
Heitzig, Jobst2, ???ENUM_CREATORROLE_AUTHOR???                 
???ViewItemFull_lblAffiliations???:
1External Organizations, ou_persistent22              
2Potsdam Institute for Climate Impact Research, ou_persistent13              

???EditItem_lblContent???

???ViewItemFull_lblShowGroup???
???ViewItemFull_lblHideGroup???
???ViewItemFull_lblSubject???: ???lbl_noEntry???
 ???ViewItemFull_lblAbstract???: Multi-agent reinforcement learning involves interacting agents whose learning processes are coupled through a shared environment. This work introduces a discrete-time approximation model for multi-agent Boltzmann Q-learning that accounts for agents’ update frequencies. We demonstrate why previous models do not accurately represent the actual stochastic learning dynamics while our model can reproduce several complex emergent dynamic regimes, including transient cooperation and metastable states in social dilemmas like the Prisoner’s Dilemma. We show that increasing the discount factor can prevent convergence by inducing oscillations through a supercritical Neimark–Sacker bifurcation, which transforms the unique stable fixed point into a stable limit cycle. This analysis provides a deeper understanding of the complexities of multi-agent learning dynamics and the conditions under which convergence may not be achieved.

???ViewItemFull_lblSubHeaderDetails???

???ViewItemFull_lblShowGroup???
???ViewItemFull_lblHideGroup???
???ViewItemFull_lblLanguages???: eng - English
 ???ViewItemFull_lblDates???: 2026-03-312026-04-032026-04-03
 ???ViewItemFull_lblPublicationStatus???: ???ViewItem_lblPublicationState_published-in-print???
 ???ViewItemFull_lblPages???: 20
 ???ViewItemFull_lblPublishingInfo???: ???lbl_noEntry???
 ???ViewItemFull_lblTOC???: ???lbl_noEntry???
 ???ViewItemFull_lblRevisionMethod???: ???ENUM_REVIEWMETHOD_PEER???
 ???ViewItemFull_lblIdentifiers???: ???ENUM_IDENTIFIERTYPE_DOI???: 10.3390/app16073524
???ENUM_IDENTIFIERTYPE_MDB_ID???: No data to archive
???ENUM_IDENTIFIERTYPE_PIKDOMAIN???: RD4 - Complexity Science
???ENUM_IDENTIFIERTYPE_ORGANISATIONALK???: RD4 - Complexity Science
???ENUM_IDENTIFIERTYPE_WORKINGGROUP???: Behavioural Game Theory and Interacting Agents
???ENUM_IDENTIFIERTYPE_RESEARCHTK???: Nonlinear Dynamics
???ENUM_IDENTIFIERTYPE_REGIONALK???: Global
???ENUM_IDENTIFIERTYPE_MODELMETHOD???: Machine Learning
???ENUM_IDENTIFIERTYPE_OATYPE???: Gold Open Access
 ???ViewItemFull_lblDegreeType???: ???lbl_noEntry???

???ViewItemFull_lblSubHeaderEvent???

???ViewItemFull_lblShowGroup???

???ViewItemFull_lblSubHeaderLegalCase???

???ViewItemFull_lblShowGroup???

???g_project_info???

???ViewItemFull_lblShowGroup???

???ViewItemFull_lblSubHeaderSource??? 1

???ViewItemFull_lblShowGroup???
???ViewItemFull_lblHideGroup???
???ViewItemFull_lblSourceTitle???: Applied Sciences
???ViewItemFull_lblSourceGenre???: ???ENUM_GENRE_JOURNAL???, SCI, Scopus, oa
 ???ViewItemFull_lblSourceCreators???:
???ViewItemFull_lblSourceAffiliations???:
???ViewItemFull_lblSourcePubInfo???: ???lbl_noEntry???
???ViewItemFull_lblPages???: ???lbl_noEntry??? ???ViewItemFull_lblSourceVolumeIssue???: 16 (7) ???ViewItemFull_lblSourceSequenceNo???: 3524 ???ViewItemFull_lblSourceStartEndPage???: ???lbl_noEntry??? ???ViewItemFull_lblSourceIdentifier???: ???ENUM_IDENTIFIERTYPE_CONE???: https://publications.pik-potsdam.de/cone/journals/resource/applied-sciences
???ENUM_IDENTIFIERTYPE_PUBLISHER???: MDPI