Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

As a systemic problem, public health cannot be addressed without considering other policy dimensions. Hence, a holistic approach across public policy areas is necessary to incorporate Health-for-All values into decision-making. However, such multisectoral interventions require public budgets that are effectively mapped into public health outcomes and indicators of their wider determinants. This budget-tagging procedure is high-cost, given that it is often done manually by domain experts. In this paper, we propose Categorical Perplexity-based Uncertainty Quantification (CPUQ), a novel, cost-effective Large Language Models (LLMs) framework that can be leveraged by policymakers to build budget-to-indicator and indicator-to-indicator mappings. This model-agnostic method employs categorical-style prompts to generate interpretable Bernoulli and categorical distributions for edges in a Text-attributed Graph, which is associated with the descriptions of the budget items and indicators. The prompting strategy proposed provides a novel way to incorporate models' uncertainty within the final outputs, enhancing accuracy and safety, We find that the budget-to-indicator mapping predicted by the framework aligns effectively with expert annotations, while when prompted to infer indicator-to-indicator networks, CPUQ estimates more nuanced relationships compared to alternative LLMs-based methods. Through our work, we hope to provide valuable insights into the strengths and weaknesses of leveraging LLMs to support public health budget planning, with the aim of promoting the implementation of the Health-for-All agenda across diverse governments and institutions.

More information Original publication

DOI

10.1016/j.artmed.2025.103203

Type

Journal article

Publication Date

2025-10-01T00:00:00+00:00

Volume

168

Addresses

E, u, r, o, -, M, e, d, i, t, e, r, r, a, n, e, a, n, , C, e, n, t, e, r, , o, n, , C, l, i, m, a, t, e, , C, h, a, n, g, e, ,, , I, t, a, l, y, ;, , T, h, e, , A, l, a, n, , T, u, r, i, n, g, , I, n, s, t, i, t, u, t, e, ,, , U, n, i, t, e, d, , K, i, n, g, d, o, m, ., , E, l, e, c, t, r, o, n, i, c, , a, d, d, r, e, s, s, :, , d, a, n, i, e, l, e, ., g, u, a, r, i, s, o, @, c, m, c, c, ., i, t, .

Keywords

Humans, Uncertainty, Public Health, Cost-Benefit Analysis, Budgets