Forecasting for Policy: helping public institutions to understand the future

Information about judgemental forecasting and our forecasting project in the Czech Republic

"Forecasting is an interesting approach to aggregating views on possible future developments that is useful in personal and public decision-making."
Petr Janský Member of the National Economic Council

FORPOL was a joint project between Czech Priorities and Metaculus. It was funded by the Effective Altruism Infrastructure Fund. It aimed to increase our understanding of practical ways on how to improve public policy-making with the use of judgemental forecasting. Based on the results of the tournament we have assembled a team of expert forecasters (called OPT). You can learn about how the team operate below or on its own website (in Czech only).

The main objective of the FORPOL (Forecasting for Policy) project was to provide public institutions with useful predictions on relevant societal topics. We currently operate forecasting tools in the Czech republic, but are interested in establishing international cooperations as well. FORPOL was also an opportunity for (currently only czech speaking) participants to improve their forecasting skills.

We are using judgmental forecasting, a method for obtaining estimates of future scenarios based on probabilistic reasoning and aggregation of a large number of qualified forecasters. Judgmental forecasting is especially useful for predictions on novel issues or where there is insufficient data (e.g., societal impacts of a pandemic, new technologies, etc.). It is also used on highly complex topics such as; geopolitics, crisis response and other social challenges. 

Judgemental forecasting is based on quantitative data but also takes into account qualitative analysis. It thus presents the possibility of assessing the situation on the basis of currently available information. 

A key phenomenon embedded within the judgmental forecasting method is collective intelligence - instead of relying on the judgment of just one expert it estimates the outcome as the result of a group of forecasters aggregated predictions. This way of forecasting minimizes information noise and bias and, at the same time, maximizes the volume of information on which the aggregated forecasts are based. 

Benefits of forecasting tournaments

Compared to other methods of aggregating expert opinions (interviews and panels, questionnaires, Delphi), forecasting tournaments are focused on three aspects:
 

  1. Accuracy: By using numerical or probabilistic predictions instead of vague verbal expressions ("most likely", "very likely", etc.), it is possible to share more accurate information and subsequently evaluate and modify one's own predictions. These probabilities also make it possible to assess the accuracy of predictions and, after a period of time, identify consistently above-average forecasters whose predictions can get more weight in the model overall score based on objective criteria.
  2. Balance: By using an online platform, it is possible to involve more participants with diverse expertise and experience to boost information sharing.
  3. Engagement: The online platform allows forecasters to further comment about the questions they are solving. Participants have strong incentives to get involved in these discussions through rewards which elevate their prediction score. 

The online platform automatically collects all the inputs, which serve as a digital repository of views and resources to improve prediction skills within the forecaster's community. 

What did we learn in FORPOL?

The aim of the FORPOL (Forecasting for policy) tournament was to provide public institutions with useful predictions on important societal topics.

The FORPOL tournament ended on 5 April 2023.

All our findings from the tournament can be accessed in our Write-up document.

Continuation of the project - Expert Forecasting Team (OPT)

We have identified the best forecasters from our tournaments FORPOL, but also the previous one - OPTIONS, and created an expert forecasting team to continue helping Czech public institutions to make better and future-proof decisions on various subjects. 

The team is composed of approximately 35 members with proven track record in predicting across a wide spectrum of topics. Members have wildly differing personalities and professions, which helps to cultivate a culture of intensive and very open multidisciplinary discussions. You can see some of their pseudonyms and professions listed below. 

Gaborone
Economist

Gobabis
Cardiologist

Chicago
Statistician

Penzance
Manager

Montauk
Entrepreneur

We are open to international cooperation - Contact us!

Do you have any questions about FORPOL? 

Jan Kleňha
project manager
jan@ceskepriority.cz

Do you want to cooperate
or ask a question?


forpol@ceskepriority.cz
info@ceskepriority.cz