User Selection and Engagement for Climate Services Coproduction

E. Baulenas aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by E. Baulenas in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0001-9934-1531
,
D. Bojovic aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by D. Bojovic in
Current site
Google Scholar
PubMed
Close
,
D. Urquiza aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by D. Urquiza in
Current site
Google Scholar
PubMed
Close
,
M. Terrado aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by M. Terrado in
Current site
Google Scholar
PubMed
Close
,
S. Pickard aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by S. Pickard in
Current site
Google Scholar
PubMed
Close
,
N. González aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain

Search for other papers by N. González in
Current site
Google Scholar
PubMed
Close
, and
A. L. St. Clair aBarcelona Supercomputing Centre, Centro Nacional de Supercomputación, Barcelona, Spain
bResearch and Development Department, DNV Group. Oslo, Norway

Search for other papers by A. L. St. Clair in
Current site
Google Scholar
PubMed
Close
Open access

Abstract

Climate services are high on the international agenda for their potential to help combat the effects of climate change. However, climate science is rarely directly incorporated into the decision-making processes of societal actors, due to what has been identified as the usability gap. This gap is partially due to a failure to timely and meaningfully engage users in the production of climate services, as well as misperceptions as to which users can best benefit from climate service uptake. In this article, we propose user selection and engagement guidelines that integrate important values from participatory science such as those of legitimacy, representativity, and agency. The guidelines consist of 5 + 1 steps: defining why, where, whom, which attributes, and which intensity and how to select and engage with stakeholders. While these steps may be initially implemented by an ideally interdisciplinary team of scientists and service designers, the final step consists of an iterative process by which each decision is agreed on together with the identified users and stakeholders under a coproduction approach. We believe this systematic user selection and engagement practice is key to support the design of climate services aligned to the actual needs of a wide and inclusive range of empowered societal agents.

Significance Statement

A review of the climate science and services literature and related research projects reveals that, despite the insistence to include users in all stages of the research process, users are often involved only sporadically and inconsistently and when there is little room to change the climate service suitable for decision-making. Here, we argue that a reason for this is the lack of user selection and engagement guidelines. Failure to implement a research design strategy for these decisions can lead to a lack of usability and applicability of the produced climate-related services, as well as hampering their long-term uptake. These guidelines can thus support the development of usable, coproduced, actionable climate science.

© 2023 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Publisher’s Note: This article was revised on 19 June 2023 to add a second affiliation for coauthor St. Clair that was omitted when originally published.

Corresponding author: Eulalia Baulenas, eulalia.baulenas@bsc.es

Abstract

Climate services are high on the international agenda for their potential to help combat the effects of climate change. However, climate science is rarely directly incorporated into the decision-making processes of societal actors, due to what has been identified as the usability gap. This gap is partially due to a failure to timely and meaningfully engage users in the production of climate services, as well as misperceptions as to which users can best benefit from climate service uptake. In this article, we propose user selection and engagement guidelines that integrate important values from participatory science such as those of legitimacy, representativity, and agency. The guidelines consist of 5 + 1 steps: defining why, where, whom, which attributes, and which intensity and how to select and engage with stakeholders. While these steps may be initially implemented by an ideally interdisciplinary team of scientists and service designers, the final step consists of an iterative process by which each decision is agreed on together with the identified users and stakeholders under a coproduction approach. We believe this systematic user selection and engagement practice is key to support the design of climate services aligned to the actual needs of a wide and inclusive range of empowered societal agents.

Significance Statement

A review of the climate science and services literature and related research projects reveals that, despite the insistence to include users in all stages of the research process, users are often involved only sporadically and inconsistently and when there is little room to change the climate service suitable for decision-making. Here, we argue that a reason for this is the lack of user selection and engagement guidelines. Failure to implement a research design strategy for these decisions can lead to a lack of usability and applicability of the produced climate-related services, as well as hampering their long-term uptake. These guidelines can thus support the development of usable, coproduced, actionable climate science.

© 2023 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Publisher’s Note: This article was revised on 19 June 2023 to add a second affiliation for coauthor St. Clair that was omitted when originally published.

Corresponding author: Eulalia Baulenas, eulalia.baulenas@bsc.es

1. Introduction

“It became obvious . . . that neither decision makers nor scientists working alone can specify what science products are needed, how they should be developed, and how they should be applied to climate adaptation” (Beier et al. 2017, p. 289).

Climate services demand is on the rise as a result of increasing awareness of the negative effects of climate change and the need for evidence-based responses (Street et al. 2019). Globally, a wide range of institutions foster the climate services market, from the World Meteorological Organization and its Global Framework for Climate Services (GFCS) launched in 2009 to other initiatives such as the European Union’s Copernicus Climate Change Service (C3S) (Bojovic et al. 2022). The C3S, for instance, aims to build a climate-resilient society by engaging a large number of experts on developing, distributing, and using climate services, ensuring the quality of climate data and eliminating obstacles impeding its usage (Buontempo et al. 2020).

Among the obstacles identified that impede the use of climate data, scholars mention cognitive, social, institutional, and knowledge barriers (Dilling and Lemos 2011; Kalafatis et al. 2015; Raaphorst et al. 2020). As an outcome of these obstacles, scholars have noticed that whereas the quality of climate services has been increasing, its usage by societal actors has not followed suit (Findlater et al. 2021). To address this gap, global scientific networks have suggested a change in paradigm in the way of producing climate- and sustainability-related science. These actors promote the adoption of knowledge coproduction processes to enhance scientific accountability toward society and ensure implementation of the scientific activity, while including different knowledge types in designing climate-related policy and strategies (van der Hel 2016; Owen et al. 2019; McCauley and Heffron 2018; Bremer et al. 2019).

Users are at the center of climate services by definition as, despite the wide range of products they encompass, climate services are identified by the key commonalities of being guided by users’ needs, providing climate information for decision-making processes, and involving dissemination and uptake practices (Bessembinder et al. 2019). Targeting the inclusion of diverse actors at key stages of the coproduction process increases the chances of producing actionable knowledge that will be incorporated into decision-making (Armitage et al. 2009; Beier et al. 2017; Hill et al. 2020). In reality, nonetheless, few examples put this into practice (Vaughan et al. 2018). Most projects adopt rather supply-driven forms of producing services with the risk of not meeting users’ needs (Buontempo and Hewitt 2018; Daniels et al. 2020; Findlater et al. 2021; Hewitt et al. 2020; Lemos and Morehouse 2005; Porter and Dessai 2017).

In this article, we adapt the methodology of stakeholder analysis to the particularities of climate services. Our aim is to build on existing work that maps climate service stakeholders (Barquet et al. 2022) and to propose a methodology for enhanced user selection and engagement that increases the likelihood that climate information is incorporated in decision-making processes and considers the needs from different types of users, because currently there is a lack of guidance, especially on systematically selecting a plurality of users. This is usually exacerbated by climate scientists’ perceptions of users in the “mini me” phenomenon, by which scientists expect users to have the same background despite this rarely being the case (Porter and Dessai 2017).

Knowledge coproduction is a participatory approach to science, and many such approaches depart from a set of principles infusing the range of methods through which they are implemented on the ground. The principles this guide aims to be infused with are those of valuing, equality, authenticity, transparency, agency, representation, deliberation, inclusion, and transdisciplinarity (Reed et al. 2018) [for ethical principles in coproduction and transdisciplinary research, see also Wilmer et al. (2021)]. Inclusive research practices are very important; the better job we make in the selection of users that include a variety of identities, backgrounds, and knowledge, the better foundation we lay down for designing services that are accessible, welcoming, safe, ethical, and inclusive for everyone. These principles have been linked to the steps proposed below, but they should represent the overarching theme in the climate services field throughout. In the next section, we give an overview of the stakeholder analysis literature, followed by the proposed steps for stakeholder and user selection and engagement. In the discussion, we dive into ways to successfully navigate the challenges that can occur during this process.

2. Adapting stakeholder analysis to climate services

Stakeholder analysis matured in the management literature in the 1980s, with the recognition that engaging actors external to an organization was critical to the very survival of the organization [for a review of stakeholder analysis definitions, see Yang (2014)]. From this literature emerged the most often cited definition of stakeholder, understood as “any group or individual who can affect or is affected by the achievement of the organization’s objectives” (Freeman 2010, p. 46). In the 1990s, evidence that the governance of natural resources was increasingly adopting hybrid regulatory, market, and network-led forms of governance raised interest from scholars in tailoring this organizational science to the issues faced in natural resource management. Natural resource management and climate services have some elements in common, such as the complexity of the issue at stake, the general initial disconnection between involved stakeholders, and a context of human–environment interactions (Beier et al. 2017). However, the particularities of climate information and services create the need to narrow down stakeholder analysis methodologies through a human-centered approach as proposed below.

Buontempo et al. (2020, appendix 1) define a climate services stakeholder as “an individual or an organisation who is interested in the project and who has a critical decision which can be informed by climate information.” As it subsequently follows, stakeholder analysis for climate information is the process that (i) identifies individuals, groups, and organizations who can benefit from using a climate service; (ii) prioritizes these individuals and groups for involvement in the climate service coproduction process; and (iii) defines a climate service that can be of support to their decision or action. For instance, in the context of flood risk management in a local area of Germany, Reimann et al. (2021) mapped disaster-impacted societal actors who represented different interests and invited them to codesign a climate service to inform adaptation decisions for coastal flooding. The activities conducted to identify and engage with these stakeholders encompass the process of stakeholder analysis. The extent to which the stakeholder might become a user is part of the steps in the guidelines.

This involvement, especially for climate services, may take a holistic and human-centered approach, as is increasingly being introduced in climate services through service design. Service design involves the practice of engaging with users and creating efficient user experiences, by making the users and stakeholders part of the whole life cycle of the service and products. It uses methods from different disciplines to solve problems by first cocreating better service definitions that begin with understanding human needs and then codesigning solutions to address them. Human-centered design cultivates deep empathy with the people who will be interacting with the service, both end-users and stakeholders, as a requirement of usable climate services (Christel et al. 2018; Terrado et al. 2022).

Next, we present the guidelines on selecting stakeholders, and within the initial selection, engage a group of committed users. As shown in Fig. 1, the guidelines adopt and adapt the principles from participatory scientists, which include (based on Bell and Reed 2021) valuing, equality, authenticity, transparency, agency, representation, and deliberation, to which we add interdisciplinarity and inclusivity (Glavovic et al. 2022; Cologna and Oreskes 2022).

Fig. 1.
Fig. 1.

Stakeholder and user analysis for climate services coproduction processes.

Citation: Weather, Climate, and Society 15, 2; 10.1175/WCAS-D-22-0112.1

3. Results: The guidelines

This section presents the guidelines for the user-oriented analysis, summarized in Fig. 1.

a. Step 1: Why—high-level goal conceptualization

The literature recommends as the first step to focus on the conceptualization of the high-level goal or problem, rather than on the specific climate service or indicator to be developed, which will be done later with users (Beier et al. 2017; Norström et al. 2020; Prell et al. 2009). High-level goals can imply a wider range of aspects as, for instance, noted in Norström et al. (2020):

  • achieving changes in policies and practices,

  • achieving changes in attitudes and perceptions,

  • creating new relationships and networks of collaboration, and

  • increasing the agency of previously marginalized actors, or even impacts,

or also, more concrete for climate services:

  • supporting midterm decision-making processes linked to policy and

  • improving the sectoral applications of predictions and projections.

In practical terms, project discussions usually start among, ideally, an interdisciplinary team of social and physical climate scientists, as well as service designers.

This will allow the project team to continue with the follow-up steps, but we should return to these steps once the stakeholders are engaged (step 6.1), to specify the objectives, confirm the shared understandings, and ensure alignment to the user needs as the second component of goal definition. Issue or action definition should be conceived as a flexible and iterative process, moreover, because the pool of stakeholders might change across the life cycle of a project and ensuring shared understanding among the project network is key for reaching milestones (Norström et al. 2020). For example, a project has the original high-level goal to improve the sectoral application of decadal predictions in agriculture. Upon discussion with the engaged users (step 6.1), information at a decadal time scale can prove less relevant for the service, as the amount of yield is determined by the climate in the months before the harvest. Hence, seasonal predictions are identified by stakeholders as the most appropriate in this case and thus the high-level goal needs to be adjusted. This is also related to step 2.

b. Step 2: Where—defining the case

Climate services depart from applied climate science and are generally related to a specific context including a climate-sensitive sector, scale, and governance system. Relevant to the sector of agriculture, energy, and forest is that climate science generally encompasses boundary-spanning issues that should be viewed in relation to complex, interconnected systems (Cash et al. 2003). The scale and the governance system imply a recognition of the multiple spatial, temporal, jurisdictional, and institutional levels that intervene in human–environment systems (Cash et al. 2006). The recognition of this complexity is the departure point to determine where the users are located. Again, this is an interactive step that will have to be repeated with stakeholders once identified and engaged (step 6.2, below, and in terms of scale, see step 6.3). In this iteration, the case can be further defined; for instance, stakeholders and users can help identify an event that can become the subject of a climate service coproduction process (Terrado et al. 2023).

The European Commission–funded climate science and climate services projects, such as Fully Optimized User Centric Climate Services Value Chain for Southern Africa (FOCUS-Africa), Process-Based Climate Simulation: Advances in High-Resolution Modelling and European Climate Risk Assessments (PRIMAVERA), the European Climate Prediction system (EUCP), and the Mediterranean Grape, Olive and Durum wheat food systems (MED-GOLD) or the prototypes evaluated in the European Provision of Regional Impacts Assessment on Seasonal and Decadal Timescales (EUPORIAS), add a range of case studies to apply developments in science to specific contexts, from the local to the supranational. This practice is recommended because of the very need of applied climate science or climate services to support a decision or action that is likely to be context bounded, independent of the context being as broad as, for instance, the European level [see, e.g., Athanasiou et al. (2020) for an EUCP example]. An alternative is for climate services that are of technical readiness and that have already been developed with a use-case in mind, such as wine producers in the MED-GOLD project.

Gerring (2016), in his seminal book on case study research, discusses several techniques and criteria for choosing a place-based case, depending on the high-level goal (step 1) of the scientific project, which we have adapted for developing climate services (Table 1).

Table 1

Criteria for place-based case selection for climate service coproduction and examples.

Table 1

Stakeholder and network studies have shown that errors at the stage of defining case boundaries can incur in validity issues but equally impact the feasibility of the chosen approach to step 3: stakeholder identification [for more guidance, see Borgatti et al. (2018), chapter 3]. This step, as furthered in the discussion, is crucial if one considers aspects of scalability or replication of the climate service.

c. Step 3: Whom to include—stakeholder and user identification

The vision of the user is of relevance, and initial preconceptions about them should be openly discussed by the group involved in a climate service project. Generally, the literature describes the effect of the “mini me” by which scientists misinterpret the profile of the user, who they see as someone with similar perceptions, background, and decision-making rationales as themselves despite being rarely the case (Porter and Dessai 2017). Participatory methodologies are generally added to scientific processes to address initial (mis)perceptions, challenge assumptions, and facilitate mutual learning between participants, which implies that users have as much to learn from scientists as scientists have to learn from users. As a sign of recognition, some projects differently label the users more intensively engaged in coproduction [see a review on the different notions of coproduction in Bremer and Meisch (2017)]. For instance, there are labels such as superusers [Adaptation-Oriented Seamless Predictions of European Climate (ASPECT)], companion-partner users (EUCP), fellow users (FOCUS-Africa), champion users (PRIMAVERA), or next users (Otto et al. 2016).

Whom to include relies again on the previous steps and can imply only a small handful of stakeholders identified as potential users or a broad circle of over 100 stakeholders, as it depends on the high-level goal and case(s) (see, e.g., Zingraff-Hamed et al. 2020). In the table below, we show the range of possible categories from which the pool of stakeholders/users can be identified. This step again brings considerations about the sector and scale, which partially depend on the decisions taken in the previous steps. Many of these stakeholder categories have a presence at several scales (e.g., an NGO can have headquarters at the European Union level and have local offices), and the scale should meet the scope of influence of the “decision or action” that the climate service is supporting, whether this is at the local, subnational, national, or supranational level (Table 2).

Table 2

Proposition of user categories with typologies to guide user identification. Sources: Raaphorst et al. (2020); Roux et al. (2017); Street et al. (2015); our own.

Table 2

There is no requisite that these categories should all be represented, but they can help in brainstorming because, depending on the high-level goals and selected case(s) (step 1 and 2), the potential pool of stakeholders and users will vary. Here, being mindful of the distinction between levels of aggregation is relevant, that is, treating individuals as such or individuals as representatives of organizations.

There are several methods to identify the first pool of stakeholders, ranging from basic desk research activities to more sophisticated content analysis of policy documents to detect stakeholders or stakeholder networks surrounding a given topic (see, e.g., Kalafatis et al. 2015). After a very initial identification of some stakeholders, among more resource-intensive methods there are focus groups and helicopter interviews, approaching actors with different perspectives on the state of the art (Hajer and Versteeg 2005), with or without integrating the practice of snowball sampling by which the initial contacts nominate other potential stakeholders (Reed et al. 2009). This stage of user identification requires technical skills and demands from scientists to couple them with a capacity for social analysis (Reed et al. 2009; Walker et al. 2008). Finally, project network personal contacts can be included, but it is important that they are subjected to step 4, to be aware of possible conflict of interests or power positions.

d. Step 4: Which attributes—from stakeholders to users

The identified actors will not all need to be involved with the same degree of engagement intensity; hence, this step asks, “Why would we like to count this stakeholder or potential user in the coproduction process?” In terms of attributes, Mitchell et al. (1997) propose to characterize stakeholders based on influence, power, and legitimacy (Jepsen and Eskerod 2009, p. 336) [see Reed et al. (2009, p. 1938) for alternatives]. Adapting this approach to climate services, users can be fit into profiles based on the users’ power and influence to determine the type and characteristics of climate service(s) that will be developed; the urgency with which the climate service is needed; the legitimacy of supporting the decision-making process related to the climate service; the multiplicity of interests and perceptions; and, related, knowledge types (Table 3).

Table 3

Definition of attributes for stakeholder selection and assessment questions.

Table 3

After this step, one can proceed to establish a desired level of involvement.

e. Step 5: With which intensity—defining engagement intensity

Once the reasons why a stakeholder is desirable to be included are checked, the next step is to propose an involvement degree for the coproduction process. The attributes of step 4 can be assessed together in a multiattribute exercise to link them to elements of a coproduction process that range from passive to more active engagement forms.

The multiattribute exercise can be done qualitatively or by adding a quantitative approach [e.g., Likert scales, see for instance Bourne and Walker (2005)]. The criteria can have different weights as illustrated by the following example for the criterion of “knowledge”: depending on the high-level goal and/or the timeline of the project, familiarity with the topic (climate information, climate change, climate services) is considered relevant. Thus, not all types of knowledge may be required for the coproduction process. Moreover, “new” users not familiarized with climate information may need capacity building, which might not be possible in the case of short projects with less time for engagement.

We envisage three degrees of engagement based on the framework for climate services presented in Bojovic et al. (2021): awareness raising (for all stakeholders), involvement (for those stakeholders who have characteristics of potential users), and empowerment (for those stakeholders who may be final users). The framework proposes different methods by engagement degree (Table 4).

Table 4

Example of a multiattribute exercise to determine engagement degree. The ellipses (. . .) in column 5 indicate that it is left to the discretion of the analysts to select which attribute elements from Table 3 they deem relevant for the study.

Table 4

Step 5 includes asking the identified stakeholders about their willingness to engage in the project to the desired degree. This is challenging due to the observed reality of stakeholder burnout (Delzeit et al. 2021).

To be successful on engaging stakeholders, scholars have identified several techniques:

  • Carefully designed and tailored communication strategies are key to engage the user in a way that matters for them, and these can differ depending on the stakeholder/user needs (Bojovic et al. 2021; Christel et al. 2018, p. 201).

  • Targeted email communication including, for instance, using the contact name details (if available); attaching an official letter from, e.g., the funding body project office; and proposing a date for a call for discussing further details can serve as a safe space to define the stakes of climate service from the stakeholder perspective. Effective but more invasive techniques are follow-up calls in the case of receiving a nonresponse to the email.

  • After the stakeholder has agreed to participate, it is important also to confirm the needed degree of confidentiality that the user will require.

  • Identifying influential stakeholders who can become sponsors of the project or climate service, such as, for example, scientists with a high reputation or policy brokers, can be beneficial. These are committed individuals or groups who may act as links between social groups and motivate others to participate (Armitage et al. 2009; Reinecke 2015; Baulenas et al. 2021). Additionally, identifying intermediary agents such as community-based organizations to monitor and ensure a power-balanced and transparent process can be important to avoid marginalization of certain groups (Thinyane et al. 2018).

  • Some scholars propose monetary compensation (Klenk et al. 2015) in acknowledgment that the scientists and service developers are being paid to attend stakeholder-engaged meetings, while stakeholders may be taking time away from their actual jobs or other sources of income.

The benefit of conducting an exhaustive user identification and mapping (step 3) is that, per each profile considered relevant to participate in the process, there can be “backup” stakeholders in case of unwillingness to participate, discontinuing participation in the middle of the project (attrition), or intermittent availability during the process.

f. Step 6: How—iteration: adding the co-component to each step

The final step is the most important and starts once the stakeholders and users have been engaged in the process. This step returns back to steps 1 to 5 and revises them, adding the coproduction component to counter the top-down approach that has guided the previous steps.

Substep 6.1 consists of cospecifying the goals and decision-making process. The high-level goal (step 1) needs to be agreed upon and further elaborated on and specified between scientists and stakeholders. Studies on participative approaches have shown that joint goal definition can impact the success of the project (Reed et al. 2018, section 9). This step also generates problem ownership, which is important to maintain interest of stakeholders during the project (see, e.g., Delzeit et al. 2021). As the climate service definition also implies a decision-making context, at this step it can be codecided which decision can be supported by the climate service and which types of capacity-building processes this might require.

Substep 6.2 consists of codefining the case study, which implies decisions on the specificities of the case study: specific events or locations. For instance, step 2 selected “Barcelona,” substep 6.2 with stakeholders selects “the 2007/08 severe drought in Barcelona” (Martin-Ortega et al. 2011; March et al. 2013). To support this step with a coproduction approach, Terrado et al. (2023) proposed eight best practices for the selection of events with stakeholders in climate services.

The other substeps (6.3, 6.4, and 6.5) consist of covalidating the results of the exercises that the project team have conducted in steps 3, 4, and 5, respectively. For instance, step 3 identified the initial list of stakeholders; the currently engaged stakeholders can help identify other stakeholders that were not originally identified using snowball sampling. Step 4 established attributes for each participant. To some extent, the general attributes of the current network of engaged stakeholders can be shared. This can help raise awareness of the values that have been considered when including several profiles and the rationale behind themselves (the stakeholders) being present in the project, which can also positively contribute to project ownership. Substep 6.5 can validate if the communication strategy is suitable to the stakeholder realities.

The methods proposed under knowledge exchange (user forums, surveys, workshops, learning laboratories, interviews) are a good choice to conduct step 6 and its substeps, which can be done in the same get-together event [for more detail, see Bojovic et al. (2021)].

Last, to consolidate joint decisions and formalize the type of coproduction process that will be conducted with the stakeholders/users to develop the climate service, as well as to ensure intersubjectivity, there are several possible actions. Klenk et al. (2015, p. 744) proposed a memorandum of understanding “outlining goals, principles, and intellectual property rights of partnerships with non-academic stakeholders; clear roles and responsibilities of knowledge co-producers and guidelines for how partnerships will accumulate, store, and mobilize data.” This memorandum can be a living document accessible to all engaged stakeholders. Accessibility here may involve devising versions of this document also as a noncomputerized document available on community notice boards. The necessity for this will need to be assessed on an ad hoc basis.

Step 6 is also challenging because users might bring in different and sometimes irreconcilable needs that cannot feasibly be addressed with the future climate service, in what is recognized as the multiplicity of stakeholder interests (de Bakker and den Hond 2008). In the discussion, we provide some trouble-shooting techniques for these cases.

Figure 2 provides a visual picture of what the level of participation would look like for the various stakeholders in an ideal implementation of the six steps of these guidelines.

Fig. 2.
Fig. 2.

Idealized outcome of implementing the guidelines.

Citation: Weather, Climate, and Society 15, 2; 10.1175/WCAS-D-22-0112.1

4. Discussion

Climate information and services are linked to climate science, and as Owen et al. (2019, p. 152) suggest, “value-laden problems like climate change call out the need for socially engaged research processes to generate . . . knowledge that is useful-for and usable-by society to confront these so-called wicked problems.” We firmly believe that a consistent user-selection and engagement practice can ensure climate services meet these two success criteria: useful for and usable by society and societal representatives, from policymakers to local communities. Such wicked problems are multidimensional, and this multidimensionality makes clear the reasons behind collaborative, adaptable, and solution-centered approaches to science in which the complexities of human behavior are taken into account (Bednarek et al. 2018). There cannot be innovative solutions without the participation of stakeholders and users, beginning with the conceptualization of the climate service itself.

To achieve these standards, user selection and engagement in coproduction processes are tasks that should not be conducted ad hoc. The stakes that come with this process include legitimacy concerns, the possibility to empower previously marginalized but vulnerable groups, and enabling long-term uptake of climate services to strengthen adaptation and mitigation actions to combat our changing climate. At worst, ignoring the different types of knowledge found in climate-sensitive contexts can exacerbate the sidelining of the groups most impacted by the climate crisis, produce biased results, and be an obstacle for building the necessary trust in scientific activity required for acted-upon and evidence-based policymaking. As scholars point out, “A lack of process for identifying and involving stakeholders often leads to a very long initiating process and significant delays in implementation” (Zingraff-Hamed et al. 2020, p. 3). At the same time, we recognize that user selection and engagement are very demanding processes on which there has been insufficient emphasis in the field of climate services (Vaughan et al. 2018). In this paper, we have aimed to address this gap, and in this section, we share some trouble-shooting techniques to overcome some of the challenges that might arise during its implementation.

a. Multiplicity: Dealing with multiple demands, interests, and perceptions

Conflict and conflicting views are regarded in network studies as something functional that can lead to innovation, to the point that certain network management techniques are deliberately targeting different profiles (Provan and Kenis 2007). The presence of different perceptions, views, and interests is inherent to knowledge coproduction processes in climate services and service design (Porter and Dessai 2017). The interests can be partially derived from the position of the individual, moreover, if the individual acts at the mezzo level and is thus representative of an organization, and these can be identified in the initial stages of the user mapping and identification. However, these different expectations from the climate service need to be carefully managed through targeted methods such as focus groups, interviews, or workshops. Trained social scientists are here essential members of the team applying these methods.

b. Lacking a theme, a team

The proposal stage of research projects is key for planting the seeds of successful coproduction processes and of user selection and engagement. At the proposal stage, not only are objectives and tasks defined, but also the very practical aspects such as the budget distribution among project partners. Lessons learned from climate services projects suggest that it is important to factor in this aspect (see, e.g., Buontempo et al. 2018; Klenk et al. 2015). Proposals may incorporate a theme on the knowledge coproduction process (a dedicated work package), or alternatively encourage the incorporation of experts across several teams. Given the importance of design for obtaining successful outcomes in engagement processes, engaging in-house or external experts is always recommended.

c. Mutual, negative, and unlearning

While learning is often thought of as always beneficial per se, the literature on policy learning in climate policymaking shows that some processes can also move toward undesired pathways (Biesbroek and Candel 2020). Additionally, some learning processes require “unlearning.” As Neij and Heiskanen (2021, p. 12) report, “Importantly, deep-seated changes are also suggested to require the need for unlearning of existing practices.” For instance, a forest owner who has never used climate services to base her decision-making processes on (e.g., type of management) might be reluctant to change practices that might be influenced by long-standing family traditions and the practices of other community members such as local leaders (Oliva et al. 2016). Using coproduction methods and having different disciplines in the scientist team can help create a climate of trust among the project scientists and stakeholders and convert the project into a platform of exchange and learning. In this platform of exchange, reciprocity, all parts gaining from participating in the process, can be more easily ensured.

d. Visualizing power

Norström et al. (2020, p. 5) observed that, “Asymmetrical power relations can prevent some actors from engaging in knowledge co-production and will reproduce knowledge hierarchies, in which certain knowledge and expertise are seen as being more legitimate than others.” This will impact the quality of the engagement process and bias results. In fact, the very implementation of participatory processes is a response to the willingness to balance power not only among societal groups, but also between researchers and users. Collaboration and deliberative processes within can help create more equalized dynamics (Mosley 2013, p. 70). There are several tools in place to identify power relations in projects (see, e.g., Reed et al. 2009; Schiffer 2007). Depending on the type of context in which the project is developed, stakeholders might know each other, and here, social network analysis can help in understanding the linkages between stakeholders as well as the inherent power dynamics.

e. Scale and scalability

These guidelines may be applied to any scale of decision-making, from local, to regional, to supranational, targeting stakeholders concerned with problems that pertain to each of these scales. The framework can, in addition, support scalability and replicability of case studies, especially when thoroughly conducting step 3 for case selection. For scaling up activities, the stakeholder mapping needs to be adjusted to the institutional and sociopolitical frameworks existing at different decision-making scales. However, similar or the same figures can recur in different scales as well as stakeholder categories. For example, civil protection may be an independent agency in one country, but it can also be situated in a department in the ministry or be distributed as a network pertaining to several sectors.

Overall, these trouble-shooting techniques may provide support in creating usable and legitimate science that contributes to the decision-making processes for a wide range of societal actors, strengthening adaptation and mitigation actions to combat climate change. Last, although the proposed steps for user selection and engagement may provide a robust approach, they also have some limitations. For instance, we have addressed several important topics such as power, scale, and principles in research, but only briefly. Thus, these guidelines may need to be supported with additional references, some of which we have already added when discussing these topics. Our assumption is nonetheless that these guidelines may be used by a team with expertise that can understand the repercussions of these key aspects in the selection and engagement of stakeholders in climate services coproduction processes.

5. Conclusions

In this article, we adapted stakeholder analysis methodologies to offer a hands-on road map for user selection and engagement in climate services. The six steps consist of 1) why: the definition of the high-level goal(s); 2) where: delineation of the case; 3) who: user mapping and identification; 4) which attributes: multiattribute analysis for selection criteria; 5) with which intensity: deciding on the engagement intensity; and last 6) introducing coproduction to each step. As an outcome, the proposed steps introduce context (step 2), scalar fit (step 3), power (step 4), and design (step 5) considerations, which in Reed et al. (2018) are shown not only to determine the success of different types of engagement, but also to counteract the normativity of infusing projects with principles. We advocate for an iterative collaborative process that engages in a dialogue among different types of expertise to consistently incorporate climate services into decision-making for a climate-resilient society, viewing users as experts of their own knowledge domain.

Acknowledgments.

We acknowledge that the work presented in this paper is based on knowledge and experience that the authors gained from working on various projects, including the European Union–funded projects PRIMAVERA (641727), Advanced Prediction in Polar Regions and Beyond: Modelling, Observing System Design and Linkages Associated with a Changing Arctic Climate (APPLICATE) (727862), MED-GOLD (776467), EUCP (776613), the Next Generation Earth System Models (https://cordis.europa.eu/project/id/101003470) (NextGEMS) (101003470), Impetus4Change (101081555), FOCUS-Africa (869575), and EUPORIAS (308291). The opinions expressed in this paper are those of the authors and do not necessarily reflect the views of the European Commission. We thank the reviewers for allowing the paper to better reflect, curate, and frame our ideas. This work has been funded under the projects NextGEMS (101003470) and FOCUS-Africa (GA869575).

Data availability statement.

No datasets were generated or analyzed during the current study.

REFERENCES

  • Armitage, D. R., and Coauthors, 2009: Adaptive co-management for social–ecological complexity. Front. Ecol. Environ., 7, 95102, https://doi.org/10.1890/070089.

    • Search Google Scholar
    • Export Citation
  • Athanasiou, P., A. van Dongeren, A. Giardino, M. I. Vousdoukas, R. Ranasinghe, and J. Kwadijk, 2020: Uncertainties in projections of sandy beach erosion due to sea level rise: an analysis at the European scale. Sci. Rep., 10, 11895, https://doi.org/10.1038/s41598-020-68576-0.

    • Search Google Scholar
    • Export Citation
  • Barquet, K., L. Segnestam, and S. Dickin, 2022: MapStakes: A tool for mapping, involving and monitoring stakeholders in co-creation processes. Stockholm Environment Institute Rep., 22 pp., https://doi.org/10.51414/sei2022.014.

  • Baulenas, E., S. Kruse, and M. Sotirov, 2021: Forest and water policy integration: A process and output-oriented policy network analysis. Environ. Policy Governance, 31, 432450, https://doi.org/10.1002/eet.1951.

    • Search Google Scholar
    • Export Citation
  • Bednarek, A. T., and Coauthors, 2018: Boundary spanning at the science–policy interface: The practitioners’ perspectives. Sustainability Sci., 13, 11751183, https://doi.org/10.1007/s11625-018-0550-9.

    • Search Google Scholar
    • Export Citation
  • Beier, P., L. J. Hansen, L. Helbrecht, and D. Behar, 2017: A how-to guide for coproduction of actionable science. Conserv. Lett., 10, 288296, https://doi.org/10.1111/conl.12300.

    • Search Google Scholar
    • Export Citation
  • Bell, K., and M. Reed, 2021: The tree of participation: A new model for inclusive decision-making. Community Dev. J., 57, 595614, https://doi.org/10.1093/cdj/bsab018.

    • Search Google Scholar
    • Export Citation
  • Bessembinder, J., M. Terrado, C. Hewitt, N. Garrett, L. Kotova, M. Buonocore, and R. Groenland, 2019: Need for a common typology of climate services. Climate Serv., 16, 100135, https://doi.org/10.1016/j.cliser.2019.100135.

    • Search Google Scholar
    • Export Citation
  • Biesbroek, R., and J. J. L. Candel, 2020: Mechanisms for policy (dis)integration: Explaining food policy and climate change adaptation policy in the Netherlands. Policy Sci., 53, 6184, https://doi.org/10.1007/s11077-019-09354-2.

    • Search Google Scholar
    • Export Citation
  • Bojovic, D., A. L. St. Clair, I. Christel, M. Terrado, P. Stanzel, P. Gonzalez, and E. J. Palin, 2021: Engagement, involvement and empowerment: Three realms of a coproduction framework for climate services. Global Environ. Change, 68, 102271, https://doi.org/10.1016/j.gloenvcha.2021.102271.

    • Search Google Scholar
    • Export Citation
  • Bojovic, D., A. Nicodemou, A. L. St. Clair, I. Christel, and F. J. Doblas-Reyes, 2022: Exploring the landscape of seasonal forecast provision by Global Producing Centres. Climatic Change, 172, 8, https://doi.org/10.1007/s10584-022-03350-x.

    • Search Google Scholar
    • Export Citation
  • Borgatti, S. P., M. G. Everett, and J. C. Johnson, 2018: Analyzing Social Networks. SAGE Publishing, 384 pp.

  • Bourne, L., and D. H. T. Walker, 2005: Visualising and mapping stakeholder influence. Manage. Decis., 43, 649660, https://doi.org/10.1108/00251740510597680.

    • Search Google Scholar
    • Export Citation
  • Bremer, S., and S. Meisch, 2017: Co‐production in climate change research: Reviewing different perspectives. Wiley Interdiscip. Rev.: Climate Change, 8, e482, https://doi.org/10.1002/wcc.482.

    • Search Google Scholar
    • Export Citation
  • Bremer, S., A. Wardekker, S. Dessai, S. Sobolowski, R. Slaattelid, and J. van der Sluijs, 2019: Toward a multi-faceted conception of co-production of climate services. Climate Serv., 13, 4250, https://doi.org/10.1016/j.cliser.2019.01.003.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and C. Hewitt, 2018: EUPORIAS and the development of climate services. Climate Serv., 9, 14, https://doi.org/10.1016/j.cliser.2017.06.011.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and Coauthors, 2018: What have we learnt from EUPORIAS climate service prototypes? Climate Serv., 9, 2132, https://doi.org/10.1016/j.cliser.2017.06.003.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and Coauthors, 2020: Fostering the development of climate services through Copernicus Climate Change Service (C3S) for agriculture applications. Wea. Climate Extremes, 27, 100226, https://doi.org/10.1016/j.wace.2019.100226.

    • Search Google Scholar
    • Export Citation
  • Cash, D. W., W. C. Clark, F. Alcock, N. M. Dickson, N. Eckley, D. H. Guston, J. Jäger, and R. B. Mitchell, 2003: Knowledge systems for sustainable development. Proc. Natl. Acad. Sci. USA, 100, 80868091, https://doi.org/10.1073/pnas.1231332100.

    • Search Google Scholar
    • Export Citation
  • Cash, D. W., W. N. Adger, F. Berkes, P. Garden, L. Lebel, P. Olsson, L. Pritchard, and O. Young, 2006: Scale and cross-scale dynamics: Governance and information in a multilevel world. Ecol. Soc., 11, 8, https://doi.org/10.5751/ES-01759-110208.

    • Search Google Scholar
    • Export Citation
  • Christel, I., D. Hemment, D. Bojovic, F. Cucchietti, L. Calvo, M. Stefaner, and C. Buontempo, 2018: Introducing design in the development of effective climate services. Climate Serv., 9, 111121, https://doi.org/10.1016/j.cliser.2017.06.002.

    • Search Google Scholar
    • Export Citation
  • Clifford, K. R., W. R. Travis, and L. T. Nordgren, 2020: A climate knowledges approach to climate services. Climate Serv., 18, 100155, https://doi.org/10.1016/j.cliser.2020.100155.

    • Search Google Scholar
    • Export Citation
  • Cologna, V., and N. Oreskes, 2022: Don’t gloss over social science! A response to: Glavovic et al. (2021) ‘the tragedy of climate change science’. Climate Dev., 14, 839841, https://doi.org/10.1080/17565529.2022.2076647.

    • Search Google Scholar
    • Export Citation
  • Daniels, E., S. Bharwani, Å. Gerger Swartling, G. Vulturius, and K. Brandon, 2020: Refocusing the climate services lens: Introducing a framework for co-designing “transdisciplinary knowledge integration processes” to build climate resilience. Climate Serv., 19, 100181, https://doi.org/10.1016/j.cliser.2020.100181.

    • Search Google Scholar
    • Export Citation
  • de Bakker, F. G. A., and F. den Hond, 2008: Introducing the politics of stakeholder influence: A review essay. Bus. Soc., 47, 820, https://doi.org/10.1177/0007650307306637.

    • Search Google Scholar
    • Export Citation
  • Delzeit, R., T. Heimann, F. Schuenemann, M. Söder, F. Zabel, and M. Hosseini, 2021: Scenarios for an impact assessment of global bioeconomy strategies: Results from a co-design process. Res. Globalization, 3, 100060, https://doi.org/10.1016/j.resglo.2021.100060.

    • Search Google Scholar
    • Export Citation
  • Dilling, L., and M. C. Lemos, 2011: Creating usable science: Opportunities and constraints for climate knowledge use and their implications for science policy. Global Environ. Change, 21, 680689, https://doi.org/10.1016/j.gloenvcha.2010.11.006.

    • Search Google Scholar
    • Export Citation
  • Findlater, K., S. Webber, M. Kandlikar, and S. Donner, 2021: Climate services promise better decisions but mainly focus on better data. Nat. Climate Change, 11, 731737, https://doi.org/10.1038/s41558-021-01125-3.

    • Search Google Scholar
    • Export Citation
  • Freeman, R. E., 2010: Strategic Management: A Stakeholder Approach. Cambridge University Press, 276 pp.

  • Gerring, J., 2016: Case Study Research: Principles and Practices. 2nd ed. Cambridge University Press, 332 pp.

  • Glavovic, B. C., T. F. Smith, and I. White, 2022: The tragedy of climate change science. Climate Dev., 14, 829833, https://doi.org/10.1080/17565529.2021.2008855.

    • Search Google Scholar
    • Export Citation
  • Hajer, M., and W. Versteeg, 2005: A decade of discourse analysis of environmental politics: Achievements, challenges, perspectives. J. Environ. Policy Plann., 7, 175184, https://doi.org/10.1080/15239080500339646.

    • Search Google Scholar
    • Export Citation
  • Hewitt, C. D., N. Golding, P. Zhang, T. Dunbar, P. E. Bett, J. Camp, T. D. Mitchell, and E. Pope, 2020: The process and benefits of developing prototype climate services—Examples in China. J. Meteor. Res., 34, 893903, https://doi.org/10.1007/s13351-020-0042-6.

    • Search Google Scholar
    • Export Citation
  • Hill, R., F. J. Walsh, J. Davies, A. Sparrow, M. Mooney, Central Land Council, R. M. Wise, and M. Tengö, 2020: Knowledge co-production for Indigenous adaptation pathways: Transform post-colonial articulation complexes to empower local decision-making. Global Environ. Change, 65, 102161, https://doi.org/10.1016/j.gloenvcha.2020.102161.

    • Search Google Scholar
    • Export Citation
  • Jepsen, A. L., and P. Eskerod, 2009: Stakeholder analysis in projects: Challenges in using current guidelines in the real world. Int. J. Proj. Manage., 27, 335343, https://doi.org/10.1016/j.ijproman.2008.04.002.

    • Search Google Scholar
    • Export Citation
  • Kalafatis, S. E., M. C. Lemos, Y.-J. Lo, and K. A. Frank, 2015: Increasing information usability for climate adaptation: The role of knowledge networks and communities of practice. Global Environ. Change, 32, 3039, https://doi.org/10.1016/j.gloenvcha.2015.02.007.

    • Search Google Scholar
    • Export Citation
  • Klenk, N. L., K. Meehan, S. L. Pinel, F. Mendez, P. T. Lima, and D. M. Kammen, 2015: Stakeholders in climate science: Beyond lip service? Science, 350, 743744, https://doi.org/10.1126/science.aab1495.

    • Search Google Scholar
    • Export Citation
  • Lemos, M. C., and B. J. Morehouse, 2005: The co-production of science and policy in integrated climate assessments. Global Environ. Change, 15, 5768, https://doi.org/10.1016/j.gloenvcha.2004.09.004.

    • Search Google Scholar
    • Export Citation
  • March, H., L. Domènech, and D. Saurí, 2013: Water conservation campaigns and citizen perceptions: The drought of 2007–2008 in the Metropolitan Area of Barcelona. Nat. Hazards, 65, 19511966, https://doi.org/10.1007/s11069-012-0456-2.

    • Search Google Scholar
    • Export Citation
  • Martin-Ortega, J., M. González-Eguino, and A. Markandya, 2011: The costs of drought: The 2007/2008 case of Barcelona. Water Policy, 14, 539560, https://doi.org/10.2166/wp.2011.121.

    • Search Google Scholar
    • Export Citation
  • McCauley, D., and R. Heffron, 2018: Just transition: Integrating climate, energy and environmental justice. Energy Policy, 119, 17, https://doi.org/10.1016/j.enpol.2018.04.014.

    • Search Google Scholar
    • Export Citation
  • Mitchell, R. K., B. R. Agle, and D. J. Wood, 1997: Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Acad. Manage. Rev., 22, 853886, https://doi.org/10.2307/259247.

    • Search Google Scholar
    • Export Citation
  • Mosley, L., 2013: Interview Research in Political Science. Cornell University Press, 272 pp.

  • Neij, L., and E. Heiskanen, 2021: Municipal climate mitigation policy and policy learning—A review. J. Clean. Prod., 317, 128348, https://doi.org/10.1016/j.jclepro.2021.128348.

    • Search Google Scholar
    • Export Citation
  • Nel, J. L., and Coauthors, 2016: Knowledge co-production and boundary work to promote implementation of conservation plans. Conserv. Biol., 30, 176188, https://doi.org/10.1111/cobi.12560.

    • Search Google Scholar
    • Export Citation
  • Neville, B. A., and B. Menguc, 2006: Stakeholder multiplicity: Toward an understanding of the interactions between stakeholders. J. Bus. Ethics, 66, 377391, https://doi.org/10.1007/s10551-006-0015-4.

    • Search Google Scholar
    • Export Citation
  • Norström, A. V., and Coauthors, 2020: Principles for knowledge co-production in sustainability research. Nat. Sustainability, 3, 182190, https://doi.org/10.1038/s41893-019-0448-2.

    • Search Google Scholar
    • Export Citation
  • Oliva, J., C. Castaño, E. Baulenas, G. Domínguez, J. R. González-Olabarria, and D. Oliach, 2016: The impact of the socioeconomic environment on the implementation of control measures against an invasive forest pathogen. For. Ecol. Manage., 380, 118127, https://doi.org/10.1016/j.foreco.2016.08.034.

    • Search Google Scholar
    • Export Citation
  • Otto, J., and Coauthors, 2016: Uncertainty: Lessons learned for climate services. Bull. Amer. Meteor. Soc., 97, ES265ES269, https://doi.org/10.1175/BAMS-D-16-0173.1.

    • Search Google Scholar
    • Export Citation
  • Owen, G., D. B. Ferguson, and B. McMahan, 2019: Contextualizing climate science: Applying social learning systems theory to knowledge production, climate services, and use-inspired research. Climatic Change, 157, 151170, https://doi.org/10.1007/s10584-019-02466-x.

    • Search Google Scholar
    • Export Citation
  • Porter, J. J., and S. Dessai, 2017: Mini-me: Why do climate scientists’ misunderstand users and their needs? Environ. Sci. Policy, 77, 914, https://doi.org/10.1016/j.envsci.2017.07.004.

    • Search Google Scholar
    • Export Citation
  • Prell, C., K. Hubacek, and M. Reed, 2009: Stakeholder analysis and social network analysis in natural resource management. Soc. Nat. Resour., 22, 501518, https://doi.org/10.1080/08941920802199202.

    • Search Google Scholar
    • Export Citation
  • Provan, K. G., and P. Kenis, 2007: Modes of network governance: Structure, management, and effectiveness. J. Public Adm. Res. Theory, 18, 229252, https://doi.org/10.1093/jopart/mum015.

    • Search Google Scholar
    • Export Citation
  • Raaphorst, K., G. Koers, G. J. Ellen, A. Oen, B. Kalsnes, L. van Well, J. Koerth, and R. van der Brugge, 2020: Mind the gap: Towards a typology of climate service usability gaps. Sustainability, 12, 1512, https://doi.org/10.3390/su12041512.

    • Search Google Scholar
    • Export Citation
  • Reed, M. S., and Coauthors, 2009: Who’s in and why? A typology of stakeholder analysis methods for natural resource management. J. Environ. Manage., 90, 19331949, https://doi.org/10.1016/j.jenvman.2009.01.001.

    • Search Google Scholar
    • Export Citation
  • Reed, M. S., and Coauthors, 2018: A theory of participation: What makes stakeholder and public engagement in environmental management work? Restor. Ecol., 26 (Suppl.), S7S17, https://doi.org/10.1111/rec.12541.

    • Search Google Scholar
    • Export Citation
  • Reimann, L., B. Vollstedt, J. Koerth, M. Tsakiris, M. Beer, and A. T. Vafeidis, 2021: Extending the Shared Socioeconomic Pathways (SSPs) to support local adaptation planning—A climate service for Flensburg, Germany. Futures, 127, 102691, https://doi.org/10.1016/j.futures.2020.102691.

    • Search Google Scholar
    • Export Citation
  • Reinecke, S., 2015: Knowledge brokerage designs and practices in four European climate services: A role model for biodiversity policies? Environ. Sci. Policy, 54, 513521, https://doi.org/10.1016/j.envsci.2015.08.007.

    • Search Google Scholar
    • Export Citation
  • Rodriguez-Rey, D., and Coauthors, 2022: To what extent the traffic restriction policies applied in Barcelona city can improve its air quality? Sci. Total Environ., 807, 150743, https://doi.org/10.1016/j.scitotenv.2021.150743.

    • Search Google Scholar
    • Export Citation
  • Roux, D. J., J. L. Nel, G. Cundill, P. O’Farrell, and C. Fabricius, 2017: Transdisciplinary research for systemic change: Who to learn with, what to learn about and how to learn. Sustainability Sci., 12, 711726, https://doi.org/10.1007/s11625-017-0446-0.

    • Search Google Scholar
    • Export Citation
  • Schiffer, E., 2007: The Power Mapping Tool: A method for the empirical research of power relations. IFPRI Discussion Paper 703, 25 pp., https://ebrary.ifpri.org/digital/collection/p15738coll2/id/38994/.

  • Solaraju-Murali, B., D. Bojovic, N. Gonzalez-Reviriego, A. Nicodemou, M. Terrado, L.-P. Caron, and F. J. Doblas-Reyes, 2022: How decadal predictions entered the climate services arena: An example from the agriculture sector. Climate Serv., 27, 100303, https://doi.org/10.1016/j.cliser.2022.100303.

    • Search Google Scholar
    • Export Citation
  • Street, R. B., M. Parry, J. Scott, D. Jacob, and T. Runge, 2015: A European research and innovation roadmap for climate services. European Commission Directorate-General for Research and Innovation Doc., 561 pp., https://data.europa.eu/doi/10.2777/702151.

  • Street, R. B., C. Buontempo, J. Mysiak, E. Karali, M. Pulquério, V. Murray, and R. Swart, 2019: How could climate services support disaster risk reduction in the 21st century. Int. J. Disaster Risk Reduct., 34, 2833, https://doi.org/10.1016/j.ijdrr.2018.12.001.

    • Search Google Scholar
    • Export Citation
  • Terrado, M., L. Calvo, and I. Christel, 2022: Towards more effective visualisations in climate services: Good practices and recommendations. Climatic Change, 172, 18, https://doi.org/10.1007/s10584-022-03365-4.

    • Search Google Scholar
    • Export Citation
  • Terrado, M., D. Bojovic, S. Octenjak, I. Christel, and A. L. St. Clair, 2023: Good practice for knowledge co-development through climate related case studies. Climate Risk Manage., 40, 100513, https://doi.org/10.1016/j.crm.2023.100513.

    • Search Google Scholar
    • Export Citation
  • Thinyane, M., L. Goldkind, and H. I. Lam, 2018: Data collaboration and participation for sustainable development goals—A case for engaging community-based organizations. J. Hum. Rights Soc. Work, 3, 4451, https://doi.org/10.1007/s41134-018-0047-6.

    • Search Google Scholar
    • Export Citation
  • van der Hel, S., 2016: New science for global sustainability? The institutionalisation of knowledge co-production in future Earth. Environ. Sci. Policy, 61, 165175, https://doi.org/10.1016/j.envsci.2016.03.012.

    • Search Google Scholar
    • Export Citation
  • Vaughan, C., S. Dessai, and C. Hewitt, 2018: Surveying climate services: What can we learn from a bird’s-eye view? Wea. Climate Soc., 10, 373395, https://doi.org/10.1175/WCAS-D-17-0030.1.

    • Search Google Scholar
    • Export Citation
  • Walker, D. H. T., L. M. Bourne, and A. Shelley, 2008: Influence, stakeholder mapping and visualization. Constr. Manage. Econ., 26, 645658, https://doi.org/10.1080/01446190701882390.

    • Search Google Scholar
    • Export Citation
  • Wilmer, H., and Coauthors, 2021: Expanded ethical principles for research partnership and transdisciplinary natural resource management science. Environ. Manage., 68, 453467, https://doi.org/10.1007/s00267-021-01508-4.

    • Search Google Scholar
    • Export Citation
  • Yang, R. J., 2014: An investigation of stakeholder analysis in urban development projects: Empirical or rationalistic perspectives. Int. J. Proj. Manage., 32, 838849, https://doi.org/10.1016/j.ijproman.2013.10.011.

    • Search Google Scholar
    • Export Citation
  • Zingraff-Hamed, A., and Coauthors, 2020: Stakeholder mapping to co-create nature-based solutions: Who is on board? Sustainability, 12, 8625, https://doi.org/10.3390/su12208625.

    • Search Google Scholar
    • Export Citation
Save
  • Armitage, D. R., and Coauthors, 2009: Adaptive co-management for social–ecological complexity. Front. Ecol. Environ., 7, 95102, https://doi.org/10.1890/070089.

    • Search Google Scholar
    • Export Citation
  • Athanasiou, P., A. van Dongeren, A. Giardino, M. I. Vousdoukas, R. Ranasinghe, and J. Kwadijk, 2020: Uncertainties in projections of sandy beach erosion due to sea level rise: an analysis at the European scale. Sci. Rep., 10, 11895, https://doi.org/10.1038/s41598-020-68576-0.

    • Search Google Scholar
    • Export Citation
  • Barquet, K., L. Segnestam, and S. Dickin, 2022: MapStakes: A tool for mapping, involving and monitoring stakeholders in co-creation processes. Stockholm Environment Institute Rep., 22 pp., https://doi.org/10.51414/sei2022.014.

  • Baulenas, E., S. Kruse, and M. Sotirov, 2021: Forest and water policy integration: A process and output-oriented policy network analysis. Environ. Policy Governance, 31, 432450, https://doi.org/10.1002/eet.1951.

    • Search Google Scholar
    • Export Citation
  • Bednarek, A. T., and Coauthors, 2018: Boundary spanning at the science–policy interface: The practitioners’ perspectives. Sustainability Sci., 13, 11751183, https://doi.org/10.1007/s11625-018-0550-9.

    • Search Google Scholar
    • Export Citation
  • Beier, P., L. J. Hansen, L. Helbrecht, and D. Behar, 2017: A how-to guide for coproduction of actionable science. Conserv. Lett., 10, 288296, https://doi.org/10.1111/conl.12300.

    • Search Google Scholar
    • Export Citation
  • Bell, K., and M. Reed, 2021: The tree of participation: A new model for inclusive decision-making. Community Dev. J., 57, 595614, https://doi.org/10.1093/cdj/bsab018.

    • Search Google Scholar
    • Export Citation
  • Bessembinder, J., M. Terrado, C. Hewitt, N. Garrett, L. Kotova, M. Buonocore, and R. Groenland, 2019: Need for a common typology of climate services. Climate Serv., 16, 100135, https://doi.org/10.1016/j.cliser.2019.100135.

    • Search Google Scholar
    • Export Citation
  • Biesbroek, R., and J. J. L. Candel, 2020: Mechanisms for policy (dis)integration: Explaining food policy and climate change adaptation policy in the Netherlands. Policy Sci., 53, 6184, https://doi.org/10.1007/s11077-019-09354-2.

    • Search Google Scholar
    • Export Citation
  • Bojovic, D., A. L. St. Clair, I. Christel, M. Terrado, P. Stanzel, P. Gonzalez, and E. J. Palin, 2021: Engagement, involvement and empowerment: Three realms of a coproduction framework for climate services. Global Environ. Change, 68, 102271, https://doi.org/10.1016/j.gloenvcha.2021.102271.

    • Search Google Scholar
    • Export Citation
  • Bojovic, D., A. Nicodemou, A. L. St. Clair, I. Christel, and F. J. Doblas-Reyes, 2022: Exploring the landscape of seasonal forecast provision by Global Producing Centres. Climatic Change, 172, 8, https://doi.org/10.1007/s10584-022-03350-x.

    • Search Google Scholar
    • Export Citation
  • Borgatti, S. P., M. G. Everett, and J. C. Johnson, 2018: Analyzing Social Networks. SAGE Publishing, 384 pp.

  • Bourne, L., and D. H. T. Walker, 2005: Visualising and mapping stakeholder influence. Manage. Decis., 43, 649660, https://doi.org/10.1108/00251740510597680.

    • Search Google Scholar
    • Export Citation
  • Bremer, S., and S. Meisch, 2017: Co‐production in climate change research: Reviewing different perspectives. Wiley Interdiscip. Rev.: Climate Change, 8, e482, https://doi.org/10.1002/wcc.482.

    • Search Google Scholar
    • Export Citation
  • Bremer, S., A. Wardekker, S. Dessai, S. Sobolowski, R. Slaattelid, and J. van der Sluijs, 2019: Toward a multi-faceted conception of co-production of climate services. Climate Serv., 13, 4250, https://doi.org/10.1016/j.cliser.2019.01.003.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and C. Hewitt, 2018: EUPORIAS and the development of climate services. Climate Serv., 9, 14, https://doi.org/10.1016/j.cliser.2017.06.011.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and Coauthors, 2018: What have we learnt from EUPORIAS climate service prototypes? Climate Serv., 9, 2132, https://doi.org/10.1016/j.cliser.2017.06.003.

    • Search Google Scholar
    • Export Citation
  • Buontempo, C., and Coauthors, 2020: Fostering the development of climate services through Copernicus Climate Change Service (C3S) for agriculture applications. Wea. Climate Extremes, 27, 100226, https://doi.org/10.1016/j.wace.2019.100226.

    • Search Google Scholar
    • Export Citation
  • Cash, D. W., W. C. Clark, F. Alcock, N. M. Dickson, N. Eckley, D. H. Guston, J. Jäger, and R. B. Mitchell, 2003: Knowledge systems for sustainable development. Proc. Natl. Acad. Sci. USA, 100, 80868091, https://doi.org/10.1073/pnas.1231332100.

    • Search Google Scholar
    • Export Citation
  • Cash, D. W., W. N. Adger, F. Berkes, P. Garden, L. Lebel, P. Olsson, L. Pritchard, and O. Young, 2006: Scale and cross-scale dynamics: Governance and information in a multilevel world. Ecol. Soc., 11, 8, https://doi.org/10.5751/ES-01759-110208.

    • Search Google Scholar
    • Export Citation
  • Christel, I., D. Hemment, D. Bojovic, F. Cucchietti, L. Calvo, M. Stefaner, and C. Buontempo, 2018: Introducing design in the development of effective climate services. Climate Serv., 9, 111121, https://doi.org/10.1016/j.cliser.2017.06.002.

    • Search Google Scholar
    • Export Citation
  • Clifford, K. R., W. R. Travis, and L. T. Nordgren, 2020: A climate knowledges approach to climate services. Climate Serv., 18, 100155, https://doi.org/10.1016/j.cliser.2020.100155.

    • Search Google Scholar
    • Export Citation
  • Cologna, V., and N. Oreskes, 2022: Don’t gloss over social science! A response to: Glavovic et al. (2021) ‘the tragedy of climate change science’. Climate Dev., 14, 839841, https://doi.org/10.1080/17565529.2022.2076647.

    • Search Google Scholar
    • Export Citation
  • Daniels, E., S. Bharwani, Å. Gerger Swartling, G. Vulturius, and K. Brandon, 2020: Refocusing the climate services lens: Introducing a framework for co-designing “transdisciplinary knowledge integration processes” to build climate resilience. Climate Serv., 19, 100181, https://doi.org/10.1016/j.cliser.2020.100181.

    • Search Google Scholar
    • Export Citation
  • de Bakker, F. G. A., and F. den Hond, 2008: Introducing the politics of stakeholder influence: A review essay. Bus. Soc., 47, 820, https://doi.org/10.1177/0007650307306637.

    • Search Google Scholar
    • Export Citation
  • Delzeit, R., T. Heimann, F. Schuenemann, M. Söder, F. Zabel, and M. Hosseini, 2021: Scenarios for an impact assessment of global bioeconomy strategies: Results from a co-design process. Res. Globalization, 3, 100060, https://doi.org/10.1016/j.resglo.2021.100060.

    • Search Google Scholar
    • Export Citation
  • Dilling, L., and M. C. Lemos, 2011: Creating usable science: Opportunities and constraints for climate knowledge use and their implications for science policy. Global Environ. Change, 21, 680689, https://doi.org/10.1016/j.gloenvcha.2010.11.006.

    • Search Google Scholar
    • Export Citation
  • Findlater, K., S. Webber, M. Kandlikar, and S. Donner, 2021: Climate services promise better decisions but mainly focus on better data. Nat. Climate Change, 11, 731737, https://doi.org/10.1038/s41558-021-01125-3.

    • Search Google Scholar
    • Export Citation
  • Freeman, R. E., 2010: Strategic Management: A Stakeholder Approach. Cambridge University Press, 276 pp.

  • Gerring, J., 2016: Case Study Research: Principles and Practices. 2nd ed. Cambridge University Press, 332 pp.

  • Glavovic, B. C., T. F. Smith, and I. White, 2022: The tragedy of climate change science. Climate Dev., 14, 829833, https://doi.org/10.1080/17565529.2021.2008855.

    • Search Google Scholar
    • Export Citation
  • Hajer, M., and W. Versteeg, 2005: A decade of discourse analysis of environmental politics: Achievements, challenges, perspectives. J. Environ. Policy Plann., 7, 175184, https://doi.org/10.1080/15239080500339646.

    • Search Google Scholar
    • Export Citation
  • Hewitt, C. D., N. Golding, P. Zhang, T. Dunbar, P. E. Bett, J. Camp, T. D. Mitchell, and E. Pope, 2020: The process and benefits of developing prototype climate services—Examples in China. J. Meteor. Res., 34, 893903, https://doi.org/10.1007/s13351-020-0042-6.

    • Search Google Scholar
    • Export Citation
  • Hill, R., F. J. Walsh, J. Davies, A. Sparrow, M. Mooney, Central Land Council, R. M. Wise, and M. Tengö, 2020: Knowledge co-production for Indigenous adaptation pathways: Transform post-colonial articulation complexes to empower local decision-making. Global Environ. Change, 65, 102161, https://doi.org/10.1016/j.gloenvcha.2020.102161.

    • Search Google Scholar
    • Export Citation
  • Jepsen, A. L., and P. Eskerod, 2009: Stakeholder analysis in projects: Challenges in using current guidelines in the real world. Int. J. Proj. Manage., 27, 335343, https://doi.org/10.1016/j.ijproman.2008.04.002.

    • Search Google Scholar
    • Export Citation
  • Kalafatis, S. E., M. C. Lemos, Y.-J. Lo, and K. A. Frank, 2015: Increasing information usability for climate adaptation: The role of knowledge networks and communities of practice. Global Environ. Change, 32, 3039, https://doi.org/10.1016/j.gloenvcha.2015.02.007.

    • Search Google Scholar
    • Export Citation
  • Klenk, N. L., K. Meehan, S. L. Pinel, F. Mendez, P. T. Lima, and D. M. Kammen, 2015: Stakeholders in climate science: Beyond lip service? Science, 350, 743744, https://doi.org/10.1126/science.aab1495.

    • Search Google Scholar
    • Export Citation
  • Lemos, M. C., and B. J. Morehouse, 2005: The co-production of science and policy in integrated climate assessments. Global Environ. Change, 15, 5768, https://doi.org/10.1016/j.gloenvcha.2004.09.004.

    • Search Google Scholar
    • Export Citation
  • March, H., L. Domènech, and D. Saurí, 2013: Water conservation campaigns and citizen perceptions: The drought of 2007–2008 in the Metropolitan Area of Barcelona. Nat. Hazards, 65, 19511966, https://doi.org/10.1007/s11069-012-0456-2.

    • Search Google Scholar
    • Export Citation
  • Martin-Ortega, J., M. González-Eguino, and A. Markandya, 2011: The costs of drought: The 2007/2008 case of Barcelona. Water Policy, 14, 539560, https://doi.org/10.2166/wp.2011.121.

    • Search Google Scholar
    • Export Citation
  • McCauley, D., and R. Heffron, 2018: Just transition: Integrating climate, energy and environmental justice. Energy Policy, 119, 17, https://doi.org/10.1016/j.enpol.2018.04.014.

    • Search Google Scholar
    • Export Citation
  • Mitchell, R. K., B. R. Agle, and D. J. Wood, 1997: Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Acad. Manage. Rev., 22, 853886, https://doi.org/10.2307/259247.

    • Search Google Scholar
    • Export Citation
  • Mosley, L., 2013: Interview Research in Political Science. Cornell University Press, 272 pp.

  • Neij, L., and E. Heiskanen, 2021: Municipal climate mitigation policy and policy learning—A review. J. Clean. Prod., 317, 128348, https://doi.org/10.1016/j.jclepro.2021.128348.

    • Search Google Scholar
    • Export Citation
  • Nel, J. L., and Coauthors, 2016: Knowledge co-production and boundary work to promote implementation of conservation plans. Conserv. Biol., 30, 176188, https://doi.org/10.1111/cobi.12560.

    • Search Google Scholar
    • Export Citation
  • Neville, B. A., and B. Menguc, 2006: Stakeholder multiplicity: Toward an understanding of the interactions between stakeholders. J. Bus. Ethics, 66, 377391, https://doi.org/10.1007/s10551-006-0015-4.

    • Search Google Scholar
    • Export Citation
  • Norström, A. V., and Coauthors, 2020: Principles for knowledge co-production in sustainability research. Nat. Sustainability, 3, 182190, https://doi.org/10.1038/s41893-019-0448-2.

    • Search Google Scholar
    • Export Citation
  • Oliva, J., C. Castaño, E. Baulenas, G. Domínguez, J. R. González-Olabarria, and D. Oliach, 2016: The impact of the socioeconomic environment on the implementation of control measures against an invasive forest pathogen. For. Ecol. Manage., 380, 118127, https://doi.org/10.1016/j.foreco.2016.08.034.

    • Search Google Scholar
    • Export Citation
  • Otto, J., and Coauthors, 2016: Uncertainty: Lessons learned for climate services. Bull. Amer. Meteor. Soc., 97, ES265ES269, https://doi.org/10.1175/BAMS-D-16-0173.1.

    • Search Google Scholar
    • Export Citation
  • Owen, G., D. B. Ferguson, and B. McMahan, 2019: Contextualizing climate science: Applying social learning systems theory to knowledge production, climate services, and use-inspired research. Climatic Change, 157, 151170, https://doi.org/10.1007/s10584-019-02466-x.

    • Search Google Scholar
    • Export Citation
  • Porter, J. J., and S. Dessai, 2017: Mini-me: Why do climate scientists’ misunderstand users and their needs? Environ. Sci. Policy, 77, 914, https://doi.org/10.1016/j.envsci.2017.07.004.

    • Search Google Scholar
    • Export Citation
  • Prell, C., K. Hubacek, and M. Reed, 2009: Stakeholder analysis and social network analysis in natural resource management. Soc. Nat. Resour., 22, 501518, https://doi.org/10.1080/08941920802199202.

    • Search Google Scholar
    • Export Citation
  • Provan, K. G., and P. Kenis, 2007: Modes of network governance: Structure, management, and effectiveness. J. Public Adm. Res. Theory, 18, 229252, https://doi.org/10.1093/jopart/mum015.

    • Search Google Scholar
    • Export Citation
  • Raaphorst, K., G. Koers, G. J. Ellen, A. Oen, B. Kalsnes, L. van Well, J. Koerth, and R. van der Brugge, 2020: Mind the gap: Towards a typology of climate service usability gaps. Sustainability, 12, 1512, https://doi.org/10.3390/su12041512.

    • Search Google Scholar
    • Export Citation
  • Reed, M. S., and Coauthors, 2009: Who’s in and why? A typology of stakeholder analysis methods for natural resource management. J. Environ. Manage., 90, 19331949, https://doi.org/10.1016/j.jenvman.2009.01.001.

    • Search Google Scholar
    • Export Citation
  • Reed, M. S., and Coauthors, 2018: A theory of participation: What makes stakeholder and public engagement in environmental management work? Restor. Ecol., 26 (Suppl.), S7S17, https://doi.org/10.1111/rec.12541.

    • Search Google Scholar
    • Export Citation
  • Reimann, L., B. Vollstedt, J. Koerth, M. Tsakiris, M. Beer, and A. T. Vafeidis, 2021: Extending the Shared Socioeconomic Pathways (SSPs) to support local adaptation planning—A climate service for Flensburg, Germany. Futures, 127, 102691, https://doi.org/10.1016/j.futures.2020.102691.

    • Search Google Scholar
    • Export Citation
  • Reinecke, S., 2015: Knowledge brokerage designs and practices in four European climate services: A role model for biodiversity policies? Environ. Sci. Policy, 54, 513521, https://doi.org/10.1016/j.envsci.2015.08.007.

    • Search Google Scholar
    • Export Citation
  • Rodriguez-Rey, D., and Coauthors, 2022: To what extent the traffic restriction policies applied in Barcelona city can improve its air quality? Sci. Total Environ., 807, 150743, https://doi.org/10.1016/j.scitotenv.2021.150743.

    • Search Google Scholar
    • Export Citation
  • Roux, D. J., J. L. Nel, G. Cundill, P. O’Farrell, and C. Fabricius, 2017: Transdisciplinary research for systemic change: Who to learn with, what to learn about and how to learn. Sustainability Sci., 12, 711726, https://doi.org/10.1007/s11625-017-0446-0.

    • Search Google Scholar
    • Export Citation
  • Schiffer, E., 2007: The Power Mapping Tool: A method for the empirical research of power relations. IFPRI Discussion Paper 703, 25 pp., https://ebrary.ifpri.org/digital/collection/p15738coll2/id/38994/.

  • Solaraju-Murali, B., D. Bojovic, N. Gonzalez-Reviriego, A. Nicodemou, M. Terrado, L.-P. Caron, and F. J. Doblas-Reyes, 2022: How decadal predictions entered the climate services arena: An example from the agriculture sector. Climate Serv., 27, 100303, https://doi.org/10.1016/j.cliser.2022.100303.

    • Search Google Scholar
    • Export Citation
  • Street, R. B., M. Parry, J. Scott, D. Jacob, and T. Runge, 2015: A European research and innovation roadmap for climate services. European Commission Directorate-General for Research and Innovation Doc., 561 pp., https://data.europa.eu/doi/10.2777/702151.

  • Street, R. B., C. Buontempo, J. Mysiak, E. Karali, M.