12. Re-evaluation and update of the methodology

ETAPAS User Journey's step 12

Marcello VERONA

Published on: 27/10/2023 Last update: 30/11/2023 Document

Step 12

The re-evaluation and update of the methodology is the 12th and final step during DTs responsible implementation led by PAs. As the implementation process supposes a loop, this step seeks to fulfill a double objective: (1) Assess whether the implementation of a DT-based solution has changed the status-quo, and therefore, public needs; and (2) Provide PAs with a learning process for the update of the responsible DT implementation for PAs methodology.

Concerning the first objective, the re-evaluation shall be based on the balance of results and stakeholder engagement if needed. It shall provide an answer to what could be done better and if any changes are needed according to the societal impacts it provoked. As for the second objective, the re-evaluation allows PAs to reflect on what were the strengths and failures of the ETAPAS methodology replication to their specific context, which shall lead to an adaptation of the methodology accordingly.

Roles Involved at this stage	Activity to be carried out	ETAPAS tools that can support the activity
Process manager	Ensure that the objectives are being fulfilled; Create a new strategy based on the results; Update the methodology according to the inputs.
Process coordinator	Support the project manager by providing a holistic overview of the results.
IELCAB	Ensure that all ethical, legal, and cybersecurity standards are being followed and respected. The advisory board can call for new measures that were not fully respected during the implementation; the advisory board can be revised if necessary.	Code of Conduct; Legal assessment; ETAPAS Platform.
Financial or procurement advisor	Ensure that the budget predefined was carefully followed. They shall also ensure the transparency of the financial expenses to the greater public; If the process failed to respect the budget, the financial or procurement advisor is responsible for coming up with new propositions for the next round.	Code of Conduct; Legal assessment; Guidelines to assess TD-ABC.
Data experts	Analyse the data collected and translated them into clear and informative feedback for all other roles.
Specific experts on the DT adopted	Ensure that the DT adopted is being used at its full potential; Identify risks stemming from the use of the specific DT and alert the process manager.	Code of Conduct; ETAPAS Platform.
Developers	Fix any evident issues for the proper working of the DT.
Research team	Lead benchmarking; Provide use-cases and best practices identified in similar implementation processes in other PAs.
Transformational support advisor	Understand the weaknesses and strengths of public administrators during the implementation; Identify points of enhancement for filling gaps in public administrators’ knowledge.	Guidelines on the capacity building of the team.
Responsible for stakeholder engagement	Provide a stakeholder engagement plan for feedback and brainstorming of the lessons learnt before launching a new stakeholder engagement targeting the needs (during the new round).	Guidelines for stakeholder engagement.