Monitoring and assessment
As an institute focused on achieving market and societal impact, the EIT has a results‐oriented and impact‐driven approach to monitoring and assessment. KICs operate according to business logic and on the basis of annual KIC Business Plans that implement the KIC's multiannual strategies, portfolio of activities from education to business creation. KICs operate with clear targets and deliverables while use key performance indicators. The EIT monitors the KIC's multiannual strategy and the KIC's portfolio of activities to assess its impact and to incentivise its performance with a view to:
- ensuring alignment of KIC strategies with the EIT mission and objectives and ascertaining that the strategies (have the potential to) produce the desired results and impact
- ensuring that the EIT and KICs implement their activities, deliver outputs and spend budgets according to planning or adjust plans in a timely manner where justified
- verifying that the EIT and KICs respect the basic principles of all applicable EU legislation, including good governance principles and sound financial management
- enabling continuous quality improvement and adequate risk management
- assessing and improving the KIC model with a focus on Knowledge Triangle Integration
- obtaining information on the impact and EU added value of the EIT and KICs and good practices for communication with external stakeholders
The EIT is responsible for the assessment of an individual KIC's performance and those cross‐KIC elements that contribute to accomplishing the EIT's mission. The EIT and KICs contribution to Horizon 2020 is monitored by theEuropean Commission. Closely monitoring the KICs allows the EIT to promote cross‐fertilisation between its KICs.
The EIT's monitoring system is designed according to the following principles:
The EIT assesses the KICs based on a continuous monitoring system. By ensuring accountability and identifying opportunities to improve operations, the EIT's monitoring system incentivises high quality results, innovation excellence and an efficient use of resources.
The EIT monitoring system evolves with the maturity and growth of the KICs' operations. This adaptive monitoring approach means that the EIT reviews its monitoring practices on a regular basis and adapts them to the evolving context in which both EIT and KICs operate. The adaptive nature of the EIT's monitoring system is essential as the number of KICs grows over time and they develop at different speeds.
While there is a common underlying philosophy to the EIT's monitoring framework, its implementation is suited to the different KICs. This includes a tailor‐made approach per KIC that takes into account the thematic area that it operates in; as each KIC aims at overcoming a particular societal challenge, no two KICs are the same.
How does monitoring work?
The EIT's innovation review system consists of three components: strategy, implementation, and results and impact.
The EIT Governing Board assesses the development and implementation of a KIC's multiannual strategy as well as its contribution to the EIT's overall mission. The strategic assessment examines the integrated portfolio development and management and Knowledge Triangle integration. Conclusions from the assessment at strategy level provide insight into good practices and provide guidance for improving the KIC model. Monitoring the EIT strategy is coupled with the systematic collection of information on result, impact and context indicators.
The EIT has devised a comprehensive set of well‐defined indicators to monitor the implementation of KIC Business Plans. These indicators enable the EIT to measure and communicate its contribution to Horizon 2020 objectives, to control EIT internal processes and to track the performance and progress of the KICs in a standardised manner. The collection of indicators is complemented by on‐site visits by EIT staff to the KICs to verify actions and compliance and to obtain contextual information enabling a proper interpretation and assessment of the information. Surveys are organised to measure the degree of satisfaction of KIC stakeholders and effectiveness of the KIC model (for instance, following the careers of graduates from EIT‐labelled educational programmes).
Results and impact
Returns on EIT investment in the KICs are to be measured in terms of tangible benefits for the European economy and society at large, such as the creation of new businesses, products and services in existing and future markets, contributions to tackling societal challenges, better skilled entrepreneurial people, new and more attractive job opportunities and the attraction and retention of talent from across the Union and abroad. This requires the setting-up of a robust results‐oriented evaluation system for the EIT and its KICs, focusing on achievements, results and the generation of both economic and societal impact to be benchmarked against best international practices.
To have a comprehensive view of the impact brought about by the EIT and the KICs, the EIT evaluation system combines evaluations carried out by the European Commission with assessments of topics of strategic relevance for the EIT performed by the EIT or the European Commission.