Evaluation Methodology of Polish National Multiyear Research Programme in the Area of Technical Solutions – Case Study - Polish Journal of Management Studies

Search
Polish Journal of Management Studies
 ISSN 2081-7452
Go to content

Main menu:

Evaluation Methodology of Polish National Multiyear Research Programme in the Area of Technical Solutions – Case Study

Abstracts > Vol 10.1

EVALUATION METHODOLOGY OF POLISH NATIONAL MULTIYEAR RESEARCH PROGRAMME IN THE AREA OF TECHNICAL SOLUTIONS CASE STUDY
Walaszczyk L.

Abstract: The article provides the results of the practical application of evaluation methodology in the Development of Innovative Systems of Manufacturing and Maintenance 2004-2008 (PW-004) multiyear strategic research programme in the area of technical solutions. Findings from this study indicate the evaluation criteria and methods used at different stages and levels of evaluation project, thematic area and the entire programme levels. The author indicates the importance of the evaluation process, which contributed to the achievement of the practical results in the programme. However, the author also underlines shortcomings of the methodology and identifies additional elements needed to make the evaluation methodology complex.
Key words:
evaluation, strategic research programme, technical innovations, evaluation methods, evaluation criteria.

Introduction

The development of knowledge based economy requires direct scientific research to the areas, which have the greatest influence on the economic and social development of a country (Asheim et al., 2007; Hsu et al., 2008; Hudson, 2011). Strategic research programmes are the foundation of the development based economy through the introduction of new technologies and advanced materials (Godin, 2003; Maskell, 2009; Smith, 2010). One of such programmes is the Development of Innovative Systems of Manufacturing and Maintenance 2004-2008 (PW-004) – national multiyear strategic research programme, co-ordinated by the Institute for Sustainable Technologies
National Research Institute in Radom and executed by about 75 research institutions (i.e. universities, research institutes). The main objective of the Programme was to create the system conditions and generate technical and organisational innovative solutions in the area of advanced products and technology of production (Mazurkiewicz et al., 2009). As the PW-004 Programme was high-budgeted, therefore one of the essential elements of its realisation was the evaluation of the results due to the selection of the most efficient ways of management and the usage of the results of the Programme.


full version

Concluding remarks
As a result of the PW-004 programme, 327 new solutions were developed (59 patented), including: 142 original apparatus solutions (mainly machines and devices), 111 production technologies and 74 original system solutions (among others control and automation systems) and more than 300 articles in national and international journals were published. What is more, the method for the verification of the implementation maturity level of the technical solutions (SDW) was developed (Mazurkiewicz et al., 2010), which is currently being verified and modified within the “Innovative Technical Support Systems for Sustainable Economic Development” Strategic Research Programme.
The realisation of the national PW-004 programme was a success, however the evaluation process was based only on the experience of the management staff who did not use the complex methodological approach. There was no methodology for the selection of the evaluation type to the programme level. The evaluation operations were only concentrated on the scientific and the technical levels of the solutions and their applicability, but there was a lack of tools enabling precise assessment of technological solutions developed in the programme, among others, the implementation maturity level, the innovativeness level, the implementation risk and the commercial potential. Evidently, the innovativeness was one of the criteria of the evaluation process, however the specific method for the measurement of the aspect was not applied.
In order to successfully evaluate the forthcoming strategic programmes, it seems reasonable to design a complex methodology, which would enable the identification of many aspects as the assessment of technological solutions considering among others innovativeness, implementation maturity and commercial potential aspects and the decision making on the introduction of changes within the tasks undertaken.
The complex methodology should have a multi-level structure, enabling the conduction of the evaluation on selected levels of the strategic programme and engaging the management staff, the internal experts, the external experts and the authors of technological solutions in the evaluation process. Moreover, the methodology should have an open character enabling the consideration of additional elements, if needed, or the rejection of some of them.
This research was financed by the European Union funds within the Innovative Economy Operational Programme (POIG.01.01.02-14-034/09 “Innovative Systems of Technical Support for Sustainable Development of Economy” Strategic Programme).

References
Arnold E. (ed.), 2008, Mid-term Evaluation of the Competence Centre Programme, Final report, Tallinn.
Asheim B., Coenen L., Moodysson J., Vang J., 2007, Constructing knowledge-based regional advantage: implications for regional innovation policy, “International Journal of Entrepreneurship and Innovation Management” 7 (2-5).
Avellan F., Cederwall K., Hartmann R., 2002, Hydraulic Turbine Research Programme. Evaluation report, Stockholm.
Gamota G. (ed.), 1999, Japan’s ERATO and PRESTO Basic Research Programs, http://www.wtec.org/pdf/erato.pdf, Access on 08.06.2014.
Giesko T., 2009, Mechatronic technologies and control systems. [in:]: Mazurkiewicz A. (ed.) Technological Innovations for Sustainable Development, Radom – Tel Aviv.
Godin B., 2003, The knowledge-based economy: conceptual framework or buzzword? “The Journal of Technology Transfer” 31 (1).
Henry N., Leather J., 2008, PARD – Third Interim Programme Report. Advantage West Midlands.
Hsu J.Y., Hsing-Lin Y., Yi-Wei Z., 2008, Competition policy for technological innovation in an era of knowledge based economy, “Knowledge Based Systems” 21 (8).
Hudson R., 2011, From knowledge-based economy to… knowledge-based economy? Reflections on changes in the economy and development policies in the North East of England, “Regional Innovation Systems: Theory, Empirics and Policy” 45 (7).
Independent Administrative Institute Japan Science Technology Agency Office of Basic Research, Invitation for Application of Research Proposals. Application guideline. Volume 2. CREST Type Second Term (New Research Areas) PRESTO Type (All Research Areas) 2007, http://www.jst.go.jp/kisoken/boshuu/h19/boshuu/jigyou/en/guidelines/guidelineh19.pdf, Access on: 08.06.2014.
Ingwersen P., Larsen B., 2007, Evaluation of strategic research programs: the case of Danish environmental research 1993-2002, “Research Evaluation” 16 (1).
Jakobsen L., Erdal T., Knudsen P.E., Hvidberg M., 2002, Evaluation of the Programme for Interdisciplinary Materials Research Consortia, Case report, Oxford Research.
Koponen P., Kalander J.K., Kursisto M., 2008, FinNano Programme. Intermediate evaluation. Helsinki.
Malecki E., 1991, Technology and Economic Development: The Dynamics of Local, Regional, and National Change. Longman, London.
Maskell P., 2009, Towards a knowledge-based theory of the geographical cluster, [in:] Martin R. (ed.) “The Economy: Critical Essays in Human Geography”, London.
Mazurkiewicz A. et al., 2009, Sprawozdania z realizacji projektów badawczych zamawianych (PBZ) objętych Programem Wieloletnim PW-004 pn. Doskonalenie systemów rozwoju innowacyjności w produkcji i eksploatacji w latach 2004-2008, Radom, ITeE-PIB.
Mazurkiewicz A., Karsznia W., Giesko T., Belina B., 2010, Metodyka oceny stopnia dojrzałości wdrożeniowej innowacji technicznych, [in:] Problemy Eksploatacji 1/2010, Radom, ITeE-PIB.
Performance Management Network Inc., h2 Early Adopters Program (h2EA) – six months progress report 2004 http://ito.ic.gc.ca/eic/site/itooti.nsf/vwapj/6month_progress_report_e.pdf/$FILE/6month_progress_report_e.pdf, Access on: 08.06.2014.
Polish Agency for Enterprise Development, 2010, Ocena efektywności i skuteczności programu Bon na innowacje, Final report, Warszawa.
Rezendes L., 1994, Advanced Technology. Proposal Review Process and Treatment of Foreign-owned Businesses, http://archive.gao.gov/t2pbat4/150663.pdf, Access on: 08.06.2014.
Rossi P.H., Lipsey M.W., 2004, Evaluation. A systematic approach, Sage publication, London.
Smith K., 2000, What is the knowledge economy? Knowledge intensive industries and distributed knowledge Bases, Project ‘Innovation Policy in a Knowledge-Based Economy’ commissioned by the European Commission, Oslo.
TEKES, 2006, PINTA – Clean Surfaces. 2002-2006, Technology Programme Report 17/2006, Helsinki.


METODOLOGIA OCENY POLSKIEGO NARODOWEGO WIELOLETNIEGO PROGRAMU BADAŃ W DZIEDZINIE ROZWIĄZAŃ TECHNICZNYCH - STUDIUM PRZYPADKU


Streszczenie: W artykule zaprezentowano wyniki praktycznego zastosowania metodyki ewaluacji w ramach krajowego wieloletniego programu strategicznego w obszarze innowacji technicznych Doskonalenie systemów rozwoju innowacyjności w produkcji i eksploatacji w latach 2004-2008 (PW-004). Wskazano kryteria i metody zastosowane na różnych etapach i poziomach ewaluacji – poziomie projektu badawczego, poziomie grupy tematycznej oraz poziomie programu strategicznego w ujęciu całościowym. Autor podkreśla istotę procesu ewaluacji, którego wyniki przyczyniają się do osiągania praktycznych rezultatów zaplanowanych w programie. Jednakże, wskazuje również na braki w metodyce i identyfikuje dodatkowe elementy niezbędne do wprowadzenia, aby ewaluacja uzyskała charakter kompleksowy.

Słowa kluczowe: ewaluacja, strategiczny program badawczy, innowacje techniczne, metody ewaluacja, kryteria ewaluacja.


波蘭國家評估方法長的節目在研究技術解決方案領域 – 案例研究

摘要:本文介紹了評價方法創新製造系統開發和維護的實際應用,在20042008年(PW004)科學研究的技術解決方案領域的多年度戰略計劃的結果。研究結果表明,在不同的階段和評估水平所使用的評估標準和方法該項目,主體區和整個節目的水平。作者指出的評估過程,這有助於實現該計劃的實際成果的重要性。不過,筆者也強調該方法的缺點,並確定必要的額外的元素,創造一個複雜的評估方法
关键字:評估,戰略研究計劃,技術創新,評價方法,評價標準





 
Back to content | Back to main menu