Integrating quantitative and qualitative methodologies to build a national R&D plan using data envelopment analysis based on R&D stakeholders' perspectives.

The yearly increase in government R&D investment and top-down national R&D investment allocation requires a more quantitative decision-making system that maximizes R&D performance and efficient budget allocation. Sound decision-making is necessary at both the selection stage and the pursuit stage in order to maximize limited national R&D resources. We study Korean smart farms as an example to examine national R&D investment from the various R&D actors (academia, industry, and research institutes) perspectives. The objective of our research is to evaluate the theoretical efficiency of R&D investment on specific technologies in smart farms and compare the results with expert opinions where the reality is reflected. To be specific, our study is to provide the quantitative approach in making decision among policymakers by reflecting the field experiences and opinions. We use a data envelopment analysis with an assurance region model, which integrates an analytic hierarchy process and a data envelopment analysis. The weights of output in DEA model by the R&D actors are similar to the overall weight by all actors, implying that investment allocation decisions in the smart farm sector are not significantly affected by the R&D actors. We realized that the relative efficiency of some R&D technologies increases after reflecting qualitative ideas of experts. In reality, it is necessary to invest in these technology groups, but they excluded from top-down decision-making. This also shows that a government's top-down decision-making can distort its investment allocation. This study proposes a new approach to compensate for the difference between theoretical virtual prices and actual prices in data envelopment analysis. In particular, when comparing the only quantitative results on investment priorities with analysis results by additionally reflecting the opinions of experts in each sector, we found that the Korean government's investment priorities in the smart farm field are considerably distorted. Therefore, this study is expected to be used as an alternative for policy makers to compensate for the quantitative distortion might be caused by top-down national R&D investment decisions.