Best Practices in Assessment of Research and Development Organizations: Summary of a Workshop

by National Research Council, Division on Engineering and Physical Sciences, Laboratory Assessments Board

The National Institute of Standards and Technology (NIST)-recognizing that information and insights gained through continual examination of practices for organizational assessment are useful for decision makers at organizations across the deferral, industrial, academic, and national laboratory sectors-recently requested that the National Research Council (NRC) organize a panel to review best practices in assessment of research and development (R&D) organizations. In response, the NRC established the Panel for Review of Best Practices in Assessment of Research and Development Organizations. The panel was charged to consider means of assessing the following in a manner that satisfies the requirements of NIST to perform effective assessments but also identifies assessment methods that can be applied selectively to other R&D organizations. These methods technical merit and quality of the science and engineering work, the adequacy of the resources available to support high-quality work, the effectiveness of the agency's delivery of the services and products required to fulfill its goals, the degree to which the agency's current and planned R&D portfolio supports its mission, as well as the agency's flexibility to respond to changing economic, political, social and technological contexts. As one means of data gathering, among others that the panel is performing toward development of a final report of its findings, the panel organized a planning committee for a workshop on best practices in assessment of R&D organizations. Best Practices in Assessment of Research and Development Summary of a Workshop reviews the workshop conducted at the Keck Center of the National Academies in Washington, D.C., on March 19, 2012.

52 pages, Paperback

First published September 28, 2012

About the author

The National Research Council (NRC) functions under the auspices of the National Academy of Sciences (NAS), the National Academy of Engineering (NAE), and the Institute of Medicine (IOM). The NAS, NAE, IOM, and NRC are part of a private, nonprofit institution that provides science, technology and health policy advice under a congressional charter signed by President Abraham Lincoln that was originally granted to the NAS in 1863. Under this charter, the NRC was established in 1916, the NAE in 1964, and the IOM in 1970. The four organizations are collectively referred to as the National Academies.

The mission of the NRC is to improve government decision making and public policy, increase public education and understanding, and promote the acquisition and dissemination of knowledge in matters involving science, engineering, technology, and health. The institution takes this charge seriously and works to inform policies and actions that have the power to improve the lives of people in the U.S. and around the world.

The NRC is committed to providing elected leaders, policy makers, and the public with expert advice based on sound scientific evidence. The NRC does not receive direct federal appropriations for its work. Individual projects are funded by federal agencies, foundations, other governmental and private sources, and the institution’s endowment. The work is made possible by 6,000 of the world’s top scientists, engineers, and other professionals who volunteer their time without compensation to serve on committees and participate in activities. The NRC is administered jointly by the NAS, NAE, and the IOM through the NRC Governing Board.

The core services involve collecting, analyzing, and sharing information and knowledge. The independence of the institution, combined with its unique ability to convene experts, allows it to be responsive to a host of requests.

The portfolio of activities includes:

* Consensus Studies: These comprehensive reports focus on major policy issues and provide recommendations for solving complex problems.
* Expert Meetings and Workshops: By convening symposia, workshops, meetings, and roundtables, the NRC connects professionals as well as the interested public and stimulates dialogue on diverse matters.
* Program and Research Management: At the request of state and federal agencies, the NRC manages and evaluates research programs, conducts program assessments, and reviews proposals.
* Fellowships: The NRC administers several postdoctoral fellowship programs.

Free Scientific Information: Publishing more than 200 reports and related publications each year, the institution is one of the largest providers of free scientific and technical information in the world. Most of it is now on the Web at www.nap.edu.