Next Steps for Timss: Directions for Secondary Analysis

by National Research Council, Division of Behavioral and Social Sciences and Education, Board on Testing and Assessment

Now that the initial results of The Third International Mathematics and Science Study (TIMSS) have been released, the Board on International Comparative Studies in Education (BICSE) has turned its attention to what happens next. The TIMSS data are potentially useful to researchers, policy makers, practitioners, and others interested in evidence regarding factors that influence student learning. But although the study has produced a remarkable volume of intriguing data, it is by no means complete. Scholarly review of the initial data, evaluations of claims based on the data, and follow-up secondary analysis based on the primary findings are all integral parts of a study of this magnitude, but the bulk of this very important work has not yet begun. Because of the board's serious concern that this necessary work has not been undertaken, or funded, it held a workshop on June 17 and 18, 1998, to explore different perspectives on possible next steps. The workshop was an invaluable opportunity for the board to explore issues and questions it has addressed over the years and to solidify its thinking about many of them. Because the board is convinced of the importance of moving forward with the TIMSS data, it presents in this report both recommendations as to what ought to be done and many of the innovative specific ideas that emerged from the workshop. These recommendations reflect the board's conviction, based on its many years of involvement with and deliberations about TIMSS, that this study is an extremely rich resource for the policy, scholarly, and practice communities, and that all of these groups have a responsibility to take full advantage of it. The recommendations and discussion in this report are intended to assist both researchers and funders who are considering further work with TIMSS, and a broader audience of researchers, policy makers, practitioners, and others who have followed the TIMSS results and are eager to use them. This report is, in a sense, the culmination of many years of effort for the board.

51 pages, Paperback

First published January 1, 1999

About the author

The National Research Council (NRC) functions under the auspices of the National Academy of Sciences (NAS), the National Academy of Engineering (NAE), and the Institute of Medicine (IOM). The NAS, NAE, IOM, and NRC are part of a private, nonprofit institution that provides science, technology and health policy advice under a congressional charter signed by President Abraham Lincoln that was originally granted to the NAS in 1863. Under this charter, the NRC was established in 1916, the NAE in 1964, and the IOM in 1970. The four organizations are collectively referred to as the National Academies.

The mission of the NRC is to improve government decision making and public policy, increase public education and understanding, and promote the acquisition and dissemination of knowledge in matters involving science, engineering, technology, and health. The institution takes this charge seriously and works to inform policies and actions that have the power to improve the lives of people in the U.S. and around the world.

The NRC is committed to providing elected leaders, policy makers, and the public with expert advice based on sound scientific evidence. The NRC does not receive direct federal appropriations for its work. Individual projects are funded by federal agencies, foundations, other governmental and private sources, and the institution’s endowment. The work is made possible by 6,000 of the world’s top scientists, engineers, and other professionals who volunteer their time without compensation to serve on committees and participate in activities. The NRC is administered jointly by the NAS, NAE, and the IOM through the NRC Governing Board.

The core services involve collecting, analyzing, and sharing information and knowledge. The independence of the institution, combined with its unique ability to convene experts, allows it to be responsive to a host of requests.

The portfolio of activities includes:

* Consensus Studies: These comprehensive reports focus on major policy issues and provide recommendations for solving complex problems.
* Expert Meetings and Workshops: By convening symposia, workshops, meetings, and roundtables, the NRC connects professionals as well as the interested public and stimulates dialogue on diverse matters.
* Program and Research Management: At the request of state and federal agencies, the NRC manages and evaluates research programs, conducts program assessments, and reviews proposals.
* Fellowships: The NRC administers several postdoctoral fellowship programs.

Free Scientific Information: Publishing more than 200 reports and related publications each year, the institution is one of the largest providers of free scientific and technical information in the world. Most of it is now on the Web at www.nap.edu.