Dimitrov Dimiter M, Raykov Tenko, Al-Qataee Abdullah Ali
George Mason University, Fairfax, VA, USA.
National Center for Assessment in Higher Education, Riyadh, Saudi Arabia.
Educ Psychol Meas. 2015 Jun;75(3):475-490. doi: 10.1177/0013164414543179. Epub 2014 Jul 14.
This article is concerned with developing a measure of general academic ability (GAA) for high school graduates who apply to colleges, as well as with the identification of optimal weights of the GAA indicators in a linear combination that yields a composite score with maximal reliability and maximal predictive validity, employing the framework of the popular latent variable modeling methodology. The approach to achieving this goal is illustrated with data for 6,640 students with major in Science and 3,388 students with major in Art from colleges in Saudi Arabia. The indicators (observed measures) of the targeted GAA construct were selected from assessments that include the students' high school grade and their scores on two standardized tests developed by the National Center for Assessment in Higher Education in Saudi Arabia, General Aptitude Test (GAT) and Standardized Achievement Admission Test (SAAT). A unidimensional measure of GAA was developed initially, with different sets of indicators for colleges with major in Science and for colleges with major in Art. Appropriate indicators for colleges with major in Science were the high school grade, total score on GAT, and four SAAT subscales on Biology, Chemistry, Physics, and Math. With respect to colleges with major in Art, appropriate GAA indicators were the students' high school grade and their scores on GAT-Verbal, GAT-Quantitative, and SAAT. Although the case study is Saudi Arabia, the methods and procedures discussed in this article have broader utility and can be used in different contexts of educational and psychological assessment.
本文关注的是为申请大学的高中毕业生开发一种通用学术能力(GAA)的测量方法,以及在流行的潜在变量建模方法框架下,确定GAA指标在一个线性组合中的最优权重,该线性组合能产生具有最大可靠性和最大预测效度的综合分数。通过沙特阿拉伯各大学6640名理科专业学生和3388名文科专业学生的数据,阐述了实现这一目标的方法。目标GAA结构的指标(观测测量)是从评估中选取的,这些评估包括学生的高中成绩以及他们在沙特阿拉伯高等教育评估中心开发的两项标准化考试中的成绩,即一般能力测试(GAT)和标准化成绩入学考试(SAAT)。最初开发了一种GAA的单维测量方法,理科专业大学和文科专业大学有不同的指标集。理科专业大学的合适指标是高中成绩、GAT总分以及SAAT在生物、化学、物理和数学方面的四个子量表。对于文科专业大学,合适的GAA指标是学生的高中成绩以及他们在GAT语言、GAT定量和SAAT上的成绩。尽管案例研究是沙特阿拉伯的,但本文讨论的方法和程序具有更广泛的实用性,可用于教育和心理评估的不同背景中。