Home | Instructional Development | Measurement & Evaluation |

 

Table of Contents

General Description
Test Run For Quest Program


DESCRIPTION AND INTERPRETATION OF
MERMAC SYSTEM QUEST ANALYSIS1

 


General Description


This program is used to summarize item data from questionnaires for which there are no known correct answers. It produces a distribution of the proportion of people answering each response and an optional frequency distribution, weighted mean, and standard deviation for each item. Unless the user indicates otherwise, blank or invalid responses are ignored if the mean is computed. The weight values that are applied to each response for computing item means may be positive or negative numbers or decimal fractions. The "best" alternative for each item, the one receiving the highest weight in computing the mean, also is indicated. The program optionally may print the items to the left of the response distributions.

The QUEST analysis is produced for the entire sample. It may also be broken down by different independent variables, such as discussion sections within a course.

Various items may be grouped together to produce up to 20 "subscales." Any item may contribute to one or more subscales and may be weighted differently in each. A mean is calculated for each subscale, independently of item means, as well as the standard deviation, coefficient alpha reliability, and the proportion of subjects responding to the contributing items.

A separate proportion distribution with labeling may be provided for up to 15 "group items," such as sex, grade, or status, which usually cannot be weighted reasonably. Means and standard deviations may be provided for these demographic items.


Interpretation of Output

The printout from the QUEST program has three parts. The "group item" printed on the top of the output is optional; it contains descriptive information about the group which usually cannot be weighted reasonably. In the example, sex is the group information variable; 13% of the sample are female, 63% are male, and 24% did not indicate their sex.


1Abstracted with modifications from MERMAC Manual, Test and Questionnaire Analysis, Programs Written for the IBM System/360, University of Illinois Press: Urbana, 1971.


The center portion of the printout summarizes the responses to the questionnaire items and also may print the items to the left of the responses. The questionnaire itself consists of statements to which the students could respond Strongly Agree (SA) Agree (A) Disagree (D) Strongly Disagree (SD). The proportion and frequency responding to each alternative and the proportion and frequency omitting are indicated for each item. The most desirable or favorable response is indicated under Best. This Best response indicates the weighting scheme for computing item means applied to the alternatives. In this case, when SA is the best response, the weighting scheme is SA = 4, A = 3, D = 2, E = 1; and when SD is the most favorable response, SA = 1, A = 2, D = 3, SD = 4. That is, the higher the mean, the more favorable are the respondents to that item.


The optional subscale data indicate how many items were included in the overall subscale (ITEMS), the proportion of students who responded to the items in the subscale (P/RES), the mean, the standard deviation (S.D.) or measure of the dispersion of the scores, and the coefficient alpha reliability (REL). N-01 indicates the decile for the subscale mean in one norm sample distribution.

Table of Contents


  * * *  MERMAC -- TEST ANALYSIS AND QUESTIONNAIRE PACKAGE  * * *

                     TEST RUN FOR QUEST PROGRAM

                                 SEX
                         FEMALE  MALE   OMIT
                          0.13   0.63   0.25
                            2     10      4

ITEM      SA       A       D      SD     OMIT    BEST    MEAN    S.D.

 1.      0.25    0.44    0.06    0.13    0.13     SA     2.93    0.95

	   4       7       1       2       2			

 2.      0.13    0.00    0.38    0.35    0.13     SD     3.14    0.68

	   2       0       6       6       2			

 3.      0.06    0.50    0.19    0.13    0.13     SA     2.57    1.01

	   1       8       3       2       2			

 4.      0.06    0.44    0.25    0.13    0.13     SA     2.50    0.80
	  
           1       7       4       2       2			

 5.      0.56    0.25    0.06    0.00    0.13     SA     3.57    0.70

	   9       4       1       0       2			

 6.      0.38    0.31    0.13    0.06    0.13     SA     3.14    0.85

	   6       5       2       1       2			

 7.      0.44    0.25    0.06    0.00    0.25     SA     3.50    0.81

	   7       4       1       0       4			

 8.      0.06    0.44    0.25    0.06    0.19     SA     2.38    0.80

	   1       7       4       1       3			

 9.      0.19    0.44    0.13    0.06    0.19     SA     2.92    0.70

	   3       7       2       1       3			

10.      0.00    0.19    0.63    0.06    0.13     SD     2.86    0.89

	   0       3      10       1       2			


Table of Contents

 

 

 

 

  Kathy Duvall
Measurement and Evaluation
Room 247 Armory,  MC-528
505 East Armory Avenue Champaign, IL 61820
(217) 333-3490,   e-mail kuvall@uiuc.edu
University of Illinois

at  Urbana-Champaign