Home | Instructional Development | Measurement & Evaluation |

 

1998 Summary

The Chancellor’s Senior Survey on the Undergraduate Experience at UIUC

by John C. Ory

For a printed, bound copy of this report, please contact the
Center for Teaching Excellence, 249 Armory Bldg.

In 1989, a task force appointed by the Chancellor created a questionnaire to be administered to all graduating seniors at UIUC. The results of the survey, the Chancellor said, "will be useful in responding to requests for information on how our students feel about the educational experience they have had as undergraduates here and in identifying problems on campus which need our attention." The survey was administered each year from 1990 to 1993. Due to the consistency of results the survey was not administered again until 1996.

The 1996 survey was modified to include a section of items asking students to assess their entering and exiting abilities. Due to the usefulness of this new section for campus initiatives involved in the assessment of student outcomes, the campus decided to restart annual administrations of the survey.

For the first time the Senior Survey was administered electronically in 1998. In March 1998 an e-mail message regarding the Senior Survey was sent to all seniors on the May graduation list. The e-mail message from the Chancellor asked students to complete the survey posted on a university Web-site. Ten days following the initial e-mail message a follow-up message was sent reminding students to complete the survey. Survey respondents were entered into a lottery with a single prize of two free airline tickets valued at $500 each. Of these 4,200 seniors, 1,683, or approximately 40%, responded. Similar to past years, the respondents were roughly representative of the graduating class by gender, ethnic origin, and academic affiliation as indicated below.

 

 

Percentage of Respondents All Seniors

 

Gender    
Male 48.2 48.6
Female 51.8 48.1
Ethnic Origin    
Caucasian 78.0 75.9
Hispanic/Latino 3.3 4.4
African-American 4.0 5.3
Asian-American 13.6 12.5
Native American .0 0.3
Unknown 1 1.1 1.8

 

College of Graduation    
ACES 7.0 7.4
Applied Life Studies 3.4 4.0
CBA 19.1 15.1
Communications 2.9 3.4
Education 1.8 3.3
Engineering  20.1 15.6
Fine & Applied Arts 5.8 7.8
Liberal Arts & Sciences 35.8 41.5

Care should be taken in interpreting the results of the survey because the small number of respondents in some sub-categories makes the results statistically unreliable. This summary presents highlights of the data following the general order of the survey, a copy of which is attached to this report. A "Comparison to Previous Years" section at the end of the summary presents yearly comparisons of survey results.

 

Demographics

Survey respondents present a picture of a very traditional student body, with large majorities enrolling as freshmen and completing a bachelor’s degree in eight semesters at age 21 or 22. The respondents were 79% Caucasian and

92% Illinois residents. Approximately 4% more females than males responded to the survey.

Academically, 70% of the respondents self-assessed their grade-point average as between 2.75 and 3.75. Approximately 50% of the students never changed their major, while another 38% changed majors once. Approximately 40% of the respondents reported working each semester part-time while another 40% reported working "occasionally" part-time. Approximately 70% of the respondents worked during the summer.

 

First enrolled at UIUC as:

Number of times you changed major while at UIUC:

wpe1.jpg (15443 bytes)

 

Did you change your career choice?

Did you participate in volunteer or community service work?

Did you seek personal counseling?

Do you have a disability?

Number of semesters it took to complete your degree:

wpe3.jpg (15954 bytes)

Current age:

wpe4.jpg (16268 bytes)

Gender:

Ethnic origin:

wpe5.jpg (16259 bytes)

Approximate GPA:

wpe6.jpg (16814 bytes)

Citizenship:

wpe7.jpg (15184 bytes)

Employment while undergraduate*:

wpe8.jpg (17712 bytes)

* Totals more than 100% because some students worked both summers and part- or full-time during school year.

 

Satisfaction with broad aspects of the undergraduate experience

The survey asked about senior satisfaction in three broad categories, and then, in a brief fourth section, about the overall experience at UIUC. Students were asked to choose from a five-point Likert scale, ranging from one for lowest satisfaction to five for highest satisfaction. The broad categories were:

Teaching and educational environment included 18 questions on the quality of teaching and facilities, access to courses and faculty, class size, and teachers’ evaluation of students.

Campus environment included 13 questions on racism, sexism, welcome, help, and atmosphere.

Self-assessment of entering and exiting abilities required students to assess their entering and exiting competency levels in 20 abilities, including writing, speaking, organizing time, and using technology.

Overall undergraduate experience included four questions: satisfaction with the overall educational experience at UIUC, current attitude toward UIUC, attitude toward the respondent’s major, and what the respondent would do given the chance to start all over again.

The categories were an organizational device, making it inadvisable to seek generalizations, such as "students were satisfied overall with the campus environment." Instead, the summary will attempt to point out noteworthy responses to individual questions. Before going into the categories individually, a

graphic overview of the average ratings for all teaching, educational, and campus items is presented below.

 

Teaching and educational environment

Mean Frequency %

Low                                                         High

  1 2 3 4 5 6
1. Quality of teaching by faculty in your major   3.9   2   6   18   48   27
2. Quality of teaching by faculty outside your major   3.5   1   7   38   47   8
3. Quality of teaching by TAs    3.3   3   13   41   37   6
4. Quality of laboratories and classrooms   3.5   2   10   37   40   11
5. Quality of academic program advising and information   3.0   14   23   27   26   12
6. Quality of career advising and information   3.0   13   20   29   27   11
7. Access to courses and course sections in major   4.0   2   7   17   40   34
8. Access to elective courses and course sections   3.5   4   13   30   37   16
9. Process of student evaluation of teaching   3.1   8   18   34   31   9
10. Class size at the 100 and 200 course level   3.1   7   19   36   30   8
11. Class size at the 300 course level   4.1   2   4   13   42   40
12. Overall educational philosophy of your major   3.8   3   8   21   44   23
13. Fairness of student performance evaluation procedures   3.7   1   6   26   53   13
14.  Usefulness of student evaluation procedures in assisting students to learn 3.3   3   15   38   39   6
15. Quantity of faculty office hours    3.7   2   10   29   41   18
16. Faculty members’ presence during posted office hours   4.0   1   5   21   42   31
17. Accessibility of faculty in general   3.8   1   8   25   43   23
18. Communication between faculty and students regarding student needs and concerns   3.4   4   13   33   36   14

For all respondents, the items with the highest satisfaction ratings in this section were:

4.1: Class size at the 300 course level.

4.0: Access to courses and course sections in major.

4.0: Faculty members’ presence during posted office hours.

3.9: Quality of teaching by faculty in your major.

For all respondents, the items with the lowest satisfaction ratings in this section were:

3.0: Quality of academic program advising and information.

3.0: Quality of career advising and information.

3.1: Class size at the 100 and 200 course level.

3.1: Process of student evaluation of teaching.

 

Campus environment

                                                                                            Mean Frequency %

Low          High

19. It was easy to meet and get to know other students   3.7   3   11   23   36   27
20. It was easy to get involved in student groups and activities   4.0   1   7   21   36   35
21. There was exposure to different student backgrounds and cultures   3.9   2   9   19   35   35
22a. The classroom environment was free from racist behavior   4.1   2   6   16   34   41
22b. The classroom environment was free from sexist behavior   3.9   3   8   20   35   34
23a. The campus environment was free from racism   3.0   11   22   30   26   11
23b. The campus environment was free from sexism   3.4   6   16   31   32   16
24a. The University appropriately addressed problems of racism   3.3   11   14   29   28   19
24b. The University appropriately addressed problems of sexism   3.5   6   10   31   32   22
25. You felt you were welcome at UIUC   4.1   2   5   17   38   38
26. You had someone (University employee) that you could go to for help   3.4   13   14   23   25   26
27. The "University" cared about you   2.6   21   24   33   17   6
28. You felt safe on campus    3.6   3   10   26   42   19

 

For all respondents, the items with the highest satisfaction ratings in this section were:

4.1: The classroom environment was free from racist behavior.

4.1: You felt that you were welcome at UIUC.

4.0: It was easy to get involved in student groups and activities.

3.9: The classroom environment was free from sexist behavior.

3.9: There was exposure to different student backgrounds and cultures.

For all respondents, the items with the lowest satisfaction ratings in this section were:

2.6: The "University" cared about you.

3.0: The campus environment was free from racism.

There was a noticeable difference between the ratings on the items asking if the classroom was free from racist behavior (4.1) and if the campus was free from racism (3.0). The graphs below show some of the variation by ethnic background on these questions. (Please note, as previously indicated, that survey respondents underrepresented African-American and Hispanic/Latino respondents. The number of respondents by ethnic origin is 1,313 Caucasian, 229 Asian-American, 67 African-American, 57 Hispanic/Latino, and one Native American.)

 

22a. The classroom environment was free from racist behavior.

wpe9.jpg (19823 bytes)

**No average provided due to having only one respondent.

 

23a. The campus environment was free from racism.

wpeA.jpg (17600 bytes)

24a. The University appropriately addressed problems of racism.

wpeB.jpg (18163 bytes)

Men and women disagreed about the extent of sexism on campus and the university’s attempt to address the problem.

 

22b. The classroom environment was free from sexist behavior.

23b. The campus environment was free from sexism.

24b. The University appropriately addressed problems of sexism.

 

Comparison of Entering and Exiting Abilities

wpeC.jpg (27604 bytes)The respondents reported increases in their entering competency levels for all but one ("Communicate in a language other than English") of the abilities listed. The abilities with the greatest difference between entering and exiting competency levels were:

+1.6 Effectively use technology (e.g., computers, high tech equipment)

+1.1 Draw conclusions after weighing evidence, facts, and ideas

+1.0 Locate, screen, and organize information

+.9 Speak effectively

+.9 Understand and appreciate cultural and ethnic differences

+.9 Problem solving skills

 

 

Overall undergraduate experience

                                                                                                                                                Mean Frequency %

                                                                                                                                                        Low High

                                                                                                                                1              2              3              4                  5

49. Your major at UIUC   4.0   3   6   15   38   38
50. Your overall educational experience at UIUC   4.0   1   4   17   49   28
51. Your TOTAL experience at UIUC    4.2   1   3   15   40   42
52. If you could start all over again, would you:
- attend UIUC again?   84%
- attend another institution?   16%
- not attend college?   0%
- take same major?   62%

All of the overall experience items received high satisfaction ratings in this section. There were some variations in the overall quality ratings by ethnic background, as shown in the graphs below. Asian-American and African-American respondents gave slightly lower overall ratings than did other students.

49. Please rate your major at UIUC:

wpeD.jpg (23753 bytes)

 

50. Your overall educational experience at UIUC:

wpeE.jpg (23814 bytes)

51. Your TOTAL experience at UIUC:

wpeF.jpg (24489 bytes)

52. If you could start all over again, would you ...

attend UIUC again? (percent indicating yes):

wpe10.jpg (25472 bytes)

Aspects of the University that were most helpful to your pursuit of an education at UIUC

Of the 1,683 graduating seniors responding to the Senior Survey, 1,067 (64%) responded to this item. A summary of their responses is provided below. (One percent represents approximately 11 students.)

Comment   % of responses
Access to technology   17
Variety of course offerings   13
Excellence of faculty   13
Helpfulness of faculty/staff   13
Excellence of college/department/program    11
Facilities/Resources   11
Extracurricular activities/organizations    9
Peers/Other students   7
Libraries   6
Vast amount of opportunities   6
Cultural diversity   5
Diversity   5
Size of campus   4
Advisors   4
Cost   4
Reputation of UIUC   3
Learning environment   3
Undergraduate research   2
Study abroad   2
Greek system   2
Competition   2
Career/College placement office   2
Smaller classes at upper levels   1

Aspects of the university that were obstacles to your pursuit of an education at UIUC

Of the 1,683 graduating seniors responding to the Senior Survey, 994 (59%) responded to this item. A summary of their responses is provided below. (One percent represents approximately 10 students.)

Comment   % of responses
Poor or non-existent academic advising    16
Poor teaching by professors   16
University too large/ "felt like a number"   12
Classes too large   9
Too much bureaucracy/red tape   9
Professors not caring/helpful   7
Program requirements (courses, GPA, hours)    7
Difficulty in getting desired courses    6
Lack of adequate facilities   6
Poor teaching by TA’s   4
Sexual discrimination/Race issues    4
Poor curriculum/program   4
Unavailability of professors   3
Non-relevant classes   3
Couldn’t understand foreign TA’s    2
Emphasis on research at the expense of teaching   2
Unfair/poor grading   2
Debate over the chief   2
Peers   2

 

How has the university changed since your freshman year?

Of the 1,683 graduating seniors responding to the Senior Survey, 981 (58%) responded to this item. A summary of their responses is provided below. (One percent represents approximately 10 students.)

 

Comment   % of responses
More emphasis on technology   21
Facilities/physical plant   21
Chief concerns increased   7
Racism increased   3
Campus is safer   3
University is more commercial   3
University is more expensive   3
Better alcohol management   2
More ethnic diversity   2
Sports (some better, some worse)   2
University seems smaller   2
Campus more focused on race relations    2
Better educational opportunities   1
More crime and violence   1
Campus is friendlier   1
University is more liberal   1

COMPARISON TO PREVIOUS YEAR - Demographics of Respondents

 

This section of the report will compare 1998 Senior Survey results to responses recorded in 1990, 1993, 1996, and 1997. The 40% response rate in 1998 was highest ever for the survey. This year there were slightly fewer African-American and Latino/Hispanic respondents and slightly more Asian-American respondents than in past years. Following are some additional differences among respondents over time.

 

Satisfaction with broad aspects of the undergraduate experience

Following is a listing of item mean scores for common items administered in 1990, 1993, 1996, 1997, and 1998. Overall, there is consistency of student responses over time. However, the upward trend for many of the items in 1996 and 1997 continued in the 1998 data. No single item mean score was lower in 1998 than in 1997 and 18 were higher. Items with increases are marked with a (+) and items with decreases are marked with a (-). Four item means increased by +.2 of a point and three means increased by +.3. These seven items are printed in bold typeface.

1998   1997   1996   1993   1990
3.9   3.9   3.8   3.9   3.8   1. Quality of teaching by faculty in your major
3.5   3.5   3.5   3.5   3.5   2. Quality of teaching by faculty outside your major
3.3+   3.2   3.2   3.2   3.2   3. Quality of teaching by TAs
3.5+   3.4   3.3   3.2   3.3   4. Quality of laboratories and classrooms
3.0   3.0   -   -   -   5. Quality of academic program advising and information
3.0   3.0   -   -   -   6. Quality of career advising and information
4.0   4.0   4.1   3.8   3.8   7. Access to course and course sections in major
3.5   3.5   3.6   3.3   3.5   8. Access to elective courses and course sections
3.1   3.1   3.0   3.0   3.2   9. Process of student evaluation of teaching
3.1   3.1   3.0   2.9   2.9   10. Class size at the 100 and 200 course level
4.1   4.1   4.0   4.0   3.9   11. Class size at the 300 course level
3.8   3.8   3.8   3.8   3.7   12. Overall educational philosophy of major
3.7   3.7   3.7   3.7   3.7   13. Fairness of student performance evaluation procedures
3.3   3.3   3.2   3.1   3.1   14. Usefulness of evaluation procedures to learning
3.7+   3.5   3.5   -   -   15. Quantity of faculty office hours
4.0+   3.9   3.9   -   -   16. Faculty members’ presence during posted office hours
3.8+   3.7   3.6   -   -   17. Accessibility of faculty in general
3.4   3.4   -   -   -   18. Communication between faculty and students regarding student needs and concerns
3.7   3.7   3.7   3.7   3.8   19. Easy to meet and get to know other students
4.0+   3.9   3.8   3.7   3.7   20. Easy to get involved in student groups, activities
3.9+   3.8   3.7   3.7   3.5   21. Exposure to different backgrounds and cultures
4.1+   3.9   3.9   3.7   4.0   22a. Classroom environment free from racist behavior
3.9+   3.7   3.8   3.6   3.8   22b. Classroom environment free from sexist behavior
3.0+   2.9   2.8   2.5   2.9   23a. Campus environment free from racism
3.4+   3.2   3.3   3.0   3.0   23b. Campus environment free from sexism
3.3+   3.2   3.1   3.0   3.2   24a. University appropriately addressed racism
3.5+   3.4   3.4   3.2   3.2   24b. University appropriately addressed sexism
4.1+   3.8   3.8   3.7   3.8   25. Felt that you were welcome at UIUC
3.4+   3.2   3.3   3.2   3.1   26. Had someone you could go to for help
2.6+   2.5   2.5   2.3   2.3   27. "University" cared about you
3.6+   3.3   3.1   3.2   3.3   28. You felt safe on campus
4.0   4.0   4.0   4.1   3.9   49. Please rate your major at UIUC
4.0   4.0   4.0   4.0   3.9   50. Your overall educational experience at UIUC
4.2+   4.1   4.0   3.9   3.8   51. Your TOTAL experience at UIUC

Student Ratings of Entering and Exiting Abilities

The students’ ratings of their exiting abilities are significantly higher than their entering ratings in all three years the items were used. The average rating increase across abilities was +.8 in 1998, which is higher than the average of +.7 in the two previous years. Three abilities (printed in bold typeface) reported entering/exiting gains of at least one rating point.

 

1998

1997

1996

Entering

Exiting

Entering

Exiting

Entering

Exiting

Rating Rating Diff Rating Rating Diff Rating

Rating

Diff Ability

3.4

4.2

.8

3.5

4.1

.6

3.5

4.1

.6

Write effectively

3.2

4.1

.9

3.2

4.0

.8

3.2

4.0

.8

Speak effectively

3.4

4.2

.8

3.4

4.0

.6

3.5

4.0

.5

Create original ideas

3.4

4.5

1.1

3.5

4.3

.8

3.6

4.3

.7

Draw conclusions

3.4

4.4

1.0

3.5

4.3

.8

3.5

4.3

.8

Locate/organize info

3.3

4.2

.9

3.3

4.1

.8

3.2

4.0

.8

Appreciate differences

3.5

4.4

.9

3.6

4.3

.7

-

-

-

Problem solving skills

3.6

4.2

.6

3.6

4.2

.6

3.5

4.1

.6

Get along with others

3.5

4.0

.5

3.4

4.0

.6

3.4

3.9

.5

Appreciate fine arts

2.8

4.4

1.6

2.7

4.2

1.5

2.8

4.2

1.4

Use technology

2.7

2.7

0

2.5

2.7

.2

2.6

2.6

0

Use another language

3.1

3.8

.7

3.1

3.7

.6

3.2

3.8

.6

Understand science

3.3

3.7

.4

3.3

3.7

.4

3.3

3.7

.4

Understand math

3.8

4.2

.4

3.8

4.3

.5

-

-

-

Understand values/ethics

3.6

4.3

.7

3.6

4.3

.7

3.6

4.3

.7

Work in groups

3.7

4.5

.8

3.7

4.5

.8

3.8

4.5

.7

Learn on own

3.3

4.1

.8

3.3

4.2

.9

3.4

4.2

.8

Organize time effectively

-

3.8

-

-

4.2

-

-

4.3

-

Demonstrate competency

-

4.1

-

-

4.0

-

-

4.0

-

Seek/obtain employment

-

4.2

-

-

4.2

-

-

-

-

Understand context

 

 

Satisfaction with the campus environment

The tables below show response pattern changes for respondents with different ethnic backgrounds to several questions regarding racism on campus and in the classroom. The most noticeable differences from past years were the slightly higher ratings given by Caucasian, Hispanic/Latino, and Asian-American respondents, and the slightly lower ratings given by the African-Americans respondents.

 

22a. The classroom environment was free from racist behavior:

  1998  1997   1996  1993  1990
Caucasian   4.2   4.0   3.9   3.8   4.0
Asian-American   3.8   3.6   3.8   3.5   3.8
African-American   2.9   3.1   1.8   2.4   2.6
Hispanic/Latino   3.6   3.3   3.4   3.2   3.7
Native American   -   4.0   3.0   -   -

 

23a. The campus environment was free from racism

  1998   1997   1996   1993   1990
Caucasian   3.1   3.0   2.8   2.6   2.9
Asian-American   2.9   2. 6   2. 8   2.3   2.7
African-American   2.1   2.3   1.5   1.6   2.0
Hispanic/Latino   2.6   2.3   2.6   2.0   2.6
Native American   -   2.3   3.0   -   -

 

24a. The University appropriately addressed problems of racism:

  1998   1997   1996   1993   1990
Caucasian   3.4   3.3   3.2   3.1   3.3
Asian-American   3.1   2.9   3.0   2.8   2.9
African-American   2.3   2.4   1.8   1.8   2.5
Hispanic/Latino   2.8   2.6   2.8   2.3   3.2
Native American   -   2.3   1.5   -   -

 

Men and women students continue to differ in their responses to the questions regarding sexism and sexist behavior on campus and in the classroom. Women respondents are less satisfied than men respondents. Both groups reported slightly higher ratings in 1998 than in the past.

 

22b. The classroom environment was free from sexist behavior:

  199