NSSE Logo
James Breece

NSSE has provided invaluable information to administrators, faculty, and staff across the seven University of Maine campuses needed to make changes to improve the student experience.

James H. Breece, Vice Chancellor for Academic and Student Affairs, University of Maine System

Construction of the 2009 NSSE Benchmarks

To represent the multi-dimensional nature of student engagement at the national, sector, and institutional levels, NSSE developed five indicators or Benchmarks of Effective Educational Practice:

  • Level of Academic Challenge (LAC)
  • Active and Collaborative Learning (ACL)
  • Student-Faculty Interaction (SFI)
  • Enriching Educational Experiences (EEE)
  • Supportive Campus Environment (SCE)

The individual items used in the construction of these benchmarks were created with a blend of theory and empirical analysis. Principal components analyses (oblique rotation) were used initially in this exploration, with theory and practice being used subsequently to inform and determine the final benchmark item groupings. As in the past, only randomly sampled cases are included in the calculation of institutional benchmarks.

The construction of the 2009 NSSE Benchmarks has four steps. First, all items that contribute to a benchmark are converted to a 0 - 100 point scale. For the ‘enriching’ items (question 7 on the survey), those students who indicated that they had already "done" the activity receive a score of 100, while those students who "plan to do," "do not plan to do," or who "have not decided" to do the activity receive a 0. Other items are converted as would be expected. For example, items with four response options (e.g., never, sometimes, often, very often) are recoded with values of 0, 33.33, 66.67, or 100.

Second, part-time student scores are adjusted on four of the Level of Academic Challenge items (READASGN, WRITEMID, WRITESML, ACADPR01). For each item, a ratio is calculated by dividing the mean score of all full-time students by the mean score of all part-time students. Each part-time student's score on an item is multiplied by the corresponding ratio to get their adjusted score. Adjusted scores are limited so as not to exceed 100. More information about this part-time adjustment can be found here.

Third, student-level benchmark scores are created for each group of items by taking the mean of each student's scores. A mean was calculated for each student so long as they had answered three-fifths of the items in any particular benchmark.

Finally, institutional benchmarks are created by calculating weighted averages of the student-level scores for each class (first-year students and seniors). More information about weighting can be found here.

Using all U.S. random samples from the 2009 NSSE survey administration, we examined the internal consistency of each NSSE benchmark using Cronbach's Alpha and benchmark intercorrelations. The results are shown in the tables below:

NSSE Benchmarks First-Year Senior
Level of Academic Challenge .73 .76
Active and Collaborative Learning .66 .66
Student-Faculty Interaction .71 .74
Enriching Educational Experiences .59 .66
Supportive Campus Environment .79 .80

 

  LAC ACL SFI EEE SCE
LAC   .487 .458 .378 .342
ACL .487   .582 .453 .334
SFI .470 .612   .525 .415
EEE .417 .497 .474   .308
SCE .385 .343 .392 .339  

Notes:

  1. Lower diagonal correlations are for first-year benchmarks
  2. Upper diagonal correlations are for senior benchmarks
  3. All p's < .001
  4. The table below shows the number of respondents.

  First-Year Senior
LAC 148,470 167,918
ACL 160,012 175,423
SFI 149,949 169,036
EEE 145,033 165,030
SCE 141,704 162,391

 

Click here to download the SPSS syntax used to construct the benchmarks.