Skip to main content
SpringerLink
Log in

Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

This review synthesizes the research comparing theoverall ratings of college teachers' effectiveness made by current and former students, colleagues, administrators, external (neutral) observers, and the teachers themselves. Of the 15 possible comparison pairs of rating groups, the five with the most data available show that the strongest cases of relative and absolute similarity in ratings are when current students are compared either with the teachers' colleagues or with administrators. Colleague and administrator ratings tend to be similar in relative assessment but dissimilar in absolute assessment. Teachers' self-ratings and current student ratings are, at best, moderately similar. The least similarity was found between teachers' ratings of themselves and colleague ratings. Degree of profile similarity acrossspecific evaluations was determined for studies comparing teachers' self-ratings with current student ratings, as were the relative and absolute similarity (or dissimilarity) for certain of the specific instructional dimensions. Implications of the various analyses and other considerations were explored in terms of individual and subgroup differences, mutual awareness of similarities or dissimilarities, validity issues, and directions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aiken, L. R., Jr. (1975). Procedures and problems in designing a college course evaluation questionnaire.College and University 50(3): 247–253.

    Google Scholar 

  • Aleamoni, L. M., and Yimer, M. (1973). An investigation of the relationship between colleague rating, student rating, research productivity, and academic rank in rating instructional effectiveness.Journal of Educational Psychology 64(3): 274–277.

    Google Scholar 

  • Arreola, R. A. (1979). Strategy for developing a comprehensive faculty evaluation system.Engineering Education 70(3): 239–244.

    Google Scholar 

  • Avi-Itzhak, T. (1982). Teaching effectiveness as measured by student ratings and instructor self-evaluation.Higher Education 11(6): 629–634.

    Google Scholar 

  • Ballard, M., Rearden, J., and Nelson, L. (1976). Student and peer rating of faculty.Teaching of Psychology 3(2): 88–90.

    Google Scholar 

  • Batista, E. E., and Brandenburg, D. C. (1978). The Instructor Self-Evaluation Form: Development and validation of an ipsative forced-choice measure of self-perceived faculty performance.Research in Higher Education 9(4): 319–332.

    Google Scholar 

  • Bendig, A. W. (1953). An inverted factor analysis study of student-rated introductory psychology instructors.Journal of Experimental Education 21(4): 333–336.

    Google Scholar 

  • Blackburn, R. T., and Clark, M. J. (1975). An assessment of faculty performance: Some correlates between administrator, colleague, student, and self ratings.Sociology of Education 48(2): 242–256.

    Google Scholar 

  • Blazek, H. D. (1974). Student perceptions of college teaching effectiveness. Unpublished doctoral dissertation, Northern Illinois University.

  • Bledsoe, J. C. (1975). Insight into one's own teaching through feedback from students' evaluations.Psychological Reports 37: 1189–1190.

    Google Scholar 

  • Bonge, D. (1982). Using TA ratings to validate student evaluations: A reply to Lamberth and Kosteski.Teaching of Psychology 9(2): 102.

    Google Scholar 

  • Braskamp, L. A., Caulley, D., and Costin, F. (1979). Student ratings and instructor self-ratings and their relationship to student achievement.American Educational Research Journal 16(3): 295–306.

    Google Scholar 

  • Braunstein, D. N., and Benston, G. J. (1973). Student and department chairman views of the performance of university professors.Journal of Applied Psychology 58(2): 244–249.

    Google Scholar 

  • Brooks, D. D., Kelter, P. B., and Tipton, T. J. (1980). Student evaluation versus faculty evaluation of chemistry teaching assistants.Journal of Chemical Education 57(4): 294–295.

    Google Scholar 

  • Centra, J. A. (1973a). Effectiveness of student feedback in modifying college instruction.Journal of Educational Psychology 65(3): 395–401.

    Google Scholar 

  • Centra, J. A. (1973b). Self-ratings of college teachers: A comparison with student ratings.Journal of Educational Measurement 10(4): 287–295.

    Google Scholar 

  • Centra, J. A. (1974). The relationship between student and alumni ratings of teachers.Educational and Psychological Measurement 34(2): 321–325.

    Google Scholar 

  • Centra, J. A. (1975). Colleagues as raters of classroom instruction.Journal of Higher Education 46(3): 327–337.

    Google Scholar 

  • Centra, J. A. (1979).Determining Faculty Effectiveness: Assessing Teaching, Research, and Service for Personnel Decisions and Improvement. San Francisco: Jossey-Bass.

    Google Scholar 

  • Choy, C. (1969). The relationship of college teacher effectiveness to conceptual systems orientation and perceptual orientation. Unpublished doctoral dissertation, Colorado State College.

  • Clark, M. J. (1973). Organizational stress and professional performance among faculty members at a small college. Unpublished doctoral dissertation, University of Michigan.

  • Costin, F. (1966). Intercorrelations between students' and course chairmen's ratings of instructors. (A report prepared for the Division of General Studies, University of Illinois, June.) Unpublished ms.

  • Cooper, H. M. (1984).The Integrative Research Review: A Systematic Approach. Beverly Hills: Sage.

    Google Scholar 

  • Cranton, P. A., and Hillgartner, W. (1981). The relationship between student ratings and instructor behavior: Implications for improving teaching.The Canadian Journal of Higher Education 11(1): 73–81.

    Google Scholar 

  • Dielman, T. E., and Horvatich, P. K. (1985). Interrater reliability and internal consistency of student and staff ratings of medical instruction. Paper presented at the annual meeting of the American Educational Research Association.

  • Doyle, E. J. (1969). The relationship between college teacher effectiveness and inferred characteristics of the adequate personality. Unpublished doctoral dissertation, Colorado State College.

  • Doyle, K. O., Jr. (1975).Student Evaluation of Instruction. Lexington, Mass.: Heath.

    Google Scholar 

  • Doyle, K. O., Jr. (1983).Evaluating Teaching. Lexington, Mass.: Heath.

    Google Scholar 

  • Doyle, K. O., Jr. and Crichton, L. I. (1978). Student, peer, and self evaluations of college instruction.Journal of Educational Psychology 70(5): 815–826.

    Google Scholar 

  • Drucker, A. J., and Remmers, H. H. (1951). Do alumni and students differ in their attitudes toward instructors?Journal of Educational Psychology 42(3): 129–143.

    Google Scholar 

  • Erdle, S., Murray, H. G., and Rushton, J. P. (1985). Personality, classroom behavior, and student ratings of college teaching effectiveness: A path analysis.Journal of Educational Psychology 77(4): 394–407.

    Google Scholar 

  • Erickson, G. R., and Erickson, B. L. (1979). Improving college teaching: An evaluation of a teaching consultation procedure.Journal of Higher Education 50(5): 670–683.

    Google Scholar 

  • Feldman, K. A. (1971). Using the work of others: Some observations on reviewing and integrating.Sociology of Education 44(1): 86–102.

    Google Scholar 

  • Feldman, K. A. (1976a). Grades and college students' evaluations of their courses and teachers.Research in Higher Education 4(1): 69–111.

    Google Scholar 

  • Feldman, K. A. (1976b). The superior college teacher from the students' view.Research in Higher Education 5(3): 243–288.

    Google Scholar 

  • Feldman, K. A. (1977). Consistency and variability among college students in rating their teachers and courses: A review and analysis.Research in Higher Education 6(3): 223–274.

    Google Scholar 

  • Feldman, K. A. (1978). Course characteristics and college students' ratings of their teachers: What we know and what we don't.Research in Higher Education 9(3): 199–242.

    Google Scholar 

  • Feldman, K. A. (1979). The significance of course circumstances for college students' ratings of their teachers and courses.Research in Higher Education 10(2): 149–172.

    Google Scholar 

  • Feldman, K. A. (1983). Seniority and experience of college teachers as related to evaluations they receive from students.Research in Higher Education 18(1): 3–124.

    Google Scholar 

  • Feldman, K. A. (1984). Class size and college students' evaluations of teachers and courses: A closer look.Research in Higher Education 21(1): 45–116.

    Google Scholar 

  • Feldman, K. A. (1986). The perceived instructional effectiveness of college teachers as related to their personality and attitudinal characteristics: A review and synthesis.Research in Higher Education 24(2): 139–213.

    Google Scholar 

  • Feldman, K. A. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration.Research in Higher Education 26(3): 227–298.

    Google Scholar 

  • Feldman, K. A. (1988). Effective college teaching from the students' and faculty's view: Matched or mismatched priorities?Research in Higher Education 28(4): 291–344.

    Google Scholar 

  • Fink, L. D. (1984).The First Year of College Teaching. (New Directions for Teaching and Learning, No. 17, March). San Francisco: Jossey-Bass.

    Google Scholar 

  • Finkelstein, M. J. (1984).The American Academic Profession: A Synthesis of Social Scientific Inquiry Since World War II. Columbus, Ohio: Ohio State University.

    Google Scholar 

  • Fittante, L. C., and Powell, E. R. (1974). Classroom verbal behavior and student perceptions of college teaching. Paper read at the annual meeting of the American Educational Research Association.

  • Fitzgerald, M. J., and Grafton, C. L. (1981). Comparisons and implications of peer and student evaluation for a community college faculty.Community/Junior College Research Quarterly 5(3): 331–337.

    Google Scholar 

  • Fowler, N. (1946). Turn about's fair play!Journal of Higher Education 27(3): 131–135, 170.

    Google Scholar 

  • Fox, A. M., and Hein, D. D. (1971). Teacher perceptions in effective teaching.Journal of Educational Research 10(3): 45–49.

    Google Scholar 

  • Gillmore, G. M. (1975). The relationship between graduating senior nominations of valuable and non-valuable courses and end-of-course student ratings. EAC Report 271b. Seattle, Wash.: Educational Assessment Center, University of Washington.

    Google Scholar 

  • Glass, G. V., McGaw, B., and Smith, M. L. (1981).Meta-Analysis in Social Research. Beverly Hills, Calif.: Sage.

    Google Scholar 

  • Gordon, L. K. (1970). Who are the good teachers? A study of student evaluation of college teaching. Unpublished masters' thesis, State University of New York at Stony Brook.

  • Gowin, D. B. (1958). An experimental study of part-time college faculty. Bridgeport, Conn.: University of Bridgeport.

    Google Scholar 

  • Gowin, D. B., and Payne, D. E. (1962). Evaluating instruction: Cross-perceptions of college students and teachers.School Review 70(2): 207–219.

    Google Scholar 

  • Guthrie, E. R. (1945). Evaluation of faculty service.American Association of Professors Bulletin 31(2): 255–262.

    Google Scholar 

  • Guthrie, E. R. (1949). The Evaluation of teaching.Educational Record 30(2): 109–115.

    Google Scholar 

  • Guthrie, E. R. (1954). The evaluation of teaching: A progress report. Seattle, Wash.: University of Washington.

    Google Scholar 

  • Haas, P. F., Keeley, S., and Browne, M. N. (1979). Validity of student ratings of cognitive classroom behavior.College Student Journal 13(4): 363–373.

    Google Scholar 

  • Hall, D. T. (1970). The effect of teacher-student congruence upon student learning in college classes.Journal of Educational Psychology (61): 205–213.

  • Hansen, R. B., and Rogers, B. G. (1984). Convergent and discriminant validation of measures of faculty competence by the multitrait-multimethod matrix.Educational Research Quarterly 9(1): 14–18.

    Google Scholar 

  • Harari, O., and Zedeck, S. (1973). Development of behaviorally anchored scales for the evaluation of faculty teaching.Journal of Applied Psychology 58(2): 261–265.

    Google Scholar 

  • Hayes, J. R. (1971). Research, teaching, and faculty fate.Science 172: 227–230.

    Google Scholar 

  • Hays, W. L. (1988).Statistics (4th ed.). New York: Holt, Rinehart and Winston.

    Google Scholar 

  • Hedges, L. W., and Olkin, I. (1985).Statistical Methods for Meta-Analysis. Orlando, Fla.: Academic Press.

    Google Scholar 

  • Hildebrand, M., Wilson, R. C., and Dienst, E. R. (1971).Evaluating University Teaching. Berkeley, Calif.: Center for Research and Development in Higher Education, University of California, Berkeley.

    Google Scholar 

  • Howard, G. S, Conway, C., and Maxwell, S. E. (1985). Construct validity of measures of college teaching effectiveness.Journal of Educational Psychology 77(2): 187–196.

    Google Scholar 

  • Kamisar, E. E. (1975). A survey of differences between university professors evaluated by students as outstanding teachers and their other colleagues. Unpublished doctoral dissertation, University of Michigan.

  • Kapel, D. E. (1974). Assessment of a conceptually based instructor evaluation form.Research in Higher Education 2(1): 1–24.

    Google Scholar 

  • Kulik, J. A. (1974). Evaluation of teaching. Memo to the Faculty, No. 53. Ann Arbor, Mich.: Center for Research on Learning and Teaching, University of Michigan.

    Google Scholar 

  • Kulik, J. A., and McKeachie, W. J. (1975). The evaluation of teachers in higher education. In F. N. Kerlinger (ed.),Review of Research in Education Vol. 3, pp. 210–240. Itasca, Ill.: F. E. Peacock.

    Google Scholar 

  • Lacefield, W. E. (1986). Faculty enrichment and the assessment of teaching.Review of Higher Education 9(4): 361–379.

    Google Scholar 

  • Lamberth, J., and Kosteski, D. M. (1981). Student evaluations: An assessment of validity.Teaching of Psychology 8(1): 8–11.

    Google Scholar 

  • Lamberth, J., and Kosteski, D. M. (1982). Using TA ratings to validate student evaluations: The important issues.Teaching of Psychology 9(2): 102–103.

    Google Scholar 

  • Lohff, J. K. (1985). Variations between faculty self-assessments and student ratings of instruction by item content. Unpublished doctoral dissertation, Arizona State University.

  • Love, J. A., Minnis, D. L., Sandoval, J. H., and Yonge, G. D. (1977). An instrument to describe college teaching: A reliability study. Paper read at the annual meeting of the American Educational Research Association.

  • Love, J. A., Sandoval, J., and Cohen, E. (1978). The generalizability and concurrent validity of an instrument to describe college teaching. Paper read at the annual meeting of the American Educational Research Association.

  • Lowenberg, G. (1979). Interindividual consistencies in determining behavior-based dimensions of teaching effectiveness.Journal of Applied Psychology 64(5): 492–501.

    Google Scholar 

  • Machlup, F. (1979). Poor learning from good teachers.Academe: Bulletin of AAUP 65(6): 376–380.

    Google Scholar 

  • Marsh, H. W. (1977). The validity of students' evaluations: Classroom evaluations of instructors independently nominated as best or worst teachers by graduating seniors.American Educational Research Journal 14(4): 441–447.

    Google Scholar 

  • Marsh, H. W (1982). Validity of students' evaluations of college teaching: A multitrait-multimethod analysis.Journal of Educational Psychology 24(2): 264–279.

    Google Scholar 

  • Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility.Journal of Educational Psychology 76(5): 707–754.

    Google Scholar 

  • Marsh, H. W. (1987). Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research.International Journal of Educational Research 11(3): 253–388.

    Google Scholar 

  • Marsh, H. W., Overall, J. U., and Kesler, S. P. (1979). Validity of students' evaluations of instructional effectiveness: A comparison of faculty self-evaluations and evaluations by their students.Journal of Educational Psychology 71(2): 149–160.

    Google Scholar 

  • Maslow, A. H., and Zimmerman, W. (1956). College teaching ability, scholarly activity and personality.Journal of Educational Psychology 47(3): 185–189.

    Google Scholar 

  • McCarbery, R. J. (1970). The relationship of selected factors to ratings of community college teachers. Unpublished doctoral dissertation, Indiana University.

  • McKeachie, W. J., and Lin, Y. G. (1979). A note on validity of student ratings of teaching.Educational Research Quarterly 4(3): 45–47.

    Google Scholar 

  • Miller, D. S. (1972). A study of student-faculty ratings related to selected instructional factors. Unpublished doctoral dissertation, Oklahoma State University.

  • Miller, R. I. (1972).Evaluating Faculty Performance. San Francisco: Jossey-Bass.

    Google Scholar 

  • Morrow, J. R., Jr. (1976). The effects of response position and item simplicity on the factorial structure of teacher evaluation forms. Unpublished doctoral dissertation, University of Colorado.

  • Morrow, J. R., Jr. (1977). Some statistics regarding reliability and validity of student ratings of teachers.The Research Quarterly 48(2): 372–375.

    Google Scholar 

  • Morsh, J. E., Burgess, G. G., and Smith, P. N. (1956). Student achievement as a measure of instructor effectiveness.Journal of Educational Psychology 47(2): 79–88.

    Google Scholar 

  • Moses, I. (1986). Self and student evaluation of academic staff.Assessment and Evaluation in Higher Education 9(1): 76–86.

    Google Scholar 

  • Murray, H. G. (n.d.). The reliability and validity of student ratings of faculty teaching ability. Unpublished ms.

  • Murray, H. G. (1972). The validity of student ratings of faculty teaching ability. Paper presented at the annual meeting of the Canadian Psychological Association.

  • Murray, H. G. (1976). How do good teachers teach? An observational study of the classroom teaching behaviors of Social Science professors receiving low, medium, and high teacher ratings. Paper read at the annual meeting of the Canadian Psychological Association.

  • Murray, H. G. (1980).Evaluating University Teaching: A Review of Research. Toronto: Ontario Confederation of University Faculty Associations.

    Google Scholar 

  • Murray, H. G. (1983). Low-inference classroom teaching behaviors and student ratings of college teaching effectiveness.Journal of Educational Psychology 75(1): 138–149.

    Google Scholar 

  • Pfeiffer, M. G., Lehmann, W., and Scheidt, U. (1972). Methodological investigation of perceived structure of college teaching across two cultures.Perceptual and Motor Skills 35(2): 619–626.

    Google Scholar 

  • Pfeiffer, M. G., and Rosbach, L. A. (1969). Teaching performance criterion development through scaling: Teacher-student points-of-view analysis.Perceptual and Motor Skills 28(3): 755–766.

    Google Scholar 

  • Pittman, R. B. (1981). Student and peer ratings of teacher characteristics. Paper read at the annual meeting of the North Carolina Association for Research in Education.

  • Ronan, W. W., and Schwartz, A. P. (1974). Ratings as performance criteria.International Review of Applied Psychology 23(2): 71–81.

    Google Scholar 

  • Rosenthal, R. (1984).Meta-Analytic Procedures for Social Research. Beverly Hills: Sage.

    Google Scholar 

  • Rossman, J. E. (1976). Teaching, publication, and rewards at a liberal arts college.Improving College and University Teaching 24(4): 238–240.

    Google Scholar 

  • Rotem, A. (1975). The effects of feedback from students to university professors: An experimental study. Unpublished doctoral dissertation, University of California, Santa Barbara.

    Google Scholar 

  • Sagen, H. B. (1974). Student, faculty, and department chairmen ratings of instructors: Who agrees with whom?Research in Higher Education 2(3): 265–272.

    Google Scholar 

  • Scriven, M. (1988). The validity of student ratings.Instructional Evaluation 9(2): 5–18.

    Google Scholar 

  • Seldin, P. (1984).Changing Practices in Faculty Evaluation: A Critical Assessment and Recommendations for Improvement. San Francisco: Jossey-Bass.

    Google Scholar 

  • Stallings, W. M., and Spencer, R. E. (1967). Rating of instructors in Accountancy 101 from video-tape clips. Research Report No. 265 (Oct.). Urbana-Champaign, Ill.: Measurement and Research Division, Office of Instructional Resources, University of Illinois.

  • Stavridis, P. G. (1972). Relationships between student ratings of teaching effectiveness and certain criteria used in promotion of college faculty. Unpublished doctoral dissertation, Arizona State University.

  • Swanson, R. A., and Sisson, D. J. (1971). The development, evaluation, and utilization of a departmental faculty appraisal system.Journal of Industrial Teacher Education 9(1): 64–79.

    Google Scholar 

  • Thompson, E. W. (1972). A study of the discrepancies between student evaluation and faculty self-perceptions of instructional procedures in higher education. Unpublished ms. (ERIC Document Reproduction Service No. ED 087 795)

  • Touq, M. (1972). The relationship between student participation in classroom discussion and student rating of instructors at the college level. Unpublished doctoral dissertation, Purdue University.

  • Touq, M. S., and Feldhusen, J. F. (1974). Validity of student ratings of instructors.College Student Journal 8(4): 2–5.

    Google Scholar 

  • Tracy, D. B., and Tollefson, N. (1979). A multidimensional study of effective teachers. Paper read at the annual meeting of the American Educational Research Association.

  • Usher, R. H. (1966). The relationship of perceptions of self, others, and the helping task to certain measures of college faculty effectiveness. Unpublished doctoral dissertation, University of Florida.

  • Webb, W. B., and Nolan, C. Y. (1955). Student, supervisor, and self-ratings of instructional proficiency.Journal of Educational Psychology 46(1): 42–46.

    Google Scholar 

  • Whitehead, M. J. (1953). Are you afraid of student ratings?Journal of Teacher Education 4(2): 135–136.

    Google Scholar 

  • Wood, P. H. (1978). Student and peer ratings of college teaching and peer ratings of research service: Four years of departmental evaluation. Paper read at the annual meeting of the American Educational Research Association.

Download references

Author information

Authors and Affiliations

  1. Department of Sociology, State University of New York at Stony Brook, 11794-4356, Stony Brook, NY

    Kenneth A. Feldman

Authors
  1. Kenneth A. Feldman
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Feldman, K.A. Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Res High Educ 30, 137–194 (1989). https://doi.org/10.1007/BF00992716

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00992716

Keywords

Search

Navigation