2023-2024 CAEP Measures



CAEP Accountability Measures 

As part of our national accreditation process, we are required to report 4 measures of program effectiveness publicly. We are proud of our success and we invite you to compare these data with other accredited programs.



Measure 1: Completer Impact and Effectiveness

Completer Impact on P-12 Learning and Development

Based on a sample of School of Education graduates, teachers in their first or second year of teaching completed a unit of instruction and used a matched pre-assessment and post-assessment to measure the percentage learning gain of their students.

Graduation Year

2018

11 teachers

2019

6 teachers

2020

1 teacher

2021

7 teachers

2022

3 teachers

2023

2 teachers

2024

4 teachers

P-12 student count

95

21

233

46

67

38

51

P-12 student
average gain

35.04

32.34

43.84

31.75

29.53

41.73

20.48

 
Completer Effectiveness in Applying Professional Knowledge, Skills, and Dispositions 

As part of a case study methodology, School of Education faculty visit early career teacher classrooms and do an abbreviated observation similar to the observation completed during student teaching. In this case data are recorded and analyzed qualitatively. To view the format of the observation and accumulated qualitative data click on the link below. 

Early Career Teacher Classroom Observation



Measure 2: Satisfaction of Employers and Stakeholder Involvement

A consortium of Schools of Education in Oregon initially hired an educational research firm to design and administer a survey assessing employer satisfaction with newly hired teachers from these institutions. However, due to low response rates, we have taken over the administration of these surveys. Conducted biennially, the surveys target employers of alumni from the two most recent graduating cohorts. While response rates have shown improvement, they may still not fully represent the broader group of employers who hire University of Portland graduates. The survey is based on the performance categories outlined by the Interstate Teacher Assessment and Support Consortium (InTASC). The table below presents the percentage of responses within each category, and the last column shows the overall mean on a scale of 1 to 4.

InTASC Category


Unprepared

1

 

2

 

3

Very Well Prepared

4

M (SD)

Learner and Learning

 

 2.4

 25.0

 72.6

 3.70 (0.51)

Content
Knowledge

 2.1

 4.2

 27.1

 66.7

 3.58 (0.68)

Instructional Practice

 

4.5

 32.6

62.8

 3.58 (0.59)

Professional
Responsibilities

 

4.5

 15.2

 80.3

 3.76 (0.53)


In terms of advanced program candidates, 100% met CAEP Measure 2 by continuing employment as rated by their supervisors. In addition, we conducted interviews with both completers and employers of advanced programs as an additional data point; the interview protocol that is being used for these interviews is available here. These interviews discovered satisfaction of both completers and employers in terms of capacity; see results here.

In addition, internal and external stakeholders participate in program design, evaluation, and continuous improvement processes for both initial licensure and advanced programs through our Unit Advisory Consortium (UAC). These meetings are held twice per year; a typical meeting agenda involves analyzing data, co-constructing revisions to assessments, feedback sessions, and conducting focus groups with completers.



Measure 3: Candidate Competency at Program Completion

We administer a survey of new teachers satisfaction with the preparation they received from Schools of Education at exit of the program. The survey instrument was designed to address Interstate Teacher Assessment and Support Consortium (InTASC) performance categories. In the table below the numbers represent the percentage of responses within each response category. 

InTASC Category

Unprepared

1

2

3

4

5

6

7

8

9

Very well prepared

10

Learner and Learning

 0.4

 2.4

2.4

2.0

3.6

7.2

19.2

14.4

19.2

28.8

Content
Knowledge

 

 1.2

2.4

 

1.2

5.3

23.4

19.3

19.3

27.5

Instructional Practice

 0.7

 3.3

 0.7

 2.0

2.0

10.7

14.7

16.7

18.7

30.7

Professional
Responsibilities

 

 3.2

3.2

2.4

4.0

4.0

13.6

10.4

22.4

36.8

 
For advanced administrator programs, candidates rate their competency, in terms of how much better their competency was at program completion using a survey aligned to the National Educational Leadership Preparation (NELP) Program Recognition Standards. In the table below the numbers represent the percentage of responses within each response category.

NELP Standard

Unprepared

1

2

3

4

5

6

7

8

9

Very well prepared

10

Mission, Vision, & Improvement

 

 

 

 

 

10.0

10.0

50.0

30.0

 

Ethics and Professional Norms

 

 

 

 

 

 

26.7

73.3

 

Equity, Inclusiveness, & Cultural Responsiveness

 

 

 

 

 13.3

 46.7

20.0

20.0

 

Learning & Instruction

 

 

 

20.0

 

20.0

40.0

20.0

 

Community & External Leadership

 

 

 

 

 

13.3

26.7

33.3

26.7

 

Operations & Management

 

 

 

 

 

 13.3

66.7

20.0

 

Building Professional Capacity

 

 

 

20.0

 

55.0

25.0

 

 



Measure 4: Ability of Completers to be Hired in Education Positions for Which They Have Been Prepared

The table below shows the percentage of graduates within each employment category for each of the most recent graduating cohorts. More than 80% of our completers are hired as teachers in the immediate year following graduation! The majority of the out-of-state teaching positions for our graduates are in Washington State, but our graduates teach in schools all over the world, which has  made tracking of graduates out of state exciting but difficult—hence the range of unknown graduates. Advanced candidates are employed when in the program.

Year

Cohort size (n)

 

  Teaching_

 

Higher
education

Non-education

/ unemployed

Unknown

In state

Out of state

Total teaching

2019

77

59.0

31.1

90.2

3.3

1.6

4.9

2020

69

49.3

31.9

81.2

8.7

5.8

4.3

2021

70

47.1

44.3

91.4

2.9

2.9

2.8

2022

51

65.7

23.5

88.2

2.0

2.0

7.8

2023

80

38.8

45.0

83.8

5.0

2.5

8.8

2024

59

50.8

35.6

86.4

1.7

3.3

8.5