University of Nebraska Kearney

UNK
Random UNK images
Assessment
related links

Accounting/Finance Assessment Report 2006

Submitted Fall, 2006

Assessment Report
Department of Accounting and Finance
Academic Year 2005-2006

Assessment of outcomes in the Department of Accounting and Finance employs the direct measures of a major field test, evaluation of written and oral presentations in a senior capstone course, and employer evaluations of accounting interns, and employs the indirect measure of a senior exit survey.

Major Field Test. 

The Major Field Test program developed by Educational Testing Service (ETS) was administered to accounting and finance students in the senior capstone course BMGT 495, Administrative Strategy and Policy.  The exam was given during finals week. The results, which are scored and provided by ETS, are compared to prior results and to a three year weighted average.  

 

Major Field Test Results for
Accounting and Finance Students
Reported by Percentile
 

Subject Matter

Fall 02

Fall 03

Sp 04

Fall 04

Sp 05

**

3-yr  weighted
average

Sp 06

Major
(number)

Acc
(6)

Fin
(8)

Acc
(10)

Fin
(9)

Acc
(9)

Fin
(10)

Acc
(6)

Fin
(11)

Acc
(15)

Fin
(6)

 

 

Acc
(69)

Fin
(57)

 

Acc/Fin*
(17) 

Accounting

95+

95+

95

68

95

95

95

85

95

95

 

 

95

87

 

95+

Economics

53

94

53

19

44

90

87

87

64

95

 

 

59

76

 

90

Management

95+

58

57

87

57

95

95

91

91

65

 

 

78

82

 

 92

Qual. Bus. Analysis

95

89

29

60

56

76

87

45

70

85

 

 

64

69

 

95+

Finance

86

92

75

92

95

95

95

95

78

95

 

 

84

94

 

95+

Marketing

95+

39

75

69

91

48

87

77

90

93

 

 

87

64

 

95+

Legal & Soc Environ.

95+

95+

25

55

35

95

95

95

68

89

 

 

59

86

 

95+

International Issues

72

90

60

36

64

80

95

85

50

91

 

 

64

76

 

91

* Accounting and Finance are combined in Spring 05 Semester since fewer that 5 Finance students took the test.
** Spring 03 and Fall 05 results are not available.

Outcomes:

Findings:  See chart above.

Interpretations:  The accounting and finance students perform well overall on the exam.  In the most recent year, they have scored at or above the 90th percentile in every topic on the exam.  They scored at or above the three-year weighted average scores in all subject areas as well.  The results indicate that the accounting and finance students are meeting the objective of having a working knowledge base in the functional areas of business, and possess the ability to integrate concepts of other business disciplines. Accounting and Finance students scored very high in their respective areas each semester. Accounting and finance students scored above the 95th percentile in the most recent test in both the accounting and finance subject areas.  This indicates that the students are meeting the objective of having a working knowledge of their respective discipline (accounting or finance).  Overall, the scores indicate that accounting and finance students are very competent in the core areas of business and within their respective discipline.  In addition, the exam measures students’ ability to analyze and solve problems, and understand relationships and interpret information related to the business field.  The scores indicate that the accounting and finance students are competent in their critical thinking and problem solving skills. 

Recommendations:  Accounting and Finance student performance has been excellent.  Faculty should continue to hold students to a high standard of performance within each course. The department should continue to emphasize the importance of a working knowledge of the functional areas of business and integrating concepts of other business disciplines with accounting and finance.  Several additional years of the Major Field Exam should be analyzed in the future to determine if any trends emerge indicating any areas of weakness. 

Senior Capstone Course- BMGT 495 Administrative Strategy and Policy. 

In addition to the Major Field Exam, which is administered in this course, students make oral group presentations and complete written business reports.  An interdisciplinary faculty panel of four faculty members evaluated three oral reports and written projects by random selection in the summer of 2005.  A large part of their report appears below.

Summer 2006 BMGT495 Assessment
Administrative Strategy and Policy

Assessment rubrics for written and oral communication available through each department’s assessment website were used to assess a sample of students.  One faculty member from each of the four business departments viewed and assessed three student group presentations and also assessed the written papers related to the presentations.  The rating methods, but not the content, for both the written and oral rubrics have been revised.  Therefore, these results are not readily comparable to any prior reports.  The following descriptions relate to tables below.

Written Communication:

Average ratings in all areas of the assessment of written communication were above the “Satisfactory” level.  However, some student groups met only minimal requirements in some areas – Writing Conventions for example.

Oral Presentations:

Student groups, on the average, were rated “Good” or higher for Integration, Technology, Appearance, and Content.  In all areas with similar descriptions, the groups scored higher in their oral presentations than in their written work.

Ratings:  3 – Exemplary, 2 – Good, 1 – Satisfactory, 0 – Needs Improvement, NA - Not Applicable

 

Written Communication:

 

Average

Good/
Exemplary%

Needs
Improvement%

Range of
Student
Group Aver.

1.  Content

1.92

75

8

1.25 – 2.50

2.  Organization

1.92

75

8

1.25 - 2.50

3.  Analysis

1.67

58

8

1.50 - 2.00

4.  Writing  Conventions

1.67

58

17

1.00 - 2.75

5.  Disciplinary Char.

1.75

58

8

1.25 - 2.25

6.  Integration

1.92

58

0

1.50 - 2.25

7.  Appearance

1.89

78

0

1.67 - 2.00

 

 

 

 

 

Oral Presentations:

 

 

 

 

 

Average

Good/
Exemplary%

Needs 
Improvement%

Range of 
Student
Group Aver.

1.  Content

2.00

92

8

1.75 - 2.25

2.  Organization

1.97

83

8

1.67 - 2.25

3.  Analysis

1.78

58

8

1.58 - 2.00

4.  Speaking  Conventions

1.80

67

0

1.69 - 1.95

5.  Technology

2.13

88

0

2.00 - 2.25

6.  Disciplinary Char.

1.92

75

17

1.75 - 2.25

7.  Integration

2.17

83

0

2.00 - 2.50

8.  Appearance

2.11

83

0

1.75 - 2.45

Conclusions: Although actual numbers cannot be compared to past results, a previous suggestion - improving integration of the business areas in both the written and oral communication skills - appears to have occurred.  Analysis still needs improvement in both. Speaking and Writing Conventions are problematical for some students.

Outcomes:

Findings:  See Chart above.

Interpretations:  Average Ratings for all Written Report measures were above Satisfactory.  The Best ratings came in Content, Organization, and Integration.  At least 50% of ratings in these categories were at the good or exemplary level.  The   Measures that rated lowest (but still satisfactory) were Analysis and Writing Conventions.  Average Ratings for Oral Presentations were above Satisfactory in all Measures and above good for Content, Technology, Integration, and Appearance.  At least 80% of ratings in those categories were at the good or exemplary level. Lowest ratings were in Analysis and Speaking Conventions.

Recommendations:  Business student performance in Oral Presentations and Written Reports is at an acceptable level.  Ratings suggest that improvement should be sought in Analysis and both Speaking and Writing Conventions.   

Senior Exit Survey. 

Educational Benchmarking (EBI) surveys all graduating CBT students.  The survey includes 66 questions grouped into 16 factors.  Results are compared to a group of six comparative institutions, to school in our same Carnegie classification, and to all all school participating in the survey.  This is the first year we have participated in the survey and so have no prior year data for comparison.  The following table summarizes results of factors and questions relevant to assessment of Department of Accounting and Finance efforts.  124 CBT students responded to the survey, a 50% response rate.  16 accounting students and 5 finance students responded.  Satisfaction is rated on a seven-point scale; seven being the most satisfied.

Accounting 

 

Factor/Question

UNK Mean

Select 6

Quality of Faculty and Instruction 

4.78

4.73

Quality of teaching in required courses

4.88

4.81

Quality of feedback on assignments from instructors in required courses

4.69

4.64

Faculty Responsiveness, Grades, and Student Effort 

5.33

5.59

Satisfaction with grades in required courses accurately reflecting students’ efforts

5.25

5.61

Satisfaction with accessibility of required course instructors outside of class

5.38

5.75

Satisfaction with required course instructor’s responsiveness to student concerns

5.38

5.00

Satisfaction with required course instructors relating concepts to the real world

5.31

4.33

Quality of Faculty and Instruction 

5.13

5.00

Quality of teaching in your major courses

5.31

5.00

Quality of feedback on assignments (other than grades) received from instructors in major courses

4.94

4.95

Faculty Responsiveness, Grades and Student Effort 

5.63

5.95

Satisfaction with grades in major courses accurately reflecting students’ level of performance

5.63

5.72

Satisfaction with accessibility of major course instructors outside of class

5.63

6.16

Satisfaction with major course instructor’s responsiveness to student concerns

5.63

5.98

Size of Enrollments for Required and Major Courses 

6.09

5.97

Satisfaction with average size of required courses

5.94

5.78

Satisfaction with average size of major courses

6.25

6.16

Student Organizations and Extracurricular Activities 

5.19

5.44

Satisfaction with student organization activities in the Business program

5.31

5.48

Satisfaction with leadership opportunities in Business program’s extracurricular activities

5.06

5.44

Placement and Career Services 

4.34

5.19

Satisfaction with assistance in preparation for permanent job search

4.43

5.19

Satisfaction with access to school’s alumni to cultivate career opportunities

3.87

4.49

Satisfaction with number of companies recruiting on campus

4.19

5.32

Satisfaction with quality of companies recruiting on campus

4.63

5.55

Advisor 

5.77

5.66

Satisfaction with advisor’s availability

5.94

5.79

Satisfaction with advisor’s knowledge of requirements

5.56

5.78

Satisfaction with advisor’s helpfulness of recommendations

5.69

5.57

Satisfaction with advisor’s interest in students’ progress

5.88

5.44

Learning Outcomes: Effective Communication and Team Work 

5.50

5.29

To what extent did the Business program enhance your: Presentation skills

5.44

5.49

To what extent did the Business program enhance your: Writing skills

5.44

4.86

To what extent did the Business program enhance your: ability to work in teams

5.63

5.50

Learning Outcomes: Critical Thinking and Problem Solving 

5.75

5.76

To what extent did the Business program enhance your: ability to think critically

5.81

5.73

To what extent did the Business program enhance your: ability to define problems

5.81

5.69

To what extent did the Business program enhance your: ability to solve problems

5.75

5.79

To what extent did the Business program enhance your: ability to analyze and interpret data

5.63

5.82

Overall Program Effectiveness 

5.33

5.55

Expectations: To what extent did your Undergraduate Business program experience fulfill your expectations

5.13

5.48

Overall Value: Comparing the expense to the quality of education, rate the value of the investment made in the Undergraduate Business degree

5.25

5.41

Recommendations: How inclined are you to recommend your Undergraduate Business program to a close friend

5.63

5.75

Finance 

 

Factor/Question

UNK Mean

Select 6

Quality of Faculty and Instruction 

4.60

4.58

Quality of teaching in required courses

4.60

4.80

Quality of feedback on assignments from instructors in required courses

4.60

4.37

Faculty Responsiveness, Grades, and Student Effort 

6.15

5.36

Satisfaction with grades in required courses accurately reflecting students’ efforts

6.20

5.32

Satisfaction with accessibility of required course instructors outside of class

6.80

5.48

Satisfaction with required course instructor’s responsiveness to student concerns

6.00

5.32

Satisfaction with required course instructors relating concepts to the real world

5.60

5.35

Quality of Faculty and Instruction 

4.60

5.27

Quality of teaching in your major courses

4.80

5.56

Quality of feedback on assignments (other than grades) received from instructors in major courses

4.40

4.97

Faculty Responsiveness, Grades and Student Effort 

6.33

5.77

Satisfaction with grades in major courses accurately reflecting students’ level of performance

6.20

5.63

Satisfaction with accessibility of major course instructors outside of class

6.20

5.89

Satisfaction with major course instructor’s responsiveness to student concerns

6.60

5.81

Size of Enrollments for Required and Major Courses 

6.50

6.04

Satisfaction with average size of required courses

6.40

5.85

Satisfaction with average size of major courses

6.60

6.25

Student Organizations and Extracurricular Activities 

4.40

5.21

Satisfaction with student organization activities in the Business program

4.40

5.31

Satisfaction with leadership opportunities in Business program’s extracurricular activities

4.00

5.15

Placement and Career Services 

4.38

4.25

Satisfaction with assistance in preparation for permanent job search

4.25

4.33

Satisfaction with access to school’s alumni to cultivate career opportunities

4.25

4.04

Satisfaction with number of companies recruiting on campus

4.75

4.34

Satisfaction with quality of companies recruiting on campus

4.25

4.15

Advisor 

5.07

5.20

Satisfaction with advisor’s availability

6.75

5.52

Satisfaction with advisor’s knowledge of requirements

5.00

5.56

Satisfaction with advisor’s helpfulness of recommendations

5.00

5.17

Satisfaction with advisor’s interest in students’ progress

4.60

4.68

Learning Outcomes: Effective Communication and Team Work 

5.27

5.34

To what extent did the Business program enhance your: Presentation skills

5.00

5.70

To what extent did the Business program enhance your: Writing skills

5.00

4.84

To what extent did the Business program enhance your: ability to work in teams

5.80

5.48

Learning Outcomes: Critical Thinking and Problem Solving 

6.10

5.75

To what extent did the Business program enhance your: ability to think critically

5.60

5.72

To what extent did the Business program enhance your: ability to define problems

6.00

5.67

To what extent did the Business program enhance your: ability to solve problems

6.20

5.73

To what extent did the Business program enhance your: ability to analyze and interpret data

6.60

5.86

Overall Program Effectiveness 

5.00

5.43

Expectations: To what extent did your Undergraduate Business program experience fulfill your expectations

4.60

5.38

Overall Value: Comparing the expense to the quality of education, rate the value of the investment made in the Undergraduate Business degree

5.60

5.39

Recommendations: How inclined are you to recommend your Undergraduate Business program to a close friend

4.80

5.52

Outcomes:

Findings:  See chart above. 

Interpretations:  Business students provided assessment of their experience at UNK and  self assessment in the areas of Communication and Teamwork Skills, and Critical Thinking and Problem Solving Skills. Raw scores were above 4 for all significant measures. Accounting and Finance students were in general satisfied with their education.  However, in some areas students were much less satisfied than were students at the comparison group of institutions.

Accounting.   In the 2005/2006 academic year, accounting students were satisfied with the quality of instruction in both required courses and in courses in their specific major.  They were satisfied with their advisors and with learning outcomes.  On the other hand the students were less satisfied than the comparison group with student organizations and leadership opportunities and with placement and employment contacts.

Finance.  In the 2005/2006 academic year, finance students were satisfied with faculty responsiveness and the learning objectives of critical thinking and problem solving.  They were less satisfied than the comparison group with quality of faculty and instruction in their major courses. Like the accounting students, they were less satisfied than the comparison group with students organizations and placement.  In addition, they were less satisfied than the comparison group with learning outcomes in communication and teamwork and with advising. These results are a little difficult to interpret.  There are only two full-time finance faculty and only 5 finance students took the survey.  However, it appears there may be substantial dissatisfaction among finance students.  These numbers will need to be monitored from year to year to see if the indications hold.

Recommendations: We plan several initiatives within the department that may help to improve areas in which students have manifested some dissatisfaction.  The Accounting Society is making the transition to Beta Alpha Psi, the national accounting fraternity.  Beta Alpha Psi will increase student involvement and opportunity for leadership and should increase student contact with professionals and potential employers.  The department has begun an initiative to increase contact and interaction with the professional community that should give students more contact with local accounting and finance professionals, both in the classroom and in other non-classroom settings.  The department is planning to implement a common final exam for the first finance course.  The common final will help assess whether students advancing to higher level courses in the major are well prepared for an in-depth study of finance. A more coordinated effort by faculty may produce more consistency between classes and greater satisfaction among students.

Internships.  

Accounting and Finance students completing business internships are evaluated by their supervisor using the evaluation form developed for assessment purposes.  Students were evaluated in twenty areas and given an overall rating.  The supervisor rated the student interns, using a five-point scale, with 5 representing ‘Excellent’ and 1 being ‘Weak’. The results are contained in the following chart.

 

 

Supervisor Evaluation of Intern 

 

2002/03

2003/04

2004/05

Number of Student Internships

12

31

9

Academic Preparedness

 

 

 

Learned readily

4.5

4.39

4.67

Education/background were appropriate for job

4.6

4.46

4.78

Oral Communication

 

 

 

Grammar

4.3

4.46

4.67

Sought supervision when necessary

4.5

4.43

4.44

Listened/responded to instructions

4.3

4.50

4.33

Written Communication

 

 

 

Spelling

4.7

4.52

4.86

Sentence structure

4.6

4.52

4.57

Clear expression of ideas

4.6

4.50

4.57

Critical Thinking

 

 

 

Independent decision making

4.0

4.19

4.63

Used proper judgment in prioritization/other

4.2

4.35

4.56

Good problem solving techniques

4.0

4.33

4.33

Appropriate level of maturity

4.3

4.36

4.67

Relationships/Attitude

 

 

 

Worked well with coworkers

4.5

4.75

4.67

Worked well with clients

4.9

4.53

4.88

Was sensitive to cultural differences

4.7

4.56

4.50

Exhibited enthusiasm

4.3

4.32

4.78

Diligently approached tasks

4.3

4.57

4.67

Use of Technology

4.8

4.78

4.67

Overall Dependability (Attendance/punctuality)

4.75

4.54

4.56

Overall Quality of Work

4.3

4.39

4.56

Overall Performance

4.3

4.50

4.67

Scale :  5=Excellent      1=Weak

 

 

 

Findings: See above chart.

Interpretations:  The overall scores evaluating interns by employer/supervisor were very good.  Student skills scores were at least 4 on a 5 point scale for all areas.  For the 2004/2005 the highest ratings were in the areas of Relationships/ Attitudes (working well with clients and showing enthusiasm), Academic preparedness (learning readily and having appropriate education/background), and Written Communication.  The lowest ratings were in the areas of Listening to Instructions and Independent Decision-Making,  However, the scores in these areas are still quite good, 4.33 on a 5 point scale. The Overall Performance rating of the interns was 4.67 on a 5 point scale.  Employer/supervisor evaluations indicate that accounting and finance students possess a working knowledge of their discipline, and are competent in their oral and written communication skills, critical thinking, problem solving and use of technology.

Recommendations:  The ratings of student interns were high.  Students should be encouraged to pursue internship opportunities.  The department may want to review current curriculum and course assignments in an attempt improve students’ problem solving techniques.

Assessment of the Assessment Process

The use of the Major Field Test is working well as an assessment tool and should be continued.  Breaking down scores for specific emphasis areas (i.e. accounting and finance students) that began Fall 2001 should continue.  This exam is currently providing useful assessment data for the department. 

The Senior Capstone Course, BMGT 495 is a logical course for assessment to occur.  However, the current methods being employed to assess written and oral communication in the course use such small numbers, are evaluated inconsistently from year to year, and do not indicate accounting and finance student performance, that it is difficult to make any assessment of the department performance from these measures.  

The Internship Assessment measure, which consists of an employer/supervisor evaluation of student intern performance is providing useful information and should be continued. 

The senior exit survey is providing useful information and should be continued.  It will become more useful in the future when we can compare between years and note trends. 

We have plans to add common final exams in the business core courses offered by the department.  These should prove better assessment data than we currently have.  We also plan to develop assessment exams to be given in a senior class in accounting and finance. These exams will test overall learning goals for each of the majors and will supply information superior to what we currently get. 

The department is currently working with the other three departments within the business discipline and the Director of Assessment to improve department assessment and to also better coordinate the assessment measures that are common to the four departments that comprise the business discipline.