University of Nebraska Kearney

Geography and Earth Science Assessment Report 2006

Submitted Fall, 2006

Geography and Earth Science Program
Assessment Report
October 2006

Assessment Plan

April 2005

The Department of Geography’s assessment plan is focused on the teaching mission of the Department, which states in part:

As a discipline of study, Geography is considered both a Social and Natural Science. In a sense, Geography is a "bridge" discipline that synthesizes and integrates the knowledge of the physical sciences as they relate to the earth and those disciplines dealing with the human condition. Geography is the discipline that treats the inter-relationships of people and the land. The Department of Geography strives, within the tripartite nature of a university, to promote integrated research and various teaching approaches that lead to an array of academic courses serving curricula at all levels of the institution by providing the geographic perspective to the Baccalaureate degree. 

The Department plays a major role in the General Studies Program of the University offering diverse courses in both the Natural and Socials Sciences. The Department also offers four (4) baccalaureate degrees/majors (BA, BS, BS with GIS/Spatial Analysis Option, and BS with an Environmental Option), a 7-12 Teaching Endorsement, and two (2) Minors (Geography and Spatial Analysis). The Department’s Assessment Plan assesses both the Major/Minor components and the General Studies component, but with different emphases and assessment tools.

Component 1 Learning Objectives Being Assessed

A variety of active, student centered mission components are derived from the Department's mission:

Skills Outcomes:

1. Students will demonstrate regular progress towards and attainment of professional levels of communication of geographic data and analysis, including writing, oral presentations and/or poster presentation skills; 
2. Students will be competent in the presentation and interpretation of geographic information through the use of maps and other media. Geography Majors and Minors will be able to produce quality maps in one or more of the following production methods: Computer drafting, computer cartography, or applying Geographic Information Systems (GIS) technology to map production and spatial analysis;
3. Students will demonstrate critical thinking and analytic skills through the ability to locate, assimilate, organize, and critically review appropriate geo-spatial information.

Knowledge Based Outcomes:

1. Students will understand and demonstrate basic knowledge of the distinctiveness of places and regions at various scales of generalization;
2. Students will be able to describe and explain the earth's basic physical and atmospheric processes, and how they affect the spatial distributions of landforms, climates, soils, vegetation and/or hydrologic features;
3. Students will be able to describe and explain the basic characteristics, distribution and interconnectedness of human and cultural features on the Earth’s surface; 4. Students will be able to describe and explain various human-land interactions as they relate to both the effects of human activities upon the landscape and landscape processes, as well as the effects of the landscape and landscape processes on human activities.

Value Based Outcome

1. Students will demonstrate the set of civil and professional values and conventions that serve to enhance communication and encourage cooperation with and among colleagues; 
2. Students will demonstrate responsible and professional work habits and ethical standards in their coursework and subsequent careers.

Based on the Mission Statement and these outcomes, the Department has established a variety of direct and indirect measures to assess the department’s success in achieving them.

Component 2 Description of the Direct and Indirect Measures Used to Assess

Direct Measures

1. Capstone Experience: All students seeking the Baccalaureate degree in Geography are required to complete one of the following courses
   GEOG 410, Geographical Techniques and Thought - 3 hours
   GEOG 415, Internship - 3-6 hours
   GEOG 416 (Renumbered from Geog 443), Applications of Geographic Information Systems - 3 hours
   
   Each of these courses requires the student to demonstrate a professional level of capabilities in Geography. Hence, any one of these courses may satisfy the Department's required Capstone Experience. Note that, as faculty resources, interests, and expertise are subject to change for a variety of reasons the following classes: Geog 440, Special Topics in Regional Geography; Geog 441, Special Topics in Human Geography; Geog 442, Special Topics in Physical Geography; Geog 443, Special Topics in Applied GIS, and/or Geog 499, Independent Study, may be substituted for the Capstone Experience, when offered. Normally, students participate in these courses during one of the last two semesters of their studies.
   
   Students are required to complete a form, at the beginning of the semester, requesting permission from the instructor to complete a capstone experience. The student, Instructor of Record, and the Department Chair shall sign the form. A sample permission form is linked.
   
   Typically, a Capstone Experience culminates in a major term paper, an oral presentation and/or a poster presentation, which is evaluated by the faculty. The goal is to demonstrate proficient communication skills at the professional level. However, Geography is a broad and diverse discipline, and there are many ways to communicate geographic data and analysis, including (but not limited to or requiring all)
   • Traditional term papers
   • Oral presentations
   • Poster presentations
   • Electronic products such as maps, interactive modules, and computer models
   • Advanced geo-spatial analysis
   • Presentation and interpretation of original field or laboratory research.
   
   Given the high level of diversity within the field of Geography and among the Geography faculty, the Department's Capstone Experience must allow students the opportunity to demonstrate communication of Geographic data and analysis at a professional level in a variety of formats, as outlined above. Accordingly, the course instructor will select the specific Capstone product for assessment in each course. (Standardized Assessment Rubrics: Student Research Assessment and Student Presentation Assessment).
   
   
   1. Geography 410 - Geographical Technique and Thought
      This is a culminating Geography course taken by senior Geography majors that encompasses the philosophy, central themes, and history of Geography and Geographic thought. A primary requirement of the course is completion of a substantial research project and class presentations. The nature and scope of the research project will vary, year by year, according to enrollment, student and/or faculty interest, and expertise. Hence the products of student research will vary as described above. Regardless, students are encouraged to develop poster and/or other forms of presentations for the annual/Spring Undergraduate Research Day program.
      
      Outcomes Addressed:
      Skills: 1 and/or 2 and/or 3 as determined by the course instructor
      Knowledge: 1 and/or 2 and/or 3 and/or 4 as determined by the course instructor
      Values: 1 and 2
      Participants: Geography majors.
      Evaluators: Two Faculty, selected by (but not including) the instructor of record, at least one of which must be from the Geography Department
       
   2. Geography 415: Internship - 1-6 hours
      The purpose of the Internship is to provide students with the opportunity to gain first-hand experience working in a professional environment where geographic/spatial knowledge and skill can be applied to real-life circumstances. It also allows the student the opportunity to develop the communication and cooperation skills that are essential to productive work as a professional.
      
      With the assistance of a faculty supervisor, the student will secure an internship with an appropriate firm (agency or business) that has direct interest and active work within the scope of the student’s geographic interests. The student enters into an informal contract with the firm - and with the approval of the faculty supervisor – that specifies the duration of the internship, the specific responsibilities of the student, and the types of activities the student will be involved with, and any salary to be paid to the intern. At the conclusion of the internship, the intern's supervisor completes an evaluation of the intern, the intern completes a “self-assessment” and the faculty supervisor completes an evaluation based on the firm’s assessment and the student’s assessment. (Evaluation Instruments: Supervisor Evaluation of Internship, Student Evaluation of Internship, and Faculty Supervisor Evaluation of Internship)
      
      Finally, the student is required to prepare a written report summarizing their internship experience and/or make a formal oral presentation to an audience composed of Geography faculty and students as well as invited guests.
      
      Outcomes Addressed:
      Skills: 1 and/or 2 and/or 3 as determined by the nature of the internship
      Knowledge: 1 and/or 2 and/or 3 and/or 4 as determined by nature of the internship
      Values: 1 and/or 2
      Participants: Geography majors opting for the Internship Experience
      Evaluators: Internship Supervisor, Student, Faculty Internship Supervisor, Geography faculty
       
   3. GEOG 416- Applications of Geographic Information Systems -3 hours (Renumbered from
      Geog. 443) Prereq: GEOG 315 and GEOG 316 or permission of instructor.
      This is an applied course focusing on selected topics(s) in geography and their GIS application. Students will work quasi-independently throughout the semester in demonstrating their understanding of, and ability to perform the ‘GIS Process’ through objective formulation, data identification and acquisition, database creation, manipulation/analysis and presentation of findings by applying them to a real-world spatial problem.
      
      Outcomes Addressed:
      Skills: 1 and/or 2 and/or 3, as determined by the course instructor
      Knowledge: 1 and/or 2 and/or 3 and/or 4 as determined by the course instructor
      Values: 1 and 2
      Participants: Geography majors
      Evaluators: Two Faculty, selected by (but not including) the instructor of record, at least one of which must be from the Geography Department
       
   4. GEOG 440; 441; 442, 443, 499
      
      GEOG 440 - Special Topics in Regional Geography - 1-3 hours
      Designed for a penetrating analysis of spatial distribution patterns of physical and cultural phenomena of selected world regions. The course will involve seminar presentations based upon library research.
      
      GEOG 441 - Special Topics in Human Geography
      Advanced, in-depth studies of various aspects of Human Geography.
      
      GEOG 442 - Special Topics in Physical Geography
      Advanced, in-depth studies of various aspects of Physical Geography.
      
      GEOG 443- Special Topics in Applied GIS - 3 hrs
      This is an advanced, applied course focusing on selected topics in Geography and their GIS application.
      
      GEOG 499 - Independent Study - 1-3 hours
      Independent investigation of a selected problem in geography under the direction of any Geography faculty member. Requires written report and/or an oral presentation. Permission of department chairman required to enroll.
      
      Outcomes Addressed:
      Skills: 1 and/or 2 and/or 3 as determined by the course instructor
      Knowledge: 1 and/or 2 and/or 3 and/or 4 as determined by the course instructor
      Values: 1 and 2
      Participants: Geography majors
      Evaluators: Two faculty, selected by (but not including) the instructor of record, at least one of which must be from the Geography Department
      
      It is important to note that student performance on assessment tools will not affect their course grades or graduation. Assessment is a tool to aid the faculty in making decisions that affect the future structure and direction of the Department. If the student's Capstone Product is also a required portion of a class for which they are registered, the student's course grade will be assigned by the instructor teaching the course, while the Capstone product will be evaluated independently by other faculty, as outlined above.
    

Indirect Assessment Measures

Surveys:

The Department will undertake two distinct surveys of current and former students:

1. Survey of Graduating Geography Majors:
   Each graduating Geography major will complete a Survey of Graduating Geography Majors. The purpose of the survey is to gather information from graduating seniors so the department can identify areas of deficiency or redundancy as well as success and, where appropriate, alter practices or structures to improve the quality of the undergraduate experience. The Survey is linked.
   
   Outcomes addressed:
   Skills: 1, 2, and 3
   Knowledge: 1, 2, 3, and 4
   Values: 1 and 2
   Participants: Graduating Geography Majors
   Evaluators: Geography faculty
    
2. Alumni Survey:Every three (3) years, the Department will send out an alumni survey to all Geography Majors, Minors and Endorsees who have graduated in the previous three (3) years. The Department currently maintains a database of approximately 300 graduates since the 1970’s. The specific focus of this survey is to determine if the Department's programs have prepared its students for the job market and/or graduate school. Of particular importance are the capabilities currently required to be successful in a profession or graduate school. Based upon the responses provided, the Geography faculty will determine what, if any, action is necessary to resolve any identified deficiencies. The Survey is linked.
   
   Outcomes addressed:
   Skills: 1, 2, and 3
   Knowledge: 1, 2, 3, and 4
   Values: 1 and 2
   Participants: Geography Alumni
   Evaluators: Geography faculty

Reporting and Using the Results of Assessment Information

Early in each Fall Semester, the Geography Department faculty will convene a special Assessment meeting at which time the results of all Assessment tools and findings will be discussed and considered. Based on the facts presented and responsible management of curriculum, the faculty may determine changes in the Department's curriculum as well as Departmental policies that may have impact on the assessment process.

Component 3 Report Of The Data Collected

2005 Capstone Assessment

Eight (8) Geography Majors graduated during the 2005-2006 academic year – three (3) in December 2005 and five (5) in May 2006. All of the graduated seniors completed one or more of the courses listed under the “Direct Measures” (below) however only two (2) students completed courses within this area during the 2005-06 academic year. Having completed their degree requirements prior to the establishment of the revised 2005 Capstone Experience as noted below, these students did not opt for formal designation of their course as a “Capstone Course.”

2005 Geography 410 – Geographical Technique and Thought Assessment

Geography 410 was not offered during the 2005-06 academic year. No assessment information or data are applicable

2005 Geography 415 – Geography Internship

One student (Student 9 above) participated in Geography 415 Internship during Summer 2006.

The Supervisor’s Evaluation was completed and returned to the Department September 15, 2006. 

The Supervisor noted, in response to the question “Did the Intern have sufficient knowledge to do the projects assigned?”:

Yes, with a minimal amount of supervision and training (Student 9) was able to pick up the complex set of decision criteria required to attribute the proper land cover types to the geo-database. She was able to discern appropriate landscape features that needed to be included in the hydrologic modifications database. Her technical training in GIS was sufficient to prepare her for the projects assigned” 

The Faculty Internship Supervisor conducted an on-sight visit to the US Fish and Wildlife Office on June 21, 2006 and met with both the Intern and her Supervisor. In separate interviews, both the Intern and Supervisor expressed enthusiasm for and satisfaction with the venture. The Intern demonstrated several elements of her work and explained the relationship of her work to the larger programs to which her work was integral.

2005 Assessment: Geography 416 – Applications of Geographic Information Systems

Students were required to perform a literature review of an application of GIS in their respective major / area of interest. From this they performed a GIS analysis of a project using the 'Steps in the GIS Process': formulation of a hypothesis and objectives for solving, identification of appropriate data to meet the objectives, construction of GIS database, manipulation and analysis of the respective datasets to produce a desired 'answer layer' and the presentation of the results (via a poster presentation) to demonstrate how their respective output met the objectives of the project. Students entered their posters in both the Great Plains Rocky Mountain - AAG regional meeting and UNK's Student Research Day. At the GPRM all four students were entered in the poster competition where a panel of judges both critiqued their work and interviewed them regarding their methods and outcome and provided them with feedback.

2005 Assessment: Geography 440 – Special Topics in Regional Geography: Great Plains

was offered Spring 2006. No assessment information or data are available.

2005 Assessment: Survey of Graduating Geography Majors

Eight students graduated in Geography during the 05-06 school year. Each received a Survey of Graduating Geography Majors. Four (4) students returned completed Surveys.

Questions 8 through 18 of the Survey ask for responses “which indicate your assessment of your level of attainment”:

Tabulation of responses:

2005-06 Geography Alumni Survey

The Survey of Alumni was mailed on October 13, 2006 to approximately thirty-five (35) Geography alumni who have graduated within the last 5 years. Results will be tabulated and included in the 2007 Assessment Report

Component 4 Interpretation Of The Data

During the 05-06 academic year, eight (8) students graduated with Geography majors. Each graduate completed (and passed) at least one of the courses identified in the Capstone requirement. However, few students completed the same Capstone course or, if they did, they completed the courses (s) prior to the institution of the current Assessment Plan. Only three (3) students from this group of graduates completed and passed a listed capstone course during the 05-06 academic year. This is too small a population for meaningful quantitative analysis.

Component 5 Actions To Be Taken Based On The Data

1. Considering that the number of students graduating w/Geography majors each year will remain in the single digits, it will be necessary, for assessment purposes, to do future assessment analyses based on cumulative numbers of graduates over 2-3 year periods in order to have sufficient data for quantitative analysis.
2. Geography faculty need to work closely with their academic advisees to insure that the students are fully aware of their Capstone obligations and to insure that each advisee completes at least one Capstone course that will produce assessable work.

Component 6 Evaluation Of The Current Assessment Process

The current Capstone portion of the assessment process is cumbersome. The Geography courses listed as fulfilling capstone purposes are a group of courses from which all Geography Majors will select one or more in the process of completing their degree requirements. Any one of the courses Geog 410, 415 or 416 is required. However, each of these courses has very different focuses. Geog. 410 has been primarily a geography methods course. Geog 415 is an “on-the-job” Internship. Geog. 416 focuses on advanced GIS and spatial analysis. Further, students may also opt for a “capstone” credit by taking any one or more of the courses GEOG 440, 441, 442, 443, or 499. This broad selection of courses my provide flexibility for students but it provides no clear common base from which reliable assessment determinations/evaluations can be made. The current process is akin to the “apples and oranges” comparison cliché.

The Geography faculty will refine the process to provide more structure to and clarification of the intentions and goals of the capstone experience.

Component 7 Actions To Be Taken In Making Changes To The Assessment Process

1. As noted in Component 6 discussion above;
2. Progressive cumulative data (2-4 years) collection in order to establish a sufficient base of information that will allow for reliable quantitative analysis.