From educational objectives to

Transcription

1 DAAD Quality Assurance in Higher Education and Bologna Reforms Workshop: Quality Assurance at Programme Level the case Engineering Tbilisi, Sep 29, 2010 From educational objectives to learning outcomes

2 Content 1. Principles and definitions 2. Reference frameworks for learning outcomes 3. From educational objectives to learning outcomes 4. Exercise 1: Defining programme learning outcomes 5. Exercise 2: Defining module learning outcomes 2

3 Quality Assurance at Programme Level >What is Quality? Measurability Certain objectives are met, >What is Quality Assurance? The process of making sure that the objectives defined correspond to the (learning) outcome of the educational process

4 Learning outcomes: Definition Learning outcomes are statements of what a student should know, understand or be able to do at the end of a learning activity. The learning activity could be a lecture, a lab, a seminar, a module (combining different forms of teaching and learning) or an entire programme. Learning outcomes must be simply and clearly described. Learning outcomes must reflect the level of capability as well as the range. Learning outcomes must be capable of being validly assessed. 4

5 Learning outcomes: Definition There is a distinction between intended learning outcomes (ILOs), i.e. written statements in a course/programe syllabus, and achieved learning outcomes (ALOs), i.e. those results that students actually have (and can be demonstrated to have) achieved. 5

6 Quality: Definition In our context, Quality means: Intended Learning Outcomes (ILO) are met, i.e. Actual Learning Outcomes correspond to the ILO

7 Correspondence of ILOs and ALOs ILOs learning outcomes / competence profile knowledge, skills, competencies job / career profiles occupational area(s) work environment(s) Input of HEI support processes e.g. student services, staff resources, infrastructure, programme structure, curriculum, didactic concept, quality assurance ALOs correspondence of educational objectives and learning outcomes results of outcomes assessment and internal/external evaluation Assessment of the process: coherence of goals, input + outcomes 7

8 Content 1. Principles and definitions 2. Reference frameworks for learning outcomes 3. From educational objectives to learning outcomes 4. Exercise 1: Defining programme learning outcomes 5. Exercise 2: Defining module learning outcomes 8

9 Learning outcomes: Reference Frameworks Learning outcomes for degree programmes and modules/courses should refer to established qualification frameworks to ensure compatibility, for example: European Qualification framework for Higher Education ( Dublin Descriptors ). EUR-ACE Framework Standards for Engineering Higher Education (EUR-ACE/ENAEE). ASIIN e. V. qualification framework for degree programmes in engineering, informatics, the natural sciences and mathematics. 9

10 Bologna: System of qualification frameworks Learning outcomes - European level EQF/Dublin Descriptors Learning outcomes - National level National qualification descriptors e. g.: Knowledge and understanding Skills and competences Learning outcomes - Programme level COURSE/MODULE LEVEL COURSE/MODULE LEVEL COURSE/MODULE LEVEL 10

11 Bologna: System of qualification frameworks Learning outcomes - European level EQF/Dublin Descriptors Learning outcomes - National level National qualification descriptors e. g.: Knowledge and understanding Skills and competences Learning outcomes - Programme level COURSE/MODULE LEVEL COURSE/MODULE LEVEL COURSE/MODULE LEVEL 11

12 Bologna: System of qualification frameworks Learning outcomes - European level Learning EQF/Dublin outcomes Descriptors - European level Translation into sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /- master for Chemistry 12

13 Bologna: System of qualification frameworks frameworks Learning outcomes - European level Translation into sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /- master for Chemistry Eg. First Cycle graduates should have the ability to apply their knowledge and understanding to analyse engineering products, processes and methods 13

14 Bologna: System of qualification frameworks frameworks Learning outcomes - European level Translation into sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /- master for Chemistry Eg. Graduates having completed a first cycle degree should have demonstrated: understanding the complexity of information problems and the feasibility of their solution 14

15 Bologna: System of qualification frameworks frameworks Learning outcomes - European level Translation into sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /- master for Chemistry Eg. Graduates having completed a first cycle degree are expected to be able to conduct risk assessments concerning the use of chemical substances and laboratory procedures. 15

16 Bologna: System of qualification frameworks frameworks Learning outcomes - European level Translation into sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /- master for Chemistry 16

17 Bologna: System of qualification frameworks Learning outcomes - European level + sectoral Frameworks e.g. EUR-ACE for Engineering Euro-Inf for Informatics Eurobachelor /-master for Chemistry Learning outcomes - National level National qualification descriptors Learning outcomes - Programme level COURSE/MODULE LEVEL COURSE/MODULE LEVEL COURSE/MODULE LEVEL 17

18 Bologna: System of qualification frameworks Learning outcomes - European level EQF/Dublin Descriptors Learning outcomes - National level National qualification descriptors e. g.: Knowledge and understanding Skills and competences Learning outcomes - Programme level COURSE/MODULE LEVEL COURSE/MODULE LEVEL COURSE/MODULE LEVEL 18

19 Bologna: System of qualification frameworks Learning outcomes - European level EQF/Dublin Descriptors Learning outcomes - National level National qualification descriptors e. g.: Knowledge and understanding Skills and competences Learning outcomes - Programme level COURSE/MODULE LEVEL COURSE/MODULE LEVEL COURSE/MODULE LEVEL 19

20 Professional and academic mobility A European approach Completion of the EHEA until 2020: choice Promotion of a of comparability and compatibility of Promotion of comparability and compatibility of degrees: wide variety of high quality courses; benefits of degrees: Completion of the European Higher Education Area until 2020, in which citizens can choose from a wide and smooth transparent order recognition of high quality courses procedures and benefit from smooth recognition procedures Academic Mobility Two cycle study system, ECTS, adoption of a system of easily readable and comparable degrees, Diploma Supplement, permeability of study structures Three cycle study system, ECTS, Diploma Goals: European knowledge knowledge society characterized society by Supplements, Promotion Permeability of the European Dimension of study in Higher structures high mobility and permeability, lifelong learning Education characterized by high mobility and permeability, lifelong learning Recognition of degrees Transnational cooperation in QA Common European Market Common European Market The European The European Directive Directive on on the the recognition recognition of of Goals: freedom of movement of workers, : professional qualifications : right of establishment, Goals: freedom of movement freedom of workers, right of of services. Goal: A clear, secure and quick system for the establishment, freedom services. recognition of qualifications in the field of the regulated Goal: A professions clear, secure is required to and ensure quick free movement. system for the Declaration of Lisbon, Barcelona: Professional Barcelona: to make Europe to the make most competitive and dynamic knowledge-based recognition Mobility The EC institutions of qualifications and member states in should the facilitate field of the Europe the most economy competitive in the world. and dynamic employment and the provision of services through regulated wholesale professions consolidation is of required the existing regimes to ensure of free knowledge-based economy in the world. professional recognition in the regulated professions. movement. Paris (1998) Bologna (1999) Prag (2001) Berlin (2003) Bergen (2005) London (2007) Leuven (2009) 20

21 ASIIN e. V. qualification framework: Definitions Qualification : Formal outcome of an assessment and validation process. Learning outcomes : Statements of what a learner knows, understands and is able to do on completion of a learning process, defined in terms of knowledge, skills and competences. Knowledge : Outcome of the assimilation of information through learning (theoretical and / or factual knowledge). Skills : Ability to apply knowledge to complete tasks and solve problems (cognitive skills such as logical, intuitive and creative thinking and practical skills such as manual dexterity and the use of methods, materials, tools and instruments). Competence : Proven ability to use knowledge, skills and personal, social and / or methodological abilities, in work or study situations and in professional and / or personal development. Based on the European Qualification Framework 21

22 ASIIN e. V. QF: Bachelor graduates... 22

23 ASIIN e. V. QF: Bachelor graduates... 23

24 ASIIN e. V. QF: Master graduates have... 24

25 ASIIN e. V. QF: Master graduates have... 25

26 Benefits of learning outcomes Help to explain more clearly to students what is expected of them and thus help to guide them in their studies. Help teachers to focus more clearly on what exactly they want students to achieve in terms of knowledge and skills. Help teachers to define the assessment criteria more effectively. Help to provide guidance to employers about the knowledge and understanding possessed by graduates of programmes. Important instruments in achieving comparability and transparency of qualifications and facilitating mobility (of students and graduates/professionals). 26

27 Potential problems with learning outcomes Could limit learning if learning outcomes written within a very narrow framework lack of intellectual challenge to learners. Danger of assessment-driven curriculum if learning outcomes are too confined. Could give rise to confusion among students and staff if guidelines not adhered to when drawing up learning outcomes, etc. Must reflect established national and cultural standards and practices in order to be accepted and useful. 27

28 Content 1. Principles and definitions 2. Reference frameworks for learning outcomes 3. From educational objectives to learning outcomes 4. Exercise 1: Defining programme learning outcomes 5. Exercise 2: Defining module learning outcomes 28

29 Student-centred approach Learning outcomes place an emphasis on the learner, and on the learner s ability to do something. Traditional approach: focus on teaching description of aims and objectives and use of terms like know, understand, be familiar with. Learning outcomes approach: Focus on what you want the student to be able to use of terms like define, list, name, recall, analyse, calculate, design, etc. 29

30 From Educational Objectives to Learning Outcomes Correspondence of educational objectives, programme learning outcomes and module learning outcomes. What is characteristic for graduates, what will they do in which environment? How do the objectives translate into a detailed competency profile of the graduates? How does the curriculum support learning outcomes and programme objectives? 30 30

31 From programme objectives... The overall objective of the undergraduate programme Chemical and Metallurgical Process is to educate professionals who are able to plan, control and monitor processes as well as to develop and operate chemical and metallurgical processes. In particular they should supervise processes, design and develop laboratory tests, identify and analyse problems and create and implement solutions. They should manage resources effectively and work in teams in an effective and creative manner. Students should be committed to quality, environmental protection and safety as well as to ethics. 31

32 ...to programme learning outcomes (1) Graduates should be able to operate and control chemical and metallurgical processes based on their knowledge of chemistry and of unit operations. They also should be able to apply their knowledge of chemistry, physics, mathematics and technology in chemical and metallurgical processes, to perform chemical analyses and metallurgical tests, and interpret results in order to improve processes. They should also be capable of designing chemical and metallurgical processes and of identifying, analysing and solving technical problems. 32

33 ...to programme learning outcomes (2) Furthermore, graduates should be able to work in teams, to know contemporary aspects of their profession and be prepared for lifelong learning. They should also apply environmental protection standards and demonstrate an ethical awareness towards their work. Furthermore, they should be able to manage both material and human resources effectively. 33

34 From Educational Objectives to Learning Outcomes: Example Educational Objective: Graduates are team oriented Programme Learning Outcome: Graduates are able to function effectively as member of a team that may be composed of different genders or cultural backgrounds Module Learning Outcome (e.g. for a module Team Project ) : Knowledge on: Methods and instruments of information research supported by electronic media; presentation and moderation techniques and their application; project planning tools. Skills: They are able to - gather information on a specific problem relevant for their project team and - communicate this information effectively; - assume the designed function within a team and independently fulfil the responsibilities associated with it; - accept the function and the personalities of other team members; - actively share their knowledge with other team members; - listen to other team members. 34

35 From Educational Objectives to Learning Outcomes: Example Educational Objective: Graduates take legal and ethical considerations into account when taking decisions Programme Learning Outcome: Graduates are aware of the social and ethical responsibilities that underpin their actions, and of the professional ethical principles and standards that apply to their chosen discipline, and able to apply them. Module Learning Outcome (e.g. as part of a module Software Engineering ): Knowledge on: Codes of ethics, laws, standards and guidelines relevant to software engineering; positions in the current discussion on software engineering and its impact on society. Skills: They are able to - make ethical decisions when faced with ethical dilemmas, with reference to general principles of ethics as well as codes of ethics for software engineering; - describe and apply the laws that affect software engineers, including laws regarding copyright, patents, and other intellectual property; - describe the effect of software engineering decisions on society, the economy, the environment, their customers, their management, their peers, and themselves; - understand the role of standards and standards-making bodies in software engineering. 35

36 The task of writing learning outcomes Learning outcomes should be clearly written so that they are understood by students, colleagues and other relevant stakeholders. When writing learning outcomes it may be helpful to focus on what you expect students to be able to demonstrate upon completion of the module or programme. Focus on specialist skills as well as on social skills. Avoid complicated sentences. If necessary use more than one sentence to ensure clarity. 36

37 The task of writing learning outcomes List the learning outcomes using a phrase like On successful completion of this module, students should be able to: [list of learning outcomes]. General recommendation: 5 to 8 learning outcomes per module. Avoid certain words. The key word is DO and the key need in drafting learning outcomes is to use active verbs. Avoid ambiguous verbs like understand, be familiar with, be exposed to, be aware, appreciate 37

38 Content 1. Principles and definitions 2. Reference frameworks for learning outcomes 3. From educational objectives to learning outcomes 4. Exercise 1: Defining programme learning outcomes 5. Exercise 2: Defining module learning outcomes 38

39 From Educational Objectives to Learning Outcomes Correspondence of educational objectives, programme learning outcomes and module learning outcomes. What is characteristic for graduates, what will they do in which environment? How do the objectives translate into a detailed competency profile of the graduates? How does the curriculum support learning outcomes and programme objectives? 39 39

40 Exercise 1: Programme learning outcomes a) Group: Chose one of your department s undergraduate programmes and write down the educational objectives. (10 minutes). b) Individual: Formulate 4 key learning outcomes for the selected programme, based on its educational objectives (adhesive labels). (10 minutes) c) Group: The group members collect their proposals on a joint sheet (5 minutes). d) Group: Jointly sort the proposals and group them by content/topic (10 minutes). e) Group: Formulate one programme learning outcome for each group of proposals and thus create a joint list (10 minutes). Please be prepared to briefly present your result to the plenary. Time available: 45 minutes group work 40

41 Exercise 1: Programme learning outcomes Objectives: You have formulated programme learning outcomes based on its educational objectives. You have experienced a typical situation of a programme coordinator who practices outcomeoriented curriculum development. 41

42 - Break - 42

43 Content 1. Principles and definitions 2. Reference frameworks for learning outcomes 3. From educational objectives to learning outcomes 4. Exercise 1: Defining programme learning outcomes 5. Exercise 2: Defining module learning outcomes 43

44 From Educational Objectives to Learning Outcomes Correspondence of educational objectives, programme learning outcomes and module learning outcomes. What is characteristic for graduates, what will they do in which environment? How do the objectives translate into a detailed competency profile of the graduates? How does the curriculum support learning outcomes and programme objectives? 44 44

45 Exercise 2: Module/course learning outcomes a) Group: Chose one of the programme learning outcomes you have just formulated and follow the instructions b) to e) b) Individual: Formulate knowledge and skills that describe the chosen learning outcome in more detail (adhesive labels). Question: What does one have to be able to do to demonstrate that the learning outcome has been achieved? (10 minutes) c) Group: The group members collect their proposals on a joint sheet (5 minutes). d) Group: Jointly sort the proposals and group them by content/topic (10 minutes). e) Group: Formulate/sum up one skill for each group of proposals and thus create a joint list of skills (15 minutes). Please be prepared to briefly present your result to the plenary. Time available: 40 minutes group work 45

46 Exercise 2: Module/course learning outcomes Objectives: You have transformed a learning outcome at the programme level into concrete and measurable learning outcomes at the level of a specific teaching module. You have experienced a typical situation of a programme coordinator who practices outcomeoriented curriculum development. 46

47 Exercise 2: Module/course learning outcomes Did you find these exercises challenging? In how far? 47