Instructional Design and Technology

Get Started. It's Free
or sign up with your email address
Instructional Design and Technology by Mind Map: Instructional Design and Technology

1. Own overall reflection of instructional design and technology

1.1. Why using instructional design and technology?

1.1.1. Help users overcome a deficiency of skills and knowledge

1.1.2. Systematic process of developing instructional systems

1.1.3. Effective training & learning

1.1.4. Reach out to global market No limitation of location and time

1.1.5. Major approaches/strategies Interactive Collaborative learning Distributive: complex networks of information, resources, and instruction Social construct of knowledge Focus on constructivism Blending of different learning theories & models

1.2. A good instructional project may draw upon various theories and design models according to needs and situations

1.2.1. Ensure quality of design

1.2.2. Quality of delivery

1.2.3. Effectiveness of transfer of learning to intended outcomes

1.3. Change of roles for teachers/trainers & learners/users

1.3.1. Information presenter vs. facilitators

1.3.2. Passive learning vs. knowledge constructors

1.4. Successful instructional design and technology

1.4.1. Forming a good project team

1.4.2. Various needs analysis

1.4.3. Use of various theories, models and strategies under given situations, environment, resources and needs

1.4.4. Instructional designer-stakeholders collaboration Include various ideas, suggestions & perspectives

1.4.5. Monitor progress via using various evaluation strategies

1.4.6. Able to meet the learning objectives & outcomes

1.4.7. Alignment of needs, outcomes, assessments, and methods

1.5. Possible challenges & problems of instructional design and technology

1.5.1. Inconsistency between learning goals and the designs

1.5.2. Cater for diversity of users/learners Different learning styles Different abilities Different cultural backgrounds

1.5.3. Keep up with the rapid pace development of technology that can drive the instructional design

1.5.4. Constraints of the current situations Resources & technology Budget Expertise Working structure Interpersonal relationship Team work Sharing of goals and objectives Timeline

1.5.5. Mashup of technologies decrease creativities

1.6. Increasing trends

1.6.1. Systematic development of design

1.6.2. ICT reform embedding in whole school reform is esstential

1.6.3. Use of constructivist design and technology User generate content Collaboration among learners

1.6.4. Mobility & ubiquity of design & technology Any time Anywhere

1.6.5. Key approaches Learner- and user-centered Knowledge management Self-directed & lifelong learning Distributed learning Beyond the use of a single device Integrate different learning objects and technology to enable learning Mobile learning Online learning Informal learning Performance support Empower individuals

1.6.6. Instructional design usage Use of Web 2.0 Social networking as creation of knowledge Use of educational games Use of social media online Use of multimedia resources

2. Instructional Designs & Models

2.1. Own reflection on instructional designs and models

2.1.1. Instructional design models to design and manage a learning product development

2.1.2. The trends Use of Interactive, constructive and collaborative learning environments and tools Hands on experience Authentic task within real-word practice Learner/user-centered

2.2. Dimensions of design models (Edmonds et al., 1994)

2.2.1. Type of orientation The learning environment

2.2.2. Type of knowledge

2.2.3. Required expertise

2.2.4. Theoretical origins

2.2.5. Instructional context

2.2.6. Levels

2.3. 3D model of design documentation (Boot, 2005)

2.3.1. Building blocks for the production process Design documents as input Programming structures as throughput Learning materials as output

2.3.2. 3 major dimensions Stratification Degree of elaboration Formality

2.4. Shift of instructional design

2.4.1. Behaviourism

2.4.2. Cognitivism

2.4.3. Constructivism

2.5. 4C/IC model

2.5.1. Focus on integration and coordination of all skills

2.5.2. Distinction of supportive information and JIT information

2.5.3. Recommends mixture of part-task or whole-task practice

2.5.4. Schema construction for nonrecurrent aspects

2.5.5. Rule automation for recurrent aspects of skills

2.5.6. Aims at transfer of learning Use skills in real-life

2.5.7. 4 interrelated components Learning Tasks Concrete Authentic Whole task experiences Aim at induction Organized in wimple to complex task classes Learner support Learning tasks Supportive Information Information bridge prior knowledge and learning tasks Aim at elaboration Mental models Cognitive strategies Cognitive feedback Just-in-time (JIT) Information Information prerequisite to learning and performance Aim at compilation Preset when needed Fades away when learners acquire expertise Information display organization in small units Part-Task Practice Accurate performance of a recurrent skill Aim at rule automation Intermix with learning task Snowballing REP-sequences

2.6. Models base on Objectivism

2.6.1. Objective-Rational Instructional Design model (Willis, 1995) The process is sequential and linear Planning is top down and systematic Objectives guide development Sequencing and subskills Preselected knowledge Summative evaluation Objective data

2.6.2. Media-independent instructional design Base on cognitive load theory (Sweller) Split attention and increase cognitive load reduce transfer learning Deeper learning in media environemnts Depends on cognitive abilities and display elements Display of design is important Four physical attributes (Sanders & McCormick, 1993) Address both visual and verbal channels simultaneously Problem-solving transfer The methods Multimedia design principle Coherence design principle Spatial contiguity principle Temporal continuity principle Design principle Modality design principle Redundancy design principle

2.7. Models base on constructivism (C-DI)

2.7.1. General features & principles Knowledge is constructed through interaction with the environment and negotation Collaborative and cooperative learning Focus on group interactiion Constructive activity Collaborative learning tools Critical thinking and problem solving Conduct and manage own personalised learning activities Individual exploration and generate connections of information Prior knowledge affects the interpretation Self development responsibility Emotional intelligence self- concept building Cognitive conflict or puzzlement Stimulus for learning Determines organization and nature of what is learned Lebow's (1993) 8 principles Learning activities to a larger task complex Ownership of problem/task Authentic task Work in complex environment Ownership of the learning or problem solving process Learning environment that support and challenge the learner's thinking Test ideas against alternative views and alternative contexts Reflection on both the content learned and the learning process

2.7.2. Why use constructivist design? Creative and innovative Can measure student learning and assessing individual progress Unique and exciting learning environments Engage in authentic and meaningful tasks Engaged in negotiating meaning and in socially constructing reality

2.7.3. Major designs & models Constructivist-Interpretivist Instructional Design Model Design process is recursive, non-linear, and sometimes chaotic Planning is organic, developmental, reflective, and collaborative Objectives emerge from design and development work General ID experts do not exist Learning in meaningful contexts Subjective data Constructivist learning environment (Jonassen, 1998) The elements The problems for solving Assist solving problems Problem-based learning (Barrows,1985, 1986, 1992) Learner-centered learning environment Intentional process of constructing meaning Developing higher-order skills Manage own learning Use of media and technology Implementation Interactive multimedia learning environments Phase 1 Phase 2 Phase 3 Instructional Development Learning System (IDLS) Base on Constructivism Construct learning environment Design for lessons

2.7.4. Criticism of constructivist design Costly Require technology to implement Hard to evaluate

2.8. Classroom-oriented models

2.8.1. Gerlack and Ely (1980)

2.8.2. Heinich, Moldenda, Russell and Smaldina (1999)

2.8.3. Newby, Stepich, Leman and Russell (2000)

2.8.4. Morrison, Ross and Kemp (2004) A continuous cycle where revision is an ongoing process with all the elements Focus on 4 factors Learners Objectives Methods Evaluation 9 key elements Identify instructional problems, and specify goals Examine learner characteristics Identify subject content, and analyze task components State instructional objectives Sequence content within each instructional unit Design instructional strategies Develop the instructional message and delivery Develop evaluation instruments Select resources

2.9. Product-oriented models

2.9.1. 4 key assumptions The instructional product is needed Something needs to be produced Emphasis on tryout and revision The product must be usable by learners

2.9.2. Bergman and Moore (1990)

2.9.3. de Hoog, de Jong and de Vries (1994)

2.9.4. Bates (1995)

2.9.5. Nieveen (1997)

2.9.6. Seels and Glasgow (1998)

2.10. Systems-oriented models

2.10.1. Branson (1975)

2.10.2. Bentry (1994)

2.10.3. Dorsey, Goodrum and Schwen (1997)

2.10.4. Diamond (1998) Follows specific sequence Relies on the use of data Encourages team approach Emphasize ownership and involvement among various groups The design process Assessemnt Design Implementation Assessment Revision

2.10.5. Smith and Ragan (1999)

2.10.6. System approach model (Dick & Carey, 1978), Systematic design model (2001) Key components that interact together Instructor Learners Materials Instructional activities Delivery system Learning Performance environments The model Identify instructional goal(s) Conduct instructional analysis Analyze learners and contexts Write performance objectives Develop assessment instruments Develop instructional strategy Develop and select instructional materials Design and conduct formative evaluation of instruction Revise instruction Design and conduct summative evaluation

2.11. Models for distance education

2.11.1. Objectives-Resources-Activities (OAR) (Joeckel, Gardner and Jeon) Multilevel of factors affecting learning Social elements Physical elements Deliver through LMS Subject Matter Expert/Facilitator Focus on the learning system context Simple graphic-based aid Avoid the use of jargon Basic order of operations in the development process

2.11.2. Rowntree (1979) Introduction Overview of entire section What you have to do tasks Objectives of section Student profile Aims Constraints Select content Decide sequence Write up Assessment Evaluation

2.11.3. Koul (1995) Educational objectives Defining objectives Resources & constraints Media Language Finance Manpower Time Selection criteria Alternate methods of meeting objectives Alternate subject matter Choice of media Development, feedback and evaluation

2.12. Learning by doing model & methods

2.12.1. Learning Cycle Concrete Experience Reflective Observation Abstract Conceptualisation Active Experimentation

2.12.2. Dufour’s ‘Learning by Doing" Do Experience the activity Reflect Share Process Apply Generalize Apply what was learnt

2.12.3. Case-based reasoning method Solving new problems based on the solutions of similar past problems 4-steps process Retrieve Reuse Revise Retain Major criticism No guarantee that the generalization is correct

2.12.4. Resource-based learning Active processing of information Use authentic resources Main elements Resources and tools Activity/Task Support Evaluation Key advantages Encourage motivation Deepen understanding of subject matter Self-directed learning Increase ICT competence and confidence Skills acquired will be transferable to other areas Improve learners' attitudes Some difficulties Requires a resource-rich learning environment Some students will learn little from this method Not all teachers are good at collecting or creating the resources Teachers may not monitor activities effectively

2.12.5. Professional learning community (PLC) Continuous job-embedded learning for staff/educators Focus on learning rather than teaching Collaborative Culture Learning for all Collective inquiry For best practices Learning by doing Deeper and more profound knowledge Greater commitment

3. Designing Instructional/Learning Strategies and processes

3.1. Own reflection on instructional strategies

3.1.1. May use different strategies according to the given conditions, type of products, budget, resources and target audience

3.1.2. Roles of instructional designers Gather background and supplemental information Develop specifications and blueprints Establish and maintain schedules and deliverable deadlines Build the design Manage the training and documentation process Communicate concerns or issues to management Get feedback and make updates

3.1.3. Key elements for good instructional design Instructional designer-learners-stakeholders collaboration Instructional design expertise & experience Key factors to consider Pedagogy and design models Mode of learning Accessibility Resources Target audience Diversity of users/learners Copyright issues Ethical issues Plagiarism issues

3.1.4. The trends Increase of technology usage Current strategies seem to use various learning theories and models

3.2. ADDIE model

3.2.1. The 5 phases of instructional design Analysis phase Needs analysis Audience analysis Environment analysis Content analysis System analysis Feasibility analysis Risk analysis Developing proposal 4 basic phases of needs assessments (Klein, 1971) Design phase Define goal(s) Construct instructional analysis Analyze learners and context Write performance and learning objectives & outcomes Develop assessment strategy Arrange instructional events Select instructional methods Develop flowcharts Develop storyboards Evaluate storyboards Develop design specifications Develop prototype Evaluate prototype Review & evaluate project documentation Development phase Implementation phase Evaluation phase

3.2.2. Shortcomings of ADDIE Not leading to the best instructional solutions Not really the way instructional designers do their work

3.2.3. Models based on ADDIE Dick and Carey Model of ISD Assessments for learning objectives before designing and developing the instruction Emphasis on formative evaluation Revise instructions Rapid prototyping Saves time and money Catch problems while they are still easy to fix The model

3.2.4. Learning theories at design stage Behaviourism Cognitivism Constructivision

3.3. 9 events of instruction (Gagné)

3.3.1. 1. Gaining attention

3.3.2. 2. Informing learners of objectives

3.3.3. 3. Stimulating recall of prior learning

3.3.4. 4. Presenting the stimulus

3.3.5. 5. Providing learning guidance

3.3.6. 6. Eliciting performance

3.3.7. 7. Providing feedback

3.3.8. 8. Assessing performance

3.3.9. 9. Enhancing retention and transfer

3.3.10. Major criticism Oversimplify the learning process


3.4.1. Constructing an instructional project Overview Combination of RIOs Content items Practice items Assessment items Summary Assessment

3.4.2. RIO creation process Design Needs assessment Task analysis Learning objectives RIO types Develop Build RLO Build RIOs Alpha review Beta review Deliver Dynamic packaging CD-ROM ITL Evaluate Level 1 survey Level 2 assessment Level transfer Level 4 impact

3.5. ARCS Model of Motivational Design (Keller)

3.5.1. 4 steps for promoting and sustaining motivation Attention Relevance Confidence Satisfaction

3.6. instructional interventions

3.6.1. Enhance performance of academic tasks

3.6.2. Diversify instruction

3.6.3. Meet unique learning needs of students

3.6.4. Major strategies Utilize mnemonic cues Short sessions delivery of instructions Build frequent opportunities for movement during instruction Circulate among the students and observe and question them Make eye contact with students Use step-by-step instructions with illustrations Write instructions on the board Give students a task card Expectations of group behavior Provide examples and models Differentiate instruction Use peer learning Integrate cooperative experiences Use technological tools to access content Increase the use of visuals, charts, and models Anchor new knowledge to previously learned knowledge Work collaboratively on tasks

4. Learning theories

4.1. Own reflection on learning theories

4.1.1. Each group of theory has its own advantages and limitations

4.1.2. Learning is the interdependency of cognitive, emotional, social and environmental influences and experiences

4.1.3. Use of different theories in design according to needs and outcomes

4.2. Behaviourism (objectivism)

4.2.1. Key features & principles Objectives Observable changes in behvaiour Observable cause and effect relation Mind as black box Mind processes not improtant Behaviour can be explained without considering mental states Analyze tasks Break tasks in chunks Establish objectives Measure performance Predetermined observable and measurable outcome Intervenes in the learning process Execute the proper response

4.2.2. Major theories Classical conditioning (Pavlov) Natural reflexive or automatic learning Use stimulus for conditioning for target reponse Key elements Operant conditional (Skinner) Learning occurs when response to a stimulus is reinforced A feedback system Voluntary behaviors used in operating on the environment Key elements Social learning theory (Bandura) Modeling of behaviour, attitudes and emotions BOMS Model (Card, Moran and Newell) Human information processing model Predict user behavior Connectionism (Thorndike) Learning is connection between stimulus and response Accurate quantitative treatment of information

4.2.3. How do people learning? Positive & negative reinforcement Environmental stimuli Remember and respond Teachers present information and give feedback Role of memory Acquisition of habits Forgetting Practice or review Generalization Use of instructional cues and reinforcement

4.2.4. Impact on teaching and learning Learners' role Passive in responding to the environment stimulus Start off as a clean slate Behaviour shape though reinforcement Teachers' role Give reward or punishment on students' behvaiours Learning as the acquisition of new behaviour Facilitate mastery of the content

4.2.5. Major criticism Disregard the activities of mind Does not account for all kinds of learning Answers adapt their reinforced patterns to new information Cannot explain the acquisition of higher level skills

4.2.6. Application in the classroom Use reinforcement Memorizing content for target response

4.3. Cognitivism(objectivism)

4.3.1. Key features & principles Base on the thought process Open the black box Necessary for understanding how people learn Mind as information processor Mental models Info comes in being processed and lad to outcomes Mind attempts to make sense of the world Focus on how info is received, organized, stored and retrieved Learning is the change in schemta Thinking involves manipulation of representations Knowledge is schema Objective Analyze tasks Break tasks in chunks Establish objectives Measure performance Predetermined measurable outcome Intervenes in the learning process

4.3.2. Major theories Multimedia learning theory (Mayer, 2003) The principles 2 channels for processing information The process Active process of filtering, selecting, organizing, and integrating information Cognitive load theory (Sweller) Chunk information Auditory and visual methods Split attention effect Redundancy effect Worked-example effect Stage theory of cognitive development (Piaget) Developmental stage theory How to acquire, construct and use the nature of knowledge Cognitive development as the centre of human organism 2 Processes 4 stages Assimilation theory (Asusbel) Assimilation of new concepts into existing concept frameworks Attribution theory (Weiner) Explain the world Determine the cause of an event or behavior 3-stage process 3 causal dimensions Attributions Schema theory Organize schema: a mental pattern Component display theory 2 dimensions of learning 4 primary presentation forms Prescriptions relating the level of performance and type of content to the presentation forms Elaboration theory (Reigeluth) Organize content from simple to complex order Provide meaningful context Gestalt psychology (Tolman) Stimulus-stimulus Latent learning Mental models (Johson-Laird) Thought process How something works in the real world

4.3.3. How do people learn? Learning at a cognitive level Change of schemata Own perceptions of experience Mental process Thinking Memory Knowing Problem solving Active participation Remember rules, patterns and strategies

4.3.4. Impact on teaching and learning Learners' roles Recall schema Teachers' roles Provide new information that recalls and connects with the learner's previous knowledge Arrange practice with feedback Develop curriculum that enhances logical and conceptual growth Create active involvement of learner in the learning process

4.3.5. Major criticism Knowledge is viewed as given and absolute Does not explain how learner moves into next stage of cognition Does not account for social context Does not explain how learners apply rules and facts in unfamiliar situations

4.3.6. Application in the classroom Identify prerequisite skills Create tasks requiring increased level of processing Some strategies Schematic organization Analogical reasoning Problem solving Tasks analysis

4.4. Constructivism

4.4.1. Key features & principles Open-ended learning Learn by adjusting own mental models to accommodate new experiences Existing knowledge Social context Problem to be solved Negotiation Active construction of meaning (Piaget, 1977) Assimilate it into our existing knowledge Restructure our present knowledge to a higher level of thinking Collaborative participants Learning is both objective and subjective Methods and results of learning not easily measured Self-motivated Self-directed Interactive Lebow (1993) - 5 principles Buffer between the learner and the potentially damaging effects of instructional practices Context for learning Reasons for learning Relf-regulated learning Engage in intentional learning processes Twomey Fosnot (1989) - 4 key principles Learning New ideas Invent ideas Rethink old ideas and new conclusions

4.4.2. Major theories Constructive learning environment (Jonassen) Multiple representations of reality Authentic tasks Real-world, case-based learning environments Reflective practice Context- and content-dependent knowledge Collaborative construction Socio-cultural theory Mediation Zones of Proximal Development Internalization Cognitive Apprenticeship Assisted Learning Teleapprenticeship Scaffolded Learning Intersubjectivity Activity Setting as Unit of Analysis Distributed Intelligence in a Learning Community: Discovery learning (Bruner) Method of inquiry-based instruction Self discovery of facts and relationships Problem-based learning Hands-on, active learning Investigation and resolution of real-world problems Case-based learning Construct own knowledge by working on complex and real-life cases Situated learning (Lave) Learning is unintentional Occurs within authentic activity, context, and culture Cognitive apprenticeship (Collins et al.) Bring tacit processes out in the open People learn from one another Communities of Practice (Lave and Wenger) Groups of people Reconstructive Memory (Bartlett, 1932) Memory is reconstructive How memory stores meaningful information Make memories to fit in with personal schema Personal constructs (Kelly, 1991) Theory of personality Psychological processes are channeled by own of anticipation Build up a system of constructs Constructs are applied to anything we put our attention to

4.4.3. How do people learn? Search for meaning Active construction of knowledge From previous learning experience connect with new information Manipulate schemata Social negotiation

4.4.4. Impact on teaching and learning Learners' roles Information constructor Create own meaning of knowledge Elaborate, interpret and manipulate information Responsible for own learning Collaborate with others Teachers' roles As the facilitators Allow students to construct knowledge Design authentic situations/tasks Engage learners and provide challenges

4.4.5. Major criticism Too subjective Unpredictable outcomes

4.4.6. Application in the classroom Interactive learning Collaborative learning Hands-on problem solving Authentic learning

5. Instructional products (Delivery/Implementation)

5.1. Web 2.0 = Paradigm Shift

5.1.1. Increasing phenomenon Internet as platform Google docs Open source Data Mashup New models for resources sharing LMS New pedagogical practices in teaching Systems that learn

5.1.2. Tools & Applications RSS & aggregators examples Bloglines My Yahoo! Photopage Read-write web examples Blogs Wikis Social networking examples Facebook ebay Friendster Myspace Folksonomy Resources sharing and referencing systems (social bookmarking) Youtube Delicious CiteUike Podcasting examples iTunes Nature Digital portfolios examples Platforms examples Google Docs Zoho AirSet yackpack API for mashup examples Google maps Flikr Youtube Amazon

5.1.3. Devices promoting Web 2.0 Mobile and handheld Laptop Ultrabook Tablet

5.2. E-learning

5.2.1. Electronically supported teaching & learning

5.2.2. Information & communication systems

5.2.3. Networked learning

5.2.4. Use of multimedia via internet

5.2.5. Self-paced or instructor-led

5.2.6. Use Web 2.0

5.2.7. Suited to distance learning

5.2.8. Applications Web-based learning Computer-based learning Virtual education Digital collaboration

5.3. Mobile learning

5.3.1. Learning across contexts

5.3.2. Learning with mobile devices

5.3.3. Important part of informal learning

5.3.4. Support lifelong learning and self-learning

5.3.5. Decreases limitation of learning location

5.3.6. Functional framework Administration Scheduling Grading Calendars Reference ‘Office style’ tool Dictionaries Translators E-books Interactive ‘drill and test’ Animation Graphing Wireless response technology Microworld Models of real world Collaborative Co-presented games Collaborative environemnts Location aware Museum guides Augmented environments Data collection Note taking Sensor readings Data logging RIO creation process Design Develop Deliver Evaluate RIO creation process Design Develop Deliver Evaluate

5.3.7. Handheld devices Notebooks Ultrabooks Mobile phones/Smartphones Tablets PDAs

5.3.8. Technical and delivery support 3GP GPRS WI-FI

5.3.9. Some challenges Connectivity and battery life Ability to visualize how to using mobile learning Content security or copyright issue and private issue Accessibility and cost No restriction on learning timetable Developing an appropriate theory of learning

5.4. Instructional multimedia

5.4.1. Provide practice and feedback

5.4.2. Tutorial/instructional sessions

5.4.3. Games

5.4.4. Simulation or modelling

5.4.5. Graphics

5.4.6. Sound

5.4.7. Video

5.4.8. Examples of multimedia tools/authoring technologies Flash Autorware Dreamweaver Fireworks Photoshop Illustrator Premier

5.5. Learning objects

5.5.1. self-contained

5.5.2. Reusable

5.5.3. Can be aggregated

5.5.4. Tagged with metadata

5.5.5. Portability

5.5.6. Mutability

5.5.7. Key components General course descriptive data Life cycle Version Status Instructional content Glossary of terms Quizzes and assessment Rights Copyrights Restrictions on uUse Relationships to other courses Educational level Typology Presentation Practice Simulation Conceptual models Information Contextual representation

5.6. Project management

5.7. Own reflection on instructional products

5.7.1. Technology environments and tools support a variety of pedagogical approaches

5.7.2. Allow multiple ways of content presentation

5.7.3. Allow multiple and creative ways of knowledge construction

5.7.4. Enhance motivation

5.7.5. Increase commitment from learners/users

5.7.6. Increase accessibility

5.7.7. Increasing integration of Web 2.0 and and other instructional design and technology in education and other sectors

6. Evaluation and Revision

6.1. Own reflection on evaluation and revision

6.1.1. Addressing the achievement of target goal and outcomes

6.1.2. Feedback about achieving objectives is important

6.1.3. Having both formative and summative assessment would be optimal scenario

6.1.4. Use of research and development knowledge

6.2. 5 main purposes of evaluation (Bramley and Newby, 1984)

6.2.1. Feedback Quality control Link learning outcomes to objectives

6.2.2. Control Cost effectiveness Link training to organizational activities

6.2.3. Research Relationships between learning, training, and the transfer of training to the job

6.2.4. Intervention Influence the context

6.2.5. Power games Manipulate data for organizational politics

6.3. 4-level (step) model (Kirkpatrick)

6.3.1. Step 1: Reaction How well they learn?

6.3.2. Step 2: Learning What is learned?

6.3.3. Step 3: Behavior What changes?

6.3.4. Step 4: Results What are the tangible results?

6.3.5. Adaptation to Kirkpatrick's evaluation 1. Goals (Planning) What are the objectives? What must learners learn? What new knowledge, skills and resources are needed What must to be preceived 2. Levels of Evaluation Motivation Learning Performance Results

6.3.6. Major criticism 3 problematic assumptions The levels are not arranged in ascending order The levels are not causally linked The levels are positively inter-correlated Evaluation as an end of the process activity rather than ongoing process Only for training process, rather than other forms of learning

6.4. CIPP model (Stufflebeam)

6.4.1. Context Requirement to assess the environment

6.4.2. Input Resources for development

6.4.3. Process The way innovations are developed Initial effectiveness Innovation revision Similar to formative evaluation

6.4.4. Product Success of innovation in target environment Similar to summative evaluation

6.5. Types of evaluations

6.5.1. Formative evaluation (internal) Process focus On the fly Monitor instructional goals and objectives Analyze learning material Analyze student learning and achievements Analyze teacher effectiveness Catch deficiencies Allow interventions

6.5.2. Summative evaluation (external) Outcome focus End of the program Examples of instruments Questionnaires Surveys Interviews Observations Testing