Son-of-Fire's Learning Landscape Headline Animator

Wednesday, December 10, 2008

Analysis and Planning: Technical and Media Specifications Analysis

A technical and media specifications analysis should identify the technical, graphical, and media-based requirements and constraints to assure eLearning delivery is compatible with the hardware and software requirements of the stakeholder’s learning base. Graphic look, feel, and specifications should be identified. Requirements should be mapped into courseware development. Summaries for technical and media specifications should be submitted. Data collected at this stage should:
  • Identify infrastructure capabilities for courseware delivery
  • Identify requirements for optimal delivery media
  • Identify stakeholder standards for text, graphics, media, and branding
Risks if not conducted or conducted improperly:
  • Graphics and media that do not meet the standards and satisfaction of the stakeholder
  • Incorrect delivery formats
  • Product failure due to incompatibility of delivery medium and/or components to the hardware and software requirements of the stakeholder and/or the stakeholder’s customers
  • Missed deadlines and extended project plans that do not meet stakeholder expectations
In the end, all analysis data (organizational, task-KSA, learner, and technical/media specifications) should be used to design a learning solution that:
  • Is based on the needs of the organization/department
  • Addresses the gap between the required task-KSAs and what’s actually done by the learner on the job
  • Is delivered using the appropriate mediums and technologies that map to learner profiles
Enough with Analysis. We move to the Design phase next.

Monday, December 8, 2008

National Learning Week

We will get back to ISD, the ADDIE model, and analysis in my next post, but this is a good time for a break because it’s ASTD National Learning Week. The local ASTD chapter I serve sponsored and prepared for this by asking members to provide some learning tid-bits that fit within an acronym we defined for L-E-A-R-N:

L - Learning

E - Evaluation or eLearning

A - Assessment or Activities

R - Reinforcement or ROI

N - Networking

They are posting and distributing responses out to members with one letter of the acronym for each day of the week. Here is my submission:

L:
At some level, we are all in the business of Learning, but what do we mean when we refer to learning, behavior, or training? The following definitions can be useful from an operational standpoint... Let’s start with our subject - the learning-participant or learner. The assumption is that learners behave in a certain way until they learn to behave in another, through some sort of experience. Let’s define behavior as something that a participant does that can be observed and measured. If so, then we can agree that any measurable change in behavior is some sort of learning. That being said, the training experience needs to be the purposeful cause of that measurable change in behavior so that what is learned is consistent and applicable.

E:
Some Evaluation questions to ask your self after learning events or better yet - to prepare for during course development: Do they like it? Do they know more now than they did before training? Can they do more now than they could before training? Are work-performance outcomes better now than they were before training? Are departmental or business metrics better now than they were before training? How am I ruling out confounding variables (reasons “other than training” for your evaluation data)?…

A:
What to analyze when Assessing the need for training: Define the sponsoring organization’s/department’s mission, goals, vision, culture, obstacles to performance and budget for training. Identify and what learners need to do in “an ideal world” for their job-roles in terms of tasks, knowledge, skills, and abilities. Validate what learners are actually doing in “the real world” for their job-roles in terms of tasks, knowledge, skills, and abilities. Identify the capabilities and limitations of your learners in terms of education-level, experience, and available technologies. Use assessment results to design and develop content that focuses on the gap between the ideal and real world requirements while accounting for organizational needs and learner capabilities.

R:
When designing and developing content, apply Reinforcement principles to learning events as ABCs:

A = Antecedents – or what happens before any change in behavior, in our case a learning event that is aligned with the learner’s needs and is effectively delivered before the she meets the learning objective.
B = Behavior – is what the learner does; ideally, meeting the learning objective.
C = Consequences – these are are anything that happens after behavior that can either reinforce (increase the likelihood) or punish (decrease the likelihood) that what was learned will be applied on the job. Build and deliver activities that reinforce: Tell’em > Show’em > Let’em Try It (guided) > Let’em Apply It (unguided) > and Test’em. Also, use reminders, job aides, feedback, and supervisor support to reinforce behavior back on the job.

N:
Use social Networking and Web 2.0 tools to learn: Blog to broadcast subject matter expertise; micro-blog to keep your team abreast of newly learned knowledge and skills; write wikis to share and update reference-able knowledge-bases between team members; video short info-bytes or demonstrations from vid-cam at your desktop for your corporate YouTube. Don't have a budget? Get permission to use free tools like Blogger, WordPress, PBwiki, WetPaint, Twitter, Google Docs and Reader.

Happy National Learning Week!

Saturday, December 6, 2008

Analysis and Planning: Learner Analysis

The Learner Analysis identifies what is actually done on the job and required in the real world. A learner analysis (also known as a Person Analysis) should identify the range of learner needs based on the differences between job demands and role characteristics to assure coverage of the gap between actual learner skill sets, the expectations and standards established during the organizational analysis, and the criteria set from Task-KSA Analysis. Based on subsequent technical and media specification analysis, large differences in learner groups such can be leveraged into an appropriate medium through design and delivery supports or facilitated through blended delivery media. Learner analysis role-summaries should be submitted. Data collected at this stage should:
  • Identify logistics of the base learning pool
  • Detail role characteristics for learner profiles
  • Gauge current performance measures and characteristics for comparison against what is required in training
  • Develop an approach to providing targeted recurrent training based on identified performance gaps as required by stakeholder
  • Ensure training program complements activities relating to recruitment and performance appraisal as required by stakeholder
Risks if not conducted or conducted improperly:
  • Not understanding the learner - your customer
  • A course that does not focus on the gap between tasks/KSAs assessed as required in “a perfect world” and task/KSAs the learner was doing before the learning event in “the real world”
  • Delivery modalities that do not meet the differing needs of course participants
  • Training that does not result in improved on the job performance criteria
  • Dissatisfied course participants and a dissatisfied stakeholder
We will review technical and media requirements next.

Wednesday, December 3, 2008

Analysis and Planning: Task-KSA Analysis

The Task-KSA Analysis identifies what should be done on-the-job in the ideal world. A task-knowledge-skill-ability (Task-KSA) analysis targets the critical tasks, knowledge, skill-sets, and criteria required for performance-based behavior and outcomes resulting from courseware delivery. Task-KSAs are commonly referred to as competencies, and should be obtained from:
  • Existing courseware provided by the stakeholder when possible
  • Supporting documentation as provided by the stakeholder when possible
  • Information as solicited through Subject Matter Experts (SMEs) provided by the stakeholder
This data should support the training content for design and courseware development. Criteria from identified tasks and required KSAs should be mapped to the learning objectives of the course design and testing criteria for evaluation as facilitated by the learning management solution. Task-KSA documents should be submitted, which will be used to support design documentation. Data collected at this stage includes:
  • Identification of critical tasks, knowledge, skills, and abilities
  • Identification of critical success factors for training outcomes
  • Review of existing curriculum and suggest necessary modifications
  • Specification of information sources/references
  • Development of parameters for on-the-job training
  • Development of parameters for training targeted to specific technologies/equipment
  • Development of performance metrics and standards to govern the training process, as well as learner performance
Risks if not conducted or conducted improperly:
  • Coverage of material already mastered by course participant/learners
  • Missing coverage of material required on the job for course participant/learners based on material not captured during the Task/KSA Analysis
  • Loss of internal and predictive validity as there is no baseline for success comparison
  • A course that does not focus on the gap between tasks/KSAs assessed as required in “a perfect world” and task/KSAs occurring in “the real world”
  • Delivery modalities that do not meet the differing needs of course participants
  • Training that does not result in improved on the job performance criteria
  • Inhibited transfer of training due ignorance of group perceived function and/or climate issues not planned for during training design (e.g. The difference between how upper management perceives what is required for sales database training and what sales people out in the field perceive as required)
  • Dissatisfied course participants and a dissatisfied stakeholder
We talk about Learner Analysis next.