Wiki source code of Assessment Methods

Last modified by Simon Rath on 2022/02/23 18:07

version	line-number	content
1.1	1	(% class="jumbotron" %)
	2	(((
	3	(% class="container" %)
	4	(((
3.1	5	= Assessment Methods =
1.1	6
3.1	7	Assessment can be done using different types of tools and methods. The choice of the method depends on what is to be measured and how assessors can obtain the most objective result within the limitations of a testing setup. The TeBeVat project developed a standardised list of acceptable assessment methods. The use of these methods for a specific competence guarantee that the competence is measured in a by the sector accepted way.
1.1	8	)))
	9	)))
	10
	11	(% class="row" %)
	12	(((
	13	(% class="col-xs-12 col-sm-8" %)
	14	(((
15.1	15	= 1. Valid Assessment Methods =
1.1	16
14.1	17	== 1.1.[[ Portfolio>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Structured Portfolio.WebHome]] ==
3.2	18
6.3	19	In the portfolio, several methods are linked to one another in order to represent the individual skills of the learner in an objective way. Portfolios are used in the assessment to gain comprehensive insight into the achievements of the candidates. When creating portfolios, the candidates learn to assess themselves and their qualities. In the assessment process, a third party assesses the portfolios as a jury to increase validity and to ensure equality and fairness in the validation process. Validity, reliability and authenticity are increased by using a variety of methods. Through self-reflection, portfolios can help the candidate in the validation process to receive jobs or appropriate further education later on. Even if these methods are time-consuming for the candidate, they have the opportunity to present their skills in a flexible way. However, implicit knowledge can only be shown with difficulty using this method. A mediator can help to focus on the essential elements when creating a portfolio.
1.1	20
6.3	21	The portfolio can include a curriculum vitae, reflections on informally acquired skills, working documents and learning diaries. The candidate learns through the process-oriented method of the portfolio that every learning is a life story.
	22
14.1	23	== 1.2. [[Lifelong-Learning-Document-Tool (LLDT)>>doc:TeBeVAT Process.Documentation.Lifelong Learning Document Tool.WebHome]]: “Structured Portfolio”: Self-Evaluation/Identification Phase + Mentor ==
1.1	24
6.3	25	The LLDT offers candidates the chance to record and disseminate their acquired competences and skills.
1.1	26
6.3	27	It can also be an assessment tool (Self-Evaluation).
1.1	28
14.1	29	== 1.3. [[Observation in a Simulated Environment>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Observation in simulated environment.WebHome]] ==
10.1	30
	31	The candidate is observed in a simulated situation. This method is used for skills that can be shown in the workspace. The advantage is that all factors are under control. The disadvantage is that it is less a real-life situation. (For example, it doesn’t take in account the stress caused by audience.)
	32
15.1	33	== 1.4. [[Observation in a Real-Life Environment/On Site>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Observation on Site.WebHome]] ==
10.1	34
	35	The candidate is observed in a real-life situation. This method is used for skills that can be shown on the workspace. The advantage is that this is the closest to reality. The disadvantage is that the testing set-up is not fully under control. (For example, you can’t foresee the content and technical needs of a play.)
	36
15.1	37	== 1.5. [[Post Box Exercise>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Post Box Exercise.WebHome]] ==
10.1	38
	39	This method is used for skills that result in a written or drawn result. The candidate gets an assignment on paper and has time to prepare the written result. The result is checked with a prepared checklist of sample solutions. Examples or results could be personnel planning, a light plot, an Email…, The advantage is a high certainty of competence, compared with assessing prior work. For more artistic skills, this can be combined with a role play or an interview.
	40
15.1	41	== 1.6. [[Role Play>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Role Play.WebHome]] ==
10.1	42
	43	This method is used to assess inter-human or artistic skills. The candidate is placed in a situation with an actor as counterpart. The actor steers the situation, based on a predefined scenario, passing specific realistic situations. Observation is done based on a checklist.
	44
15.1	45	== 1.7. [[Criterion Based Interview>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Criterion Based Interview.WebHome]] ==
10.1	46
	47	Is based on an interviewing technique using principles of the STARR method:
	48
	49	* S: What was the situation?
	50	* T: What was your task?
	51	* A: What actions did you take, what did you do?
	52	* R: What was the result, what happened?
	53	* R: What did you learn (Reflection)?
	54
	55	It gives the candidate the opportunity, guided by directional questions, to demonstrate his/her skills, based on a concrete situation that happened in the own professional life. By focussing on the measurable aspects of a task, and narrowing, but deepening the focus, this is a good method to get a second opinion where competences did not become visible in testing or portfolio (not good or bad). The method needs highly skilled assessors. It is useful as extra tool to assess skills that are not observed (in positive nor negative way). It can also be used for situations that can’t be simulated, like an accident, audience panic or fire.
	56
	57	Theoretically the interview is based on past experience, however: it is also possible to use a hypothetical context.
	58
	59
15.1	60	== 1.8. [[Written Test (Multiple-Choice)>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Written Test - Multiple Choice.WebHome]] ==
10.1	61
	62	Is used to check knowledge but is only limited useful to test skills. Good tests are difficult to develop and there is always the possibility of “gambling”. This is only useful if knowledge can’t be tested by observing skills. The advantage is: it’s easy and fast and doesn’t require specialized assessors.
	63
	64	There are two forms of Multiple-Choice tests:
	65
	66	* Multiple-Choice test consists of questions where only one answer can be correct.
	67	* Multiple-Response tests consists of questions where //several //answers can be correct.
	68
	69
15.1	70	== 1.9. [[Written Test (Open Answers)>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Written Test - Open Answers.WebHome]] ==
	71
10.1	72	Is used to check knowledge or situational interpretation. The disadvantage is that it checks more the skill to express yourself on paper than it checks the real ability to perform in real life. It proves you know how to act, but not that you are able to act. Answers are checked against a checklist but need interpretation of skilled assessors.
	73
	74
15.1	75	== 1.10. [[Oral Test>>doc:01 Sectoral Layer.Sectoral Layer Glossary.Oral Examination.WebHome]] ==
	76
10.1	77	Evidence must include the questions asked as well as a transcript of the learner’s exact responses. This could be written or an audio or video recording
	78
15.1	79	Tests can be effectively used to assess detailed knowledge competences.
10.1	80
	81
15.1	82	== 1.11. [[Pitch/Presentation/Gaming>>Pitch/Presentation/Gaming]] ==
	83
10.1	84	Modern technology can be integrated into the assessment methods. It is important to define the competences being assessed: the use of the technology itself or a competence that can be assessed using a new technology.
	85
15.1	86
6.3	87	= 2. Forms of Evidence =
3.2	88
10.1	89	== 2.1. Artefact/Product ==
1.1	90
6.3	91	Where competences and skills require candidates to produce an artefact or physical product, the artefact or product must be provided for the TeBeVAT-Mentor and TeBeVAT-Assessor.
1.1	92
6.3	93	Learner evidence must include:
	94
	95	* Details of the tasks set for learners to complete, mapped against the assessment criteria of the units addressed,
	96	* A learner declaration that all work produced is their own,
	97	* Summative learner generated assessment evidence - teaching materials must not be included as evidence.
	98
15.1	99	== 2.2. Recorded Activity/Practical Ability ==
3.2	100
6.3	101	Evidence must be provided of the candidate individually and actively completing tasks that demonstrate achievement of the assessment criteria. Evidence may be assessed by direct observation of performance and must consist of at least two of the following:
1.1	102
6.3	103	* Annotated photographs
	104	* Detailed witness statements
	105	* Video (with narration or written log)
	106	* Learner log/evaluation
	107	* Peer observation report
	108
	109	N.B.: Where photographs/videos are used, each individual learner must clearly be identified.
	110
1.1	111
15.1	112	== 2.3. Evidence of Assessment ==
	113
6.3	114	It is essential that evidence of assessment is identified individually. Awarding organisations and centres offering these assessments must also satisfy the assessment and quality assurance requirements of the TeBeVAT-Process.
1.1	115
	116
15.1	117	== 2.4. Certificates and Qualifications ==
	118
6.3	119	It is important that the three levels of quality assurance regarding certification quality: Input/Process/Output, are taken into consideration when trying to assess and validate certifications provided. Qualifications should be checked with cedefop’s (European Centre for the Development of Vocational Training) definition of certification which refers to ‘individuals achieving learning outcomes that ‘match’ specific standards and/or requirements’. Thus, learning outcomes-based standards should be a key element in the certification process.
3.2	120
6.3	121	Learning outcomes are ‘statements on what a learner knows, understands and is able to do on completion of a learning process, which are defined in terms of knowledge, skills and competence’.
	122
3.2	123
15.1	124	== 2.5. Witness Statement/Peer Evaluation ==
	125
6.3	126	If accrediting prior learning the assessor would not necessarily be able to observe the candidate carrying out certain aspects of their job. If this happens, it might be appropriate for another person to comment on their performance by completing a statement called a “witness testimony”. Witness statements should be used only to support other forms of evidence such as a product. It should:
3.2	127
6.3	128	* Be provided by a person who is not related to the candidate and is in a position to make a valid comment about their performance, e.g. a supervisor, line manager, a client or customer
	129	* Contain comments that relate specifically to the performance criteria
	130	* Be authenticated by the inclusion of the witness’s signature, role, address, telephone number and the date.
	131
3.2	132
15.1	133	== 2.6. Contracts and Work Sheets ==
	134
6.3	135	* Proof needs to be of recent date. How long ago is this evidence delivered and what does this say about the mastering of the process now?
	136	* Is the evidence verifiable?
3.2	137
	138
15.1	139	== 2.7. Requirements for Forms of Evidence ==
	140
6.3	141	* Authentic: it must be clear that the evidence was truly executed or accomplished by the candidate or is related to the candidate. The experiences must be gained from activities that were carried out independently, or in groups where the candidate's own substantive contributions have been significant for the results.
	142	* Relevant: related to the competence being assessed. The experiences must have been gained in relevance to the occupational profile function. The candidate must indicate which tasks and activities he/she has executed and what results these activities have yielded. They must also indicate why they are relevant to the activities performed.
	143	* Of a sufficient level: the evidence must reflect the competence level expected for the qualification or certificate
	144	* Up to date: still have value in a current working environment
	145	* Quantitative: the evidence must be of sufficient volume, supported by sufficient experience (time accomplishing a competence)
	146	* Varied: making the breadth and scope of the experience concrete. Preferably the candidate presents evidence from different “angles” (not one-sided).
3.2	147
15.1	148
6.1	149	= 3. Assessment: “Triangulation” =
3.2	150
6.3	151
	152	The scientific method triangulation should be used as often as possible during assessment. Triangulation means using more than one method to collect data on the same topic. It is a way of assuring and increasing the validity – measuring what you want to measure – of research through the use of a variety of methods to collect data on the same topic, which involves different types of samples as well as methods of data collection.
	153
	154	For example, a common form of triangulation is using contrasting research methods such as observation and a (semi)structured interview, plus a self-assessment (which is a valid method if combined with others and when the bias of 'social desirable answers’ is considered.
	155
3.2	156
15.1	157	== 3.1. Procedures ==
	158
6.3	159	All assessment methods must be integrated into assessment procedures. There should be an informative part of the procedures before the assessment to enable the candidate to be comfortable with the process.
	160
	161	To ensure a path for equal opportunity candidates with special needs must be offered solutions to go through the assessment process that allow for adaption of the procedures and methods without influencing the validity of the assessment.
	162
	163	For example: a written test could be changed to an oral examination insofar that reading competences play no role in the competence assessed.
1.1	164	)))
	165
	166
	167	(% class="col-xs-12 col-sm-4" %)
	168	(((
	169	{{box title="Contents"}}
	170	{{toc/}}
	171	{{/box}}
	172
8.1	173
1.1	174	)))
	175	)))

Wiki source code of Assessment Methods

TeBeVAT Menu