Assessment proxy · Taxonomy mismatch
Learning Standards Carry Events, Not Competence
SCORM, xAPI, cmi5 and LTI can move learning data between systems. They cannot turn a completion event into a reliable statement that a person can do the work.
What the wrapper says
SCORM, xAPI, cmi5 and LTI exchange learning activity and course-context records that a skills taxonomy may be asked to interpret as capability.
The all-clear
Learning standards are useful interoperability standards because they make content launch, activity records, tool access, grades, framework references, and achievement claims exchangeable between systems.
What is durable
Observed performance or validated evidence tied to a capability, condition and criterion.
Your training team had done the responsible thing.
They imported course completions from the LMS. xAPI statements from a simulator.
Grades from an LTI tool.
A handful of Open Badges.
All of it into the new skills graph.
The file was called capability_evidence_FINAL_v7_USE_THIS_ONE.csv.
Naturally, it had a column named proficiency.
Nobody put it there maliciously.
The board wanted a view of capability.
The workforce-planning model wanted a clean input.
The AI product wanted to recommend people for work.
A completion record arrived with a learner identifier, a course title, a status and a date.
What else could it possibly be?
Quite a lot, unfortunately.
A learning standard carries a record about learning activity. Competence is a claim about performance.
Those objects can be related.
They are not interchangeable.
SCORM, xAPI, cmi5 and LTI are very good at the jobs they were designed for.
They stop an LMS, a course, a simulator and a remote assessment tool conducting their own private data-exchange ritual involving a CSV, an SFTP folder and somebody called Denise who understands the field mappings.
They do not decide whether a person can do your work.
Four standards walk into a skills graph
Start with SCORM, because that is usually where the innocent-looking completion begins.
SCORM is designed for a self-contained web course that an LMS can import and launch.
The package is a ZIP archive with a manifest. Its sharable content object runs in the browser and talks to an exposed API.
That is a useful contract.
A course can launch elsewhere and report a conventional attempt.
The contract is not “this person can now perform the associated job.”
The completion status, success status and score fields all belong to one attempt, at one content object, in one LMS.
The content object supplies the score.
Its package can use its own rule or threshold for completion.
So a completion says the course completed, according to the package rule.
A raw score says the content object supplied a raw score.
Both can matter greatly.
Neither names the work condition, the performance criterion, or the evidence a capability decision needs.
xAPI travels more widely, which makes the confusion more efficient.
An xAPI statement is a sentence built from an actor, a verb and an object, each present exactly once.
Its result may carry score, success, completion, response and duration. Its context may carry a parent activity, a grouping, an instructor, a registration or a team.
A learning record provider creates the statement.
A Learning Record Store keeps it.
Excellent for keeping an event trail from a simulator, a performance-support tool, an offline application or an LMS.
It is not an epistemology engine.
Statements are immutable apart from limited processing fields.
A late correction needs a void or a superseding record, rather than a quiet edit after lunch.
Useful provenance.
Still an event.
cmi5 makes the next distinction pleasantly unglamorous.
It uses xAPI, and adds an LMS-constrained launch and lifecycle model. An assignable unit emits prescribed statements: launched, initialized, terminated, completed, passed, failed.
That constraint is exactly why cmi5 is useful.
A generic xAPI producer can say “experienced” and leave your LMS to contemplate the mysteries of existence. cmi5 gives it a defined launch context and predictable reporting.
But a passed lifecycle signal is still a signal. A point score and a pass-fail flag answer separate questions, and two tools can use both faithfully while meaning entirely different things by them.
LTI solves another problem altogether.
It lets an institutional platform give a remote tool a scoped launch context.
User.
Course.
Roles.
Resource link.
Available services.
It does not turn that tool into LMS-native content. And it does not make the tool’s internal telemetry a transcript.
Its advantage services add assignment and grade services, roster and role provisioning, and deep linking, so a tool can create its own line items and an instructor can select a resource.
Splendidly practical.
Also not a competence verdict.
The skills graph makes the mistake look official
The trouble starts when these records get attached to a skill label, and the attachment is read backwards.
Somebody completes a course aligned to “data analysis.” Your LMS sends a status. Your skills graph awards “data analysis.” Your talent marketplace proposes the person for work involving analysis they have never done.
The dashboard is very pleased with itself.
The work is less impressed.
This gets more dangerous when the label comes from a respectable taxonomy, because a respectable taxonomy makes the inference look like architecture.
Alignment says what the activity was intended to address.
It does not say the learner now meets the definition.
Which is not a subtle distinction, provided you keep the objects apart.
Capability is a versioned statement about something a person can demonstrate, under stated conditions, against a criterion.
Learning record is a source-system record that an activity occurred, or produced a particular result.
Taxonomy reference is an identifier and label used to organise or translate the capability statement.
Assessment evidence is the observations, conditions, instrument, scale and scorer provenance that can support a capability decision.
Flatten those four into a row and the AI sees a fact.
The original systems supplied several incomplete facts and a polite suggestion.
The standards are doing real work, which is the difficulty
None of this argues against learning standards.
They solve problems you would otherwise be solving by hand.
SCORM gives you portable package-and-runtime behaviour, wherever you launch it. xAPI gives multiple systems a common event format and a store that retains it. cmi5 gives xAPI a portable launch and lifecycle contract.
LTI gives remote tools controlled access to course context and grade services.
CASE adds the equally useful ability to publish competency definitions and their relations. Two systems can retain an opaque identifier and a human-readable statement from a framework authority.
An assessment item can point at a canonical definition, without anyone pretending the definition is a learner attempt.
Open Badges and Comprehensive Learner Records solve a different portability problem again. A badge assertion records one issued achievement for a recipient.
A learner record aggregates assertions.
The verifiable-credentials model supports cryptographically verifiable claims with multiple proof formats.
Keep all of it.
The thing to defend is the exchange.
The thing to resist is the category error that arrives afterwards, usually in a well-intentioned transformation job called derive_employee_skills.sql.
A signed credential can authenticate an issuer and protect integrity under its rules. It cannot establish that two issuers used the same rubric, the same conditions, or the same performance threshold.
CASE can publish a target.
It cannot validate the assessment.
LTI can return a score.
It cannot tell another tool what that score means.
Transport is not validation.
Build the evidence chain before the inference
The operational answer is not to discard completions.
It is to make the relationship explicit.
For every record you import, retain four provenance dimensions.
Source system.
Observation or issue time.
Identifier namespace.
Specification or profile version.
A derived value also needs its calculation date.
The gap between when an event happened and when the store received it matters when an offline tool synchronises late. Which is an everyday reality, not a philosophical exercise.
Then retain everything the standard does not normalize for you.
The assessment conditions.
The criterion.
The score scale.
The instrument.
And who or what produced the score.
Your system needs to know whether 92 is a point score, a percentage, a simulator measure, or an unhelpfully enthusiastic number emitted by an authoring tool.
Before it becomes any kind of evidence.
The capability reference needs its own version too.
Occupational and skill classifications revise their codes and their labels between editions, and a course-alignment field that stores only a label has already misplaced the thing it claims to classify.
So an internal canonical capability statement links out to a public framework, and the link says what kind of link it is.
Direct alignment.
Partial alignment.
Assessment target.
Supporting evidence.
Verified outcome.
Keep the external system and its version.
A mapping does not become more certain because it crossed an API boundary.
Finally, decide your inference rule before the AI arrives with a tasteful chart.
A completion may grant learning history.
A successfully scored assessment may grant supporting evidence.
Observed performance under retained conditions, against a stated criterion, may grant a validated capability claim.
And a missing scale, a missing scorer, or an ambiguous mapping routes to review. Not to a recommendation engine that has suddenly decided an employee is ready for a role.
The goal is not to make your graph less useful.
It is to stop it confidently recommending a person for work they have only watched a module about.
AI has made the shortcut irresistible
Learning systems evolved locally.
An LMS stored attempts.
A simulator stored its events.
A publisher tool stored grades.
A framework authority stored standards.
An issuer stored achievements.
Then organisations asked for one skills view, which was reasonable.
Then AI asked what every field meant, which was also reasonable.
And somebody handed it activity data with skill_name attached.
Good luck.
An AI system can ingest thousands of statements, lifecycle events, completion statuses and grades without becoming tired, distracted, or annoyed by the spreadsheet’s tab colour scheme.
That makes event data irresistibly easy to use.
It also scales every hidden ambiguity with impressive efficiency.
So the durable object has to be explicit in the schema. A versioned capability claim, supported by evidence, conditions, criterion and provenance.
And the wrapper has to be explicit too.
SCORM attempt. xAPI statement. cmi5 lifecycle record.
LTI grade.
CASE definition.
Badge assertion.
Once that distinction exists, automation has something honest to work with. It can find evidence, identify gaps, propose an assessment and explain its confidence.
It can stop treating course attendance as a career diagnosis.
That is not less ambitious.
It is merely the point at which your skills matrix stops confusing a receipt with the work.
What the record establishes
- Identify whether SCORM, xAPI, cmi5, LTI, CASE, or Open Badges carries an attempt, event, launch context, framework definition, or achievement claim.
- Separate a learning activity record from evidence that supports a capability decision.
- Store the source system, observation or issue time, identifier namespace, and specification or profile version with each imported record.
- Link learning statements to versioned capability identifiers without making a taxonomy label or course completion the capability itself.
- Retain assessment conditions, score scale, assessor or scorer provenance, and the evidence used before inferring proficiency.
- Set confidence and human-review rules before an AI system turns learning events into skills recommendations.
Asked in the review
- Does a SCORM completion prove that someone is competent?
- No. SCORM records the state of a learner attempt inside a Sharable Content Object and LMS relationship. In SCORM 2004, the package can send completion status, success status, raw score, location, interactions, and suspend data. The authored SCO supplies the score and can apply its own completion rule. Those fields document a particular attempt; they do not establish performance under a stated work condition and criterion.
- What does an xAPI statement actually say?
- An xAPI Statement records an experience as an actor, verb, and object. Its result can include completion, success, response, duration, score, and extensions, while context can identify an instructor, registration, parent activity, team, or platform. The learning record provider constructs the Statement and the Learning Record Store retains it. The standard does not decide whether a supplied score is comparable, valid, or sufficient evidence of competence.
- Why is cmi5 different from ordinary xAPI?
- cmi5 uses xAPI records but adds a defined LMS launch context, Assignable Units, course-structure exchange, and constrained lifecycle statements. Its scope includes LMS launch, runtime data transport, course definition, and reporting. That structure makes completion and progress more predictable for an LMS than a generic xAPI event stream. It still does not make different assessment scales equivalent or turn a passed lifecycle signal into demonstrated workplace capability.
- Does an LTI grade tell a skills system what a person can do?
- An LTI grade is a platform-facing outcome from a remote tool, not a complete account of learner performance. LTI 1.3 passes scoped user, course, role, resource, and service context. LTI Advantage adds Assignment and Grade Services, Names and Role Provisioning Services, and Deep Linking. A score can be useful evidence when its assessment conditions and scorer are known, but the exchange standard does not supply a universal proficiency meaning.
- What belongs in a capability claim besides a course record?
- A capability claim needs the capability identifier and version, the observed performance or validated evidence, the conditions of the assessment, the criterion applied, the score scale where relevant, and the provenance of the scorer or assessment system. A source system, observation or issue time, identifier namespace, and specification or profile version are also required to preserve lineage. Without those fields, copied events become apparent facts with no interpretable basis.
- Can CASE tell whether a learner has met a standard?
- No. CASE publishes competency or academic-standard definitions and their relationships through exchange bindings such as REST and JSON-LD. It can give an assessment or credential a portable reference to a published statement. CASE does not carry a learner attempt, determine whether an assessment is valid, or decide whether an achieved score represents competence. Learner-specific evidence must come from a separate assessment, portfolio, or achievement process.
- Does a digital badge settle the competence question?
- No. An Open Badges 3.0 Assertion binds one achievement to a recipient and can carry an issuer, issue or expiry date, result, and evidence. A Comprehensive Learner Record aggregates assertions, and a Verifiable Credential can protect issuer and integrity under its verification rules. Those formats make an issuer's achievement claim portable. They do not prove that different issuers used the same rubric, conditions, or performance threshold.
- Why must a skills system keep taxonomy versions?
- Taxonomy identifiers and labels change meaning across releases. O*NET-SOC 2019 aligns with the 2018 Standard Occupational Classification but is not the same system. Its 2010-to-2019 crosswalk contains code changes and title changes, including cases where a stable code has a revised title. A learning record linked only to a current label cannot reliably show which capability definition was intended when the evidence was created.
- What should an AI system do with completion data?
- An AI system should treat completion data as a learning trace, not as a proficiency fact. It can use a SCORM state, cmi5 lifecycle statement, xAPI event, or LTI outcome to find relevant evidence and recommend a next review. Before awarding a skill or recommending a person for work, the system needs explicit confidence rules, a versioned capability reference, assessment conditions, score meaning, and human-review handling for weak or missing evidence.
- Can two scores from different learning tools be compared directly?
- Not automatically. xAPI allows a result score, cmi5 can report lifecycle outcomes, SCORM can carry raw score fields, and LTI Assignment and Grade Services can return a platform grade. Each value originates in authored content or a tool, and the standards do not normalize its scale or assessment method. A point score and a pass or fail signal answer different questions unless an organization has defined a valid common interpretation.
- What is the safest way to link learning records to a skills taxonomy?
- The safest link keeps the learning record and capability definition as separate objects. The record retains its source system, timestamp or issue time, identifier namespace, standard and version, and assessment provenance. The capability retains a versioned identifier from the selected taxonomy or a canonical internal statement. The relationship records whether it is an alignment, an assessment target, supporting evidence, or a verified outcome, rather than silently converting attendance into proficiency.