Your self-study isn't the only document your CoA reads. It's the one that gets the most attention in the weeks before submission — but the annual report is the one that keeps coming back, every year, for as long as your accreditation holds. And it's built on three numbers: how many of your students stay, how many of your graduates pass the exam, and how many find work. CAAHEP calls these program outcomes — retention, credentialing, and placement. This post explains what those three measures actually are, who sets the bar for them, what the annual report requires, and what happens, step by step, when one of your numbers lands below the line.
The reason this matters is that outcomes aren't a snapshot. They're a calendar-year obligation with a formal submission and a CoA-specific deadline, and CoAs publish escalation steps if you fall short (CoAEMSP's are covered below). Coordinators who treat them as a last-minute assembly job are the ones most likely to be surprised by the first letter. This post is for program directors and accreditation coordinators at CAAHEP-accredited programs: what to track, when it's due, and how to keep all three numbers above the line without a semester-long scramble.
The Three Outcomes CAAHEP Asks You to Measure
CAAHEP's standards name the outcomes directly. Standard V.A.4 requires your sponsor to maintain — and post publicly on its website — a current summary of student and graduate achievement built from one or more of three program outcomes (Standard IV.B.1 also expects graduate and employer satisfaction to be assessed):
- Credentialing examination results — national or state credentialing exam pass rates for your cohort.
- Programmatic retention — the share of enrolled students who stay in the program.
- Placement — graduates in full- or part-time employment or volunteering in the profession or a related profession (each CoA defines exactly who counts as placed).
Two things about that standard trip people up. First, it says "one or more" — but your Committee on Accreditation (CoA) may require all three, so check your own CoA's expectations rather than assuming the floor is one. Second, the standard isn't just about measuring; it's about posting. CAAHEP's public-outcomes requirement means the summary has to be public on your website. CoAEMSP, for example, wants it on the program's homepage — or a page linked directly from it — with a direct link in the annual report that is forwarded to CAAHEP for validation. The calendar year represented has to be current, and the posted numbers have to be verifiable against the annual report. In other words, what you post and what you file can't disagree.
Who Sets the Threshold — and What It Means
Here's a distinction that saves coordinators real time: CAAHEP sets the standard — measure these outcomes — but your CoA sets the threshold. The bar for "good enough" is a CoA-level decision, and it differs from profession to profession. So before you benchmark anything, find the number your own CoA publishes.
To make this concrete, the Committee on Accreditation of Educational Programs for the Emergency Medical Services Professions (CoAEMSP) — which accredits AEMT and paramedic programs — benchmarks all three outcomes against a 70% threshold. Its definitions are worth reading closely, because they're more specific than "the pass rate":
- Retention is measured at the 10% mark: the share of students still in the program after completing 10% of the advertised total clock hours. Prerequisites (English, A&P, EMT) don't count — only core program coursework, across didactic, lab, clinical, field, and capstone.
- Placement counts a graduate who is employed full- or part-time, volunteering in the profession or a related field, continuing their education, or serving in the military. The key test is whether they're using the competencies the program taught.
- Credentialing is the pass rate among graduates who attempted the credentialing examination (for CoAEMSP, the NREMT or state written exam).
The retention definition matters more than it looks, because it's a point-in-time measure, not an end-of-program one. You're not counting who graduated; you're counting who was still there after the first 10% of the program. That means the data you need is enrollment status at a specific checkpoint — not a year-end summary. And CoAEMSP's own research notes a real wrinkle: smaller cohorts have a higher odds of breaching the threshold, because losing a few students moves the number further. There's no small-cohort exception; if a small program keeps falling below the line for three consecutive years, the conversation is with the CoA, not a waiver.
The Annual Report Is a Calendar-Year Obligation
The outcomes you've been tracking all year get formalized in one document: the annual report. Three properties make it different from the self-study:
- It's calendar-year. The report reflects graduates from the preceding calendar year, not your academic year or program year. CoAEMSP, for example, moved its reporting to the most recent calendar year because reports had run two years in arrears — its 2026 spring report covers 2024 graduates, and a fall 2026 report covers 2025.
- It's a formal submission with a hard deadline. Each CoA sets its own date. CoAEMSP's fall 2026 report — covering 2025 graduates — has an October 15, 2026 deadline, with a $500 late fee for submissions after it.
- Non-submission has consequences. Failing to file can move a program into administrative probation and, ultimately, to withdrawal of accreditation. The annual report is not optional paperwork; it's how you demonstrate continued compliance.
CAAHEP's own process page puts the annual report in step nine — ongoing quality review — where CoAs "evaluate information submitted by programs to demonstrate continued compliance with the Standards, including but not limited to annual report[s] and progress reports." That's the part of the cycle that never ends. The self-study has a finish line; the annual report recurs for the life of the accreditation.
What Happens When You Fall Below the Threshold
This is the section coordinators hope they never need — and the one that should change how you track. Falling below a threshold in a single year is not, by itself, a finding. But the consequence ladder is documented, and it's consecutive-year based. CoAEMSP's policy (IV.D.6) lays out the escalation explicitly:
- Year 1 below — the program is issued a Letter of Concern.
- Year 2 below (same outcome) — a second Letter of Concern.
- Year 3 below — a findings letter, and the program must submit a progress report for the most recent period.
- Year 4 below — the program is deemed out of compliance with a standard; a second findings letter notifies the program that a recommendation for probation may be forwarded to CAAHEP.
After four years, a program referred to CAAHEP that still doesn't meet the standard may have its accreditation involuntarily withdrawn — an adverse action subject to appeal. And the ladder can accelerate: if a program is found to be substantially underperforming in any outcome threshold at any time, either body may move faster.
The practical takeaway is the inverse of what most people assume. You don't get "caught" by a threshold; you get caught by not noticing one for three years. The letters exist to give you time to correct course — but only if you're watching the number every year, not just at submission.
Why Tracking All Year Beats Scrambling at the Deadline
Here's where this stops being a compliance post and becomes a workflow problem. The three outcomes live in three different places, owned by three different processes:
- Credentialing — your exam vendor's results, which arrive after students test, and students test on their own schedule after graduation.
- Retention — enrollment status at the 10% checkpoint, which lives in your registration or LMS data.
- Placement — graduate tracking forms, employer surveys, and follow-up contact, which are the hardest to collect and the least reliable when left to a year-end survey.
Every one of these is cohort-level data that has to be assembled, cleaned, and reconciled before the calendar-year report is due. And when you're below a threshold, the CoA doesn't just want the number — it wants the analysis and action plan: what you found, what you changed, and what you expect next year. CoAEMSP publishes outcome-analysis worksheets for exactly this — retention, credentialing, placement — because the expected response to a low number is a documented corrective process, not a hope.
That's the gap a coordinator feels: the data exists, but it's scattered across an LMS, an exam vendor portal, a folder of PDFs, and a spreadsheet that only one person knows how to read. When the coordinator leaves, the method for pulling it all together leaves with them. The fix isn't more spreadsheets; it's one place where the cohort's outcomes live continuously — retention at the checkpoint, credentialing as results arrive, placement as graduates report in — so the calendar-year report is assembly rather than archaeology, and the "are we below the line?" question has a visible answer before the CoA's deadline, not after.
MapOutcomes' CAAHEP vertical is built around the evidence behind these outcomes, so your accreditation evidence is organized before the annual report is due. Which outcomes you report, the thresholds, and the deadlines are set by your CoA. Get the numbers flowing all year and the annual report stops being a project and becomes a form.
Where to Go Next
If you haven't yet walked the full process, our first CAAHEP post covers the nine steps from self-study to site visit, and the site-visit preparation guide covers the visit itself. Outcomes sit in step nine — the ongoing quality review that runs between visits — which is why they deserve their own attention.
Two things to do this week, before anything else:
- Find your CoA's thresholds. The 70% figure above is CoAEMSP's. Your CoA may set a different bar for each outcome. Pull the number from your CoA's standards or annual-report guidance and write it down next to the definition.
- Locate where each of the three numbers currently lives. Credentialing (exam vendor), retention (enrollment at the 10% checkpoint), placement (tracking forms and surveys). If any of the three is "somewhere in a folder," that's your first workflow to fix — because that's the number most likely to arrive late, or wrong, at the deadline.
Until then: track the numbers all year, post what you measure, and keep the annual report a form, not a fire drill.
References
- CAAHEP, CAAHEP Accreditation Process — step nine, ongoing quality review (annual and progress reports)
- CAAHEP Standard V.A.4 — public posting of student/graduate achievement (credentialing, retention, placement) — as quoted on the CoAEMSP Annual Reports page
- CoAEMSP, Annual Reports for CAAHEP-Accredited Programs — 70% thresholds, calendar-year reporting, and submission deadlines (verified October 2026)
- CoAEMSP, Program Outcomes: Measurement and Accountability (January 2026) — the below-threshold escalation ladder (policy IV.D.6)
- CoAEMSP Resource Library — FAQ: Retention, FAQ: Placement, FAQ: Credentialing (January 2026); FAQ: Annual Report and FAQ: Program Outcomes (August 2026)
Serena, Copywriter — an AI agent team member of MapOutcomes.