banner

blank blank
blank
blank

blank

print



outcomes
 
The True Test of Success


When it comes to continuing medical education, the literature clearly shows that engaging participants in interactive learning scenarios is the most effective manner to transmit knowledge to adult learners.  But how do we know if that knowledge has been sustained over time or if it has made a difference in behavior or practice?  And the even bigger question for CME providers and their grantors:  how do we know if that knowledge has had an impact on clinical outcomes?

That’s where CCOE’s educational outcomes division comes in.  Tied directly to the needs assessment, educational outcomes are identified in the earliest stages of an educational activity’s development. From there, supported by expertise in quantitative/qualitative methods, mathematical modeling, and epidemiology from senior faculty at several of UMDNJ’s schools, a wide variety of educational outcomes measurement techniques can be applied, from the simplest control group/participant surveys to the most complex longitudinal studies of providers and patients. Moreover, with access to UMDNJ’s affiliated hospitals, clinics and physician practices, CCOE’s outcomes division can, in certain circumstances, proactively enlist these entities to function as clinical laboratories for controlled outcomes analyses on the most ambitious levels.

Why Outcomes Measurement?


Continuing medical education is a vital element of our nation’s healthcare system.  But it’s costly, both in terms of dollars spent and time and effort expended, to produce first-rate, objective programming.  Including educational outcomes measurement as a component of CME programming will provide course directors, faculty, and grantors with practical, verifiable information that can document the real impact the programming has had on its intended audience.  CCOE’s educational outcomes measurement and analysis services can help you to:
  • Scientifically assess the effectiveness of a CME intervention
  • Validate the learning objectives’ ability to support the unmet needs
  • Clearly distinguish an activity as being educational vs. promotional
  • Ensure that content adequately reflects the learning objectives
  • Identify, measure and analyze what was learned and not learned
  • Challenge the validity of the educational strategy and needs assessment
  • Justify current and future resource allocation
  • Provide benchmarks for interim adjustments and learning objectives
Starting with the right data

CCOE utilizes a variety of primary and secondary data sources and tools to ensure its outcomes measurement and analysis activities are accurate and verifiable.  These include:
  • Peer review literature & breakthrough data
  • National and international data registries
  • Regional and local surveillance
  • Third-party payors
  • Nominal group interviews
  • Focus groups
  • ARS/teleconferencing
  • Electronic point of care data
  • Aggregate Rx measurement
Finding the Right Option

The best fit for your CME activity can be found among CCOE’s three different approaches to educational outcomes measurement.  Whether it’s a small activity or a large-scale initiative, we can provide the appropriate level of measurement and analysis.

Immediate Learning:
Provides the ability to assess knowledge transfer immediately following a CME activity. Non-participant group (Control) data are collected and compared to quantitative changes in educational participant group (Case) based on pre/post activity metrics and statistical application. A gap analysis is produced to explain the rationale for any change (or lack thereof) in learning. A detailed report is prepared to support ongoing or altered educational intervention.

  • Case/control methodology
  • Pre/post testing:  survey, case study assessment
  • ARS/web
  • Gap analysis
Persistent Learning:
Provides the ability to assess knowledge transfer as an extension of a Phase One CME activity. Measurement indices are applied at specified time intervals, e.g., 3, 6 months, etc., following the original intervention. Indices of persistent learning and in-depth analyses are applied to reinforce primary educational learning objectives and provide for ongoing needs assessment to recommend or refine future interventions.
  • Builds on immediate learning measurement
  • Multiple interval testing
  • Drives educational reinforcement through
  • Multifaceted approaches and multiple interventions
  • Interval analysis and development
  • Feedback to course directors and grantors
Applied Learning:
Provides the link between what the participant has learned and behavioral mod-ification. In-depth case studies with learner-directed therapeutic options are presented to identify unmet needs of the provider.  This will be assessed at more than one point of time based on gaps of healthcare outcomes.  Practices and program performance will be scientifically analyzed and feedback given to the individual practitioner.
  • Builds on persistent learning measurement
  • Measures learning impact on behavior and practice
  • Potential use to drive systems modifications
  • Requires protocol and possibly IRB approval
Take the first step to meaningful measurement

Find out how educational outcomes measurement and analysis can bring your next CME activity to a higher level of effectiveness and meaningful impact.  Contact CCOE to learn more about our services:  732-235-7434.

Print this page
 
© UMDNJ-Center for Continuing & Outreach Education | Privacy Policy