Abstract

Background: Traditional nurse extern evaluation often relies on clinical hours and task completion rather than demonstrated competency, contributing to inconsistent assessment and feedback. Competency-based evaluation emphasizes observable performance and clear expectations. The Creighton Competency Evaluation Instrument (CCEI) provides structured behavioral indicators to support consistent and transparent clinical evaluation.

Purpose: This quality improvement project evaluated the impact of CCEI training, calibration, and implementation on competency assessment, preceptor self-efficacy, and scoring consistency. Evidence integration and implementation were guided by the Johns Hopkins Nursing Evidence-Based Practice Model, Lewin’s Change Theory, and Kotter’s Eight-Step Change Model.

Methods: Twenty nurse externs and 45 preceptors participated in a 16-week pre-post quality improvement project. Weeks 1-4 included CCEI training, orientation, and video-based calibration. Weeks 5-16 included 12 weeks of competency-based evaluation with 10 formative and 2 summative assessments. Competency attainment was defined as achieving at least 90% of applicable CCEI domains using a modified Angoff process. Outcomes included competency progression and attainment, extern self-evaluation, preceptor-rated competency, preceptor self-efficacy measured with an adapted 10-item General Self-Efficacy Scale, and inter-rater reliability using percent agreement and Cohen's kappa. Qualitative feedback underwent thematic analysis.

Results: Extern competency increased from a mean score of 0.740 at baseline to 0.914 at midpoint and 1.000 by Week 12. Extern self-evaluation scores increased from 0.62 to 0.86 and 1.00, reflecting progressive growth in perceived competency. Preceptor self-efficacy improved across all constructs, with preceptor efficacy demonstrating the greatest gain (Δ = +0.88; 29.1%) and an average construct-level improvement of 23.8%. Calibration improved inter-rater reliability from 46.5% to 96.5% (κ = −0.22-0.16 to 0.84-1.00), and high reliability was maintained during summative extern evaluations (94%agreement). Qualitative findings identified four themes: greater clarity and transparency, improved feedback quality, structured and consistent evaluation, and enhanced professional growth.

Conclusion: Structured implementation of the CCEI, combined with preceptor training and calibration, improved competency-based evaluation, preceptor self-efficacy, and scoring consistency. The CCEI provided a clear behavioral framework for assessment and feedback while supporting competency attainment and readiness for professional nursing practice.

Date of publication

Fall 11-16-2026

Document Type

DNP Scholarly Project

Language

english

Persistent identifier

http://hdl.handle.net/10950/5224

Committee members

Katherine Sandlin, DNP, APRN, CPNP-PC, CNE

Degree

Doctor of Nursing Practice

Share

COinS