Добавил:
Sekretar
kiopkiopkiop18@yandex.ru
t.me/Prokururor I Вовсе не секретарь, но почту проверяю
Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз:
Предмет:
Файл:Ординатура / Хирургия / Библиотека им академика М.И. Перельмана / Книга_2823_Библиотеки_им_академика_М_И_Перельмана
.pdf
internal medicine clerkship. Acad Med. 2000 Feb;75(2):167-
173. doi:10.1097/00001888-200002000-00016.
46. Battistone MJ, Pendleton B, Milne C, et al. Global
descriptive evaluations are more responsive than global
numeric ratings in detecting students’ progress during the
inpatient portion of an internal medicine clerkship. Acad
Med. 2001 Oct;76(10 Suppl):S105-S107. doi:10.1097/00001888-
200110001-00035.
47. Battistone MJ, Milne C, Sande MA, Pangaro LN, Hemmer
PA, Shomaker TS. The feasibility and acceptability of
implementing formal evaluation sessions and using
descriptive vocabulary to assess student performance on a
clinical clerkship. Teach Learn Med. 2002 Winter;14(1):5-10.
doi:10.1207/S15328015TLM1401_3.
48. Ogburn T, Espey E. The R-I-M-E method for evaluation of
medical students on an obstetrics and gynecology clerkship.
Am J Obstet Gynecol. 2003 Sep;189(3):666-669.
doi:10.1067/s0002-9378(03)00885-8.
49. Hemmer P, Pangaro LN. The effectiveness of formal
evaluation sessions during clinical clerkships in better
identifying students with marginal funds of knowledge.
Acad Med. 1997 Jul;72(7):641-643. doi:10.1097/00001888-
199707000-00018.
50. Pangaro L, ten Cate O. AMEE Guide—Frameworks for
learner assessment in medicine (Theories in Medical
Education series). Med Teach. 2013;35:524–537.
https://t.me/med1917
51. Kinnear B, Warm EJ, Caretta-Weyer H, et al. Entrustment
unpacked: aligning purposes, stakes, and processes to
enhance learner assessment. Acad Med. 2021 Jul 1;96(7S):S56S63. doi:10.1097/ACM.0000000000004108.
52. Nabors C, Peterson SJ, Forman L, et al. Operationalizing
the internal medicine milestones—an early status report. J
Grad Med Educ. 2013 Mar;5(1):130-137. doi:10.4300/JGME-D-
12-00130.1.
53. Warm EJ, Mathis BR, Held JD, et al. Entrustment and
mapping of observable practice activities for resident
assessment. J Gen Intern Med. 2014 Aug;29(8):1177-1182.
doi:10.1007/s11606-014-2801-5.
54. Edgar L, McLean S, Hogan SO, Hamstra S, Holmboe ES.
The Milestones Guidebook. Accessed March 19, 2023. at
Competency-Based Training (acgme.org)
55. Landy FJ, Farr JL. Performance rating. Psychol Bull.
1980;87:72-107. doi:10.1037/0033-2909.87.1.72.
56. Murphy KR, Cleveland JN. Understanding Performance
Appraisal. Sage Publications; 1995.
57. Hauenstein NMA. Training raters to increase the
accuracy of appraisals and the usefulness of feedback. In:
Smither JW, ed. Performance Appraisal. Jossey Bass; 1998.
58. Rodriguez RG, Hemmer PA. Descriptive evaluations and
clinical performance evaluations in the workplace. In:
Handbook on Medical Student Evaluation and Assessment.
Pangaro LN, McGaghie WC, eds. Gegensatz Press; 2015:77-
https://t.me/med1917
96.
59. Holmboe ES, Fiebach NF, Galaty L, Huot S. The
effectiveness of a focused educational intervention on
resident evaluations from faculty: a randomized controlled
trial. J Gen Intern Med. 2001 Jul;16(7):1-6. doi:10.1046/j.1525-
1497.2001.016007427.x.
60. Direct observation of clinical care (DOCC) assessment
tool. Accessed April 7, 2023.
https://dl.acgme.org/pages/assessment.
61. Norman GR, Van der Vleuten CP, De Graaff E. Pitfalls in
the pursuit of objectivity: issues of validity, efficiency and
acceptability. Med Educ. 1991 Mar;25(2):119-126.
doi:10.1111/j.1365-2923.1991.tb00037.x.
62. Andolsek K, Padmore J, Hauer KE, Ekpenyong A, Edgar
L, Holmboe ES. Clinical Competency Committees: A
Guidebook for Programs. Accessed March 26, 2023.
www.acgme.org.
63. Pangaro LN. System approaches to student assessment.
In: Pangaro LN, McGaghie WC, eds. Handbook of Medical
Student Assessment and Evaluation. Gegensatz Press; 2015.
64. Rekman J, Gofton W, Dudek N, Gifton T, Hamstra SJ.
Entrustability scales: outlining their usefulness for
competency-based clinical assessment. Acad Med. 2016
Feb;91(2):186-190. doi:10.1097/ACM.0000000000001045.
65. Downing SM. Reliability: on the reproducibility of
assessment data. Med Educ. 2004 Sep;38(9):1006-1012.
https://t.me/med1917
doi:10.1111/j.1365-2929.2004.01932.x.
66. Park YS, Hamstra SJ, Yamazaki K, Holmboe E.
Longitudinal reliability of milestones-based learning
trajectories in family medicine residents. JAMA Netw Open.
2021 Dec 1;4(12):e2137179.
doi:10.1001/jamanetworkopen.2021.37179.
67. Weller JM, Misur M, Nicolson S, et al: Can I leave the
theatre? A key to more reliable workplace-based assessment.
Br J Anaesth. 2014 Jun;112(6):1083-1091.
doi:10.1093/bja/aeu052.
68. Gingerich A, Kogan J, Yeates P, Govaerts M, Holmboe E.
Seeing the ‘black box’ differently: assessor cognition from
three research perspectives. Med Educ. 2014
Nov;48(11):1055-1068. doi:10.1111/medu.12546.
69. Downing SM, Haladyna TM. Validity threats:
overcoming interference with proposed interpretations of
assessment data. Med Educ. 2004 Mar;38(3):327-333.
doi:10.1046/j.1365-2923.2004.01777.x.
70. Downing SM. Validity: on meaningful interpretation of
assessment data. Med Educ. 2003 Sep;37(9):830-837.
doi:10.1046/j.1365-2923.2003.01594.x.
71. Post RE, Jamena GP, Gamble JD. Using Precept-Assist to
predict performance on the American Board of Family
Medicine on In-Training Examination. Fam Med. 2014
Sep;46(8):603-607.
72. Schwartz RW, Donnelly MB, Sloan DA, Johnson SB,
https://t.me/med1917
Strodel WE. The relationship between faculty ward
evaluations, OSCE and ABSITE as measures of surgical
intern performance. Am J Surg. 1995 Apr;169(4):414-417.
doi:10.1016/s0002-9610(99)80187-1.
73. Hawkins RE, Sumption KF, Gaglione M, Holmboe ES.
The In-training Examination (ITE) in internal medicine:
resident perceptions and correlation between resident ITE
scores and faculty predictions of resident performance. Am J
Med. 1999 Feb;106(2):206-210. doi:10.1016/s0002-
9343(98)00392-1.
74. Bienstock JL, Shivraj P, Yamazaki K, et al. Correlations
between Accreditation Council for Graduate Medical
Education Obstetrics and Gynecology Milestones and
American Board of Obstetrics and Gynecology qualifying
examination scores: an initial validity study. Am J Obstet
Gynecol. 2021 Mar;224(3):308.e1-308.e25.
doi:10.1016/j.ajog.2020.10.029.
75. Francisco GE, Yamazaki K, Raddatz M, et al. Do
milestone ratings predict physical medicine and
rehabilitation (PM&R) board certification examination
scores? Am J Phys Med Rehabil. 2021 Feb 1;100(2S Suppl
1):S34-S39. doi:10.1097/PHM.0000000000001613.
76. Hauer KE, Vandergrift J, Lipner RS, Holmboe ES, Hood
S, McDonald FS. National internal medicine milestone
ratings: validity evidence from longitudinal three-year
follow-up. Acad Med. 2018 Aug;93(8):1189-1204.
doi:10.1097/ACM.0000000000002234.
https://t.me/med1917
77. Paolo AM, Bonaminio GA. Measuring outcomes of
undergraduate medical education: residency directors’
ratings of first year residents. Acad Med. 2003 Jan;78(1):90-
95. doi:10.1097/00001888-200301000-00017.
78. Durning SJ, Pangaro LN, Lawrence LL, Waechter D,
McManigle J, Jackson JL. The feasibility, reliability, and
validity of a program director’s (supervisor’s) evaluation
form for medical school graduates. Acad Med. 2005
Oct;80(10):964-968. doi:10.1097/00001888-200510000-00018.
79. Papadakis MA, Teherani A, Banach MA, et al.
Disciplinary action by medical boards and prior behavior in
medical school. N Engl J Med. 2005 Dec 22;353(25):2673-2682.
doi:10.1056/NEJMsa052596.
80. Papadakis MA, Arnold GK, Blank LL, Holmboe ES,
Lipner RS. Performance during internal medicine residency
training and subsequent disciplinary action by state licensing
boards. Ann Intern Med. 2008 Jun 3;148(11):869-876.
doi:10.7326/0003-4819-148-11-200806030-00009.
81. Heath JK, Wang T, Santhosh L, et al. Longitudinal
milestone assessment extending through subspecialty
training: the relationship between ACGME internal medicine
residency milestones and subsequent pulmonary and critical
care fellowship milestones. Acad Med. 2021 Nov
1;96(11):1603-1608. doi:10.1097/ACM.0000000000004165.
82. Han M, Hamstra SJ, Hogan SO, et al. JAMA Netw Open.
2023 Apr 3;6(4):e237588.
doi:10.1001/jamanetworkopen.2023.7588.
https://t.me/med1917
83. Smith B, Yamazaki K, Tekian A, et al. ACGME milestone
ratings of surgeon competence during training predict early
career patient outcomes. Submitted 2023.
84. Thompson WG, Lipkin M Jr, Gilbert DA, Guzzo RA,
Roberson L. Evaluation: assessment of the American Board
of Internal Medicine resident evaluation form. J Gen Intern
Med. 1990 May-Jun;5(3):214. doi:10.1007/BF02600537.
85. Silber CG, Nasca TJ, Paskin DL, Eiger G, Robeson M,
Veloski JJ. Do global rating forms enable program directors
to assess the ACGME competencies? Acad Med. 2004
Jun;79(6):549-556. doi:10.1097/00001888-200406000-00010.
86. Yamazaki K, Holmboe ES, Hamstra SJ. An empirical
investigation into milestones factor structure using national
data derived from clinical competency committees. Acad
Med. 2022 Apr 1;97(4):569-576.
doi:10.1097/ACM.0000000000004218.
87. Feinstein A. Principles of Medical Statistics. Chapman
and Hall/CRC; 2002.
88. Holmboe ES. The importance of faculty observation of
trainees’ clinical skills. Acad Med. 2004 Jan;79(1):16-22.
doi:10.1097/00001888-200401000-00006.
89. Byrne A, Soskova T, Dawkins J, Coombes L. A pilot study
of marking accuracy and mental workload as measures of
OSCE examiner performance. BMC Med Educ. 2016 Jul
25;16:191. doi:10.1186/s12909-016-0708-z.
90. Gingerich A. What if the ‘trust’ in entrustable were a
https://t.me/med1917
social judgement? Med Educ. 2015 Aug;49(8):750-752.
doi:10.1111/medu.12772.
91. Gingerich A, Regehr G, Eva KW. Rater-based assessments
as social judgments: rethinking the etiology of rater errors.
Acad Med. 2011 Oct;86(10 Suppl):S1-S7.
doi:10.1097/ACM.0b013e31822a6cf8.
92. Schumacher DJ, Holmboe E, Carraccio C, et al. Residentsensitive quality measures in the pediatric emergency
department: exploring relationships with supervisor
entrustment and patient complexity and acuity. Acad Med.
2020 Aug;95(8):1256-1264.
doi:10.1097/ACM.0000000000003242.
* For this chapter we will use the words assessment and
evaluation interchangeably.
https://t.me/med1917
5
Direct Observation
Jennifer R. Kogan, MD, Eric S. Holmboe, MD
https://t.me/med1917
Chapter Outline
Introduction
Direct Observation as Workplace-Based
Assessment
Rationale for Direct Observation
Importance of and State of Core Clinical Skills
Direct Observation as an Educational Tool for
Feedback and Deliberate Practice
Direct Observation as an Assessment Method in
Competency-Based Medical Education
Direct Observation as a Method to Guide
Supervision
Assessment Tools for Direct Observation
Assessment Tool Format
Issues With Reliability and Validity
Accuracy
Variable Assessment Standards
Role of Inference
Impact of Educational Culture
Rater Limitations and Bias
Conceptual Model Summarizing Rater Cognition
Improving the Quality of Direct Observation
Assessments
Overview of Faculty Development Approaches to
Improve Assessment Quality
Motivating Faculty to Participate in Rater Training
Performance Dimension Training
Frame of Reference Training
Recognizing Inference
Prioritizing Observations and Creating a Summary
https://t.me/med1917
Соседние файлы в папке Библиотека им академика М.И. Перельмана