Brazilian Journal of Anesthesiology
https://bjan-sba.org/article/doi/10.1016/j.bjane.2013.11.003
Brazilian Journal of Anesthesiology
Scientific Article

Anesthesiology Journal club assessment by means of semantic changes

Avaliação do clube de revista de anestesiologia por meio de mudanças semânticas

Joaquim Edson Vieira; Marcelo Luís Abramides Torres; Regina Albanese Pose; José Otávio Costa Auler Junior

http://dx.doi.org/10.1016/j.bjane.2013.11.003 Braz J Anesthesiol, vol.64, n4, p.258-262, 2014
PDF English
PDF Português
Downloads: 0
Views: 660

Abstract

BACKGROUND AND OBJECTIVES: the interactive approach of a journal club has been described in the medical education literature. The aim of this investigation is to present an assessment of journal club as a tool to address the question whether residents read more and critically. METHODS: this study reports the performance of medical residents in anesthesiology from the Clinics Hospital - University of São Paulo Medical School. All medical residents were invited to answer five questions derived from discussed papers. The answer sheet consisted of an affirmative statement with a Likert type scale (totally disagree-disagree-not sure-agree-totally agree), each related to one of the chosen articles. The results were evaluated by means of item analysis - difficulty index and discrimination power. RESULTS: residents filled one hundred and seventy three evaluations in the months of December 2011 (n = 51), July 2012 (n = 66) and December 2012 (n = 56). The first exam presented all items with straight statement, second and third exams presented mixed items. Separating "totally agree" from "agree" increased the difficulty indices, but did not improve the discrimination power. CONCLUSIONS: the use of a journal club assessment with straight and inverted statements and by means of five points scale for agreement has been shown to increase its item difficulty and discrimination power. This may reflect involvement either with the reading or the discussion during the journal meeting.

Keywords

Education, Medical, Graduate, Anesthesiology, Self-assessment, Program evaluation, Educational measurement, Periodicals as topic

Resumo

JUSTIFICATIVA E OBJETIVOS: a abordagem interativa de um clube de revista foi descrita na literatura de ensino médico. O objetivo desta investigação é apresentar uma avaliação do clube de revista como uma ferramenta para discutir a questão da leitura crítica entre os residentes. MÉTODOS: este estudo relata o desempenho dos médicos residentes de anestesiologia do Hospital das Clínicas - Faculdade de Medicina da Universidade de São Paulo. Todos os médicos residentes foram convidados a responder a cinco perguntas derivadas de artigos discutidos. A folha de resposta consistia em uma declaração afirmativa com uma escala do tipo Likert (discordo totalmente, discordo, não tenho certeza, concordo, concordo totalmente), cada declaração relacionada a um dos artigos escolhidos. Os resultados foram avaliados por meio da análise de itens - índice de dificuldade e poder de discriminação. RESULTADOS: os residentes completaram 173 avaliações nos meses de dezembro de 2011 (n = 51), julho de 2012 (n = 66) e dezembro de 2012 (n = 56). O primeiro teste apresentou todos os itens com declaração direta e o segundo e terceiro testes apresentaram itens mistos. Separar "concordo totalmente" de "concordo" aumentou os índices de dificuldade, mas não melhorou o poder de discriminação. CONCLUSÕES: o uso de uma avaliação do clube revista com declarações diretas e inversas e com o uso de uma escala de cinco pontos para acordo mostrou aumentar a dificuldade do item e o poder de discriminação. Isso pode refletir o envolvimento com a leitura ou com a discussão durante as reuniões do clube.

Palavras-chave

Educação, Médico, Graduação, Anestesiologia, Autoavaliação, Avaliação do programa, Avaliação educacional, Periódicos como tema

References

Alguire PC. A review of journal clubs in postgraduate medical education. J Gen Intern Med.. ;13:347-353.

Hinkson CR, Kaur N, Sipes MW. Impact of offering continu- ing respiratory care education credit hours on staff participation in a respiratory care journal club. Respir Care.. ;56:303-305.

Linzer M, Brown JT, Frazier LM. Impact of a medi- cal journal club on house-staff reading habits, knowledge, and critical appraisal skills. A randomized control trial. JAMA.. ;260:2541-2537.

Letterie GS, Morgenstern LS. The journal club teaching critical evaluation of clinical literature in an evidence-based environ- ment. J Reprod Med.. ;45:304-299.

Harris J, Kearley K, Heneghan C. Are journal clubs effec- tive in supporting evidence-based decision making? A systematic review BEME Guide No. 16. Med Teach.. ;33:9-23.

Shifflette V, Mitchell C, Mangram A. Current approaches to journal club by general surgery programs within the South- western surgical congress. J Surg Educ.. ;69:166-162.

Crank-Patton A, Fisher JB, Toedter LJ. The role of the journal club in surgical residency programs: a survey of APDS program directors. Curr Surg.. ;58:101-104.

Kelly AM, Cronin P. Setting up, maintaining and evaluating an evidence based radiology journal club: the University of Michi- gan experience. Acad Radiol.. ;17:1073-1078.

Burstein JL, Hollander JE, Barlas D. Enhancing the value of jour- nal club: use of a structured review instrument. Am J Emerg Med.. ;14:561-563.

McLeod RS, MacRae HM, McKenzie ME. Evidence Based Reviews in Surgery Steering Committee. A moderated journal club is more effective than an Internet journal club in teach- ing critical appraisal skills: results of a multicenter randomized controlled trial. J Am Coll Surg.. ;211:769-776.

Lee AG, Boldt HC, Golnik KC. Using the Journal Club to teach and assess competence in practice-based learning and improvement: a literature review and recommendation for implementation. Surv Ophthalmol.. ;50:542-548.

Misra UK, Kalita J, Nair PP. Traditional journal club: a continuing problem. J Assoc Physicians India.. ;55:346-343.

Hartzell JD, Veerappan GR, Posley K. Resident run journal club: a model based on the adult learning theory. Med Teach.. ;31:e161-e156.

Valentini RP, Daniels SR. The journal club. Postgrad Med J.. ;73:81-85.

Gronlund NE. Constructing achievement tests prentice-hall. .

Linzer M. The journal club medical education: over one hundred years of unrecorded history. Postgrad Med J.. ;63:478-475.

Sidorov J. How are internal medicine residency journal clubs organized and what makes them successful?. Arch Intern Med.. ;155:1193-1197.

Dirschl DR, Tornetta 3rd P, Bhandari M. Designing, conducting, and evaluating journal clubs in orthopaedic surgery. Clin Orthop Relat Res.. ;413:146-157.

Ausubel DP. The acquisition and retention of knowledge: a cognitive view. .

Barnette JJ. Effects of stem and Likert response option reversals on survey internal consistency: if you feel the need there is a better alternative to using those negatively worded stems. Educ Psychol Meas.. ;60:3361-3370.

5dcd9a350e88258753bf58f1 rba Articles
Links & Downloads
2352-2291 (Electronic) 0104-0014 (Printed)
Braz J Anesthesiol ©2024 All rights reserved.

Braz J Anesthesiol

Share this page
Page Sections