Impact of facilitating physician access to relevant medical literature on outcomes of hospitalised internal medicine patients: a randomised controlled trial

The CIT Program database contains more than 8,...Image via Wikipedia

  • Methods
  • Qualitative research                                  

Impact of facilitating physician access to relevant medical literature on outcomes of hospitalised internal medicine patients: a randomised controlled trial

Editor's Choice

  1. Ariel Izcovich1
  2. Carlos Gonzalez Malla1
  3. Martín Miguel Diaz1
  4. Matías Manzotti1,
  5. Hugo Norberto Catalano1
+Author Affiliations

  1. 1Medical Clinical Service, Internal Medicine Department, School of Medicine, Hospital Alemán de Buenos Aires, Buenos Aires, Argentina
  1. Correspondence toAriel Izcovich Pueyrredon 1640, Zip code C1118AAT, Ciudad Autónoma de Buenos Aires, Buenos Aires, Argentina;
  • Accepted 5 July 2011


Introduction There is limited high-quality evidence regarding the usefulness of bibliographic assistance in improving clinically important outcomes in hospitalised patients. This study was designed to evaluate the impact of providing attending physicians with bibliographic information to assist them in answering medical questions that arise during daily clinical practice.
Methods All patients admitted to the Internal Medicine ward of Hospital Aleman in Buenos Aires between March and August 2010 were randomly assigned to one of two groups: intervention or control. Throughout this period, the medical questions that arose during morning rounds were identified. Bibliographic research was conducted to answer only those questions that emerged during the discussion of patients assigned to the intervention group. The compiled information was sent via e-mail to all members of the medical team.
Results 809 patients were included in the study, 407 were randomly assigned to a search-supported group and 402 to a control group. There was no significant difference in death or transfer to an intensive care unit (ICU) (RR 1.09 (95% CI 0.7 to 1.6)), rehospitalisation (RR 1.0 (95% CI 0.7 to 1.3)) or length of hospitalisation (6.5 vs 6.0 days, p=0.25). The subgroup of search-supported physicians’ patients (n=31), whose attending physicians received hand-delivered information, had a significantly lower risk of death or transfer to an ICU compared with the control group (0% vs 13.7%, p=0.03).
Conclusions The impact of bibliographic assistance on clinically important outcomes could not be proven by this study. However, results suggest that some interventions, such as delivering information by hand, might be beneficial in a subgroup of inpatients.


Searching for information in books or consulting a specialist has been the most traditional way to answer questions that arise during patient care.1 The ability to search for information, along with its increasing accessibility, allows physicians who have the skills to perform critical appraisal to answer questions based on high-quality evidence. Therefore, it is extremely important to use search resources and an ability to perform critical appraisal, as tools to provide the best evidence-based patient care.
In a systematic review by Dawes and Sampson,2 different reasons are mentioned as to why most physicians do not use bibliographic searching to answer daily questions. Some of these reasons are limited time to perform the research, lack of training in critical appraisal of the information found and low expectations for finding a relevant and direct answer to questions (ie, useful for patient’s care, unbiased and easily accessible).3
Bibliographic assistance could be a useful tool for answering medical questions that arise during patient care, not only for its academic importance, but also for improving patient-important outcomes.
There is limited high-quality evidence regarding the impact of bibliographic assistance on clinically important outcomes for hospitalised patients. The vast majority of the evidence comes from uncontrolled studies that have a high risk of biased results.4
We conducted a randomised study to determine the proportion of admitted patients who generate questions for attending physicians, to compare the outcome of these patients with those who do not generate questions and to evaluate the usefulness (in terms of important patient outcomes) of facilitating information access for physicians who work with admitted patients on internal medicine services.


In 2009, intending to increase the utilisation of EBM resources in daily medical practice, a specialist in internal medicine and trained and skilled in evidence-based medicine was hired in the general internal medicine unit of the Hospital Aleman de Buenos Aires. His work, starting in 2009, consisted of identifying and answering medical questions that arose mainly during daily morning reports. A review of this process found that 80% of the questions identified could be successfully answered, 60% of them based on high-quality evidence. Most of the identified questions were about treatment and prognosis and could be classified as haematology, oncology, infectious diseases or cardiopulmonary questions.5
A survey answered by resident and staff physicians working on the internal medicine ward showed that 72% of the publications delivered were useful information and 42% motivated changes in medical practice for at least one of the participating physicians.6


From March 2010 through August 2010, all patients admitted to the general internal medicine ward of the Hospital Aleman de Buenos Aires were randomly assigned to an intervention (search-supported) group or a control group in a 1:1 ratio by flipping a coin at the time of admission.
Morning report is held daily on the General Internal Medicine Service. It is attended by resident physicians, staff physicians and heads of wards, and new admissions and other inpatients are discussed.
During the course of this study, a physician who is a specialist in internal medicine and who was trained and skilled in evidence-based medicine and whose work is funded by the Internal Medicine Service identified the medical questions that arose during morning reports. Such questions were either explicitly formulated by staff or resident physicians or inferred by the physician responsible for collecting them. Questions were collected using the PICOT structure (Population/Problem, Intervention, Comparison, Outcome, Type of design that would answer the question)7 in order to gather key words for the literature search. In some cases, the questions were answered immediately by someone who was present in the session, frequently, using electronic resources such as UpToDate. Those questions were excluded from this study.
The same physician who collected the questions also searched the literature for evidence. He answered only those questions obtained from the discussions of the inpatients that were assigned to the intervention (search-supported) arm and not those obtained from inpatients assigned to the control arm. The literature search was carried out once the morning report was over and it was considered finished 12 h after it started. The sources used in this search were Cochrane Library, PubMed and Lilacs.
The literature found was sent by e-mail to the whole medical team, including those physicians directly responsible for the care of the patient who had prompted the question. Emails were sent daily, from Monday to Thursday, and they included a brief summary of the literature found to address each of the questions answered that day, a critical appraisal of the papers based on the User’s Guides8 and the papers themselves attached in PDF format. In some cases, the literature was printed out and delivered by hand, directly to the professionals involved. The following criteria were used to choose to deliver information by hand: (1) one of the physicians directly involved in the care of the patient who prompted the question requested the information in hardcopy or (2) the physician who searched for the information considered that the literature could alter the diagnostic and therapeutic strategy for the patient who prompted the question. Follow-up of the patients included in the study was done, prospectively, from 1 March 2010 to 15 August 2010 through spreadsheets that were prepared everyday by the resident physicians working on the Service.
The process of medical question identification and answering described for the intervention arm is the usual practice on the internal medicine service of the Hospital Aleman de Buenos Aires since 2009. This job is carried out since then, by the same physician who did it during the study.
The outcomes considered were a composite of in-hospital death or transfer to an intensive care unit (ICU), death, transfer to an ICU, length in days of hospital stay and rehospitalisation during the course of the study.
The primary analyses compared the randomised groups (patients assigned to the intervention arm versus patients assigned to the control arm) and the non-randomised groups (patients who prompted questions versus patients who did not prompt questions).
We also planned a priori subgroup analyses among patients who prompted at least one question, particularly regarding patients whose attending physicians received information delivered by hand.
Normally distributed numerical variables were compared by Student’s t tests and dichotomous variables were assessed using RR and absolute risks, by χ2 tests with continuity corrections or Fisher’s exact test, as applicable. Tests of significance were two-tailed, and a p value of less than 0.05 or 95% CI excluding 1 were considered significant. All the calculations were performed using STATA v11.0 software. A post hoc power analysis with α error value of 0.05 and a two-tailed test for each outcome was performed using G*power 3 software ( The power of the study for each of the evaluated outcomes was length of stay 16%, death or ICU 5%, and rehospitalisation 5%.


A total of 809 patients were included in the study, 407 were randomised to the search-supported arm and 402 were randomised to the control arm (figure 1).
Figure 1

View larger version:

Figure 1

Group assignment and questions identified/answered
The average age of the patients included in the study was 66 years (95% CI 65 to 67 years old). Baseline characteristics were similar in both arms (table 1).
View this table:

Table 1

Baseline characteristics
Of all the patients included in the study, 151 (19%, 95% CI 15% to 21%) prompted at least one question: 78 (19%, 95% CI 15% to 23%) randomised to the search-supported arm and 73 (18%, 95% CI 14% to 21%) randomised to the control arm. Most of the questions identified were about treatment or prognosis (table 1). The average number of questions per patient was 1.2. The total number of collected questions was 188.
The questions about 77 of the 78 patients who were randomised to the search-supported arm were satisfactorily answered. For 31 of these patients, the information was delivered by hand to their attending physicians (see figure 1).
The combined outcome of death or transfer to an ICU occurred for 76 patients (9.3%, 95% CI 7.3% to 11.4%). The number of readmissions during the course of the study was 135 (16.6%, 95% CI 14.1% to 19.2%). The average length of stay for the study population was 6.3 days (95% CI 5.8 to 6.7 days).
The patients who generated questions had an increase in the risk of being transferred to an ICU (RR 2.0, 95% CI 1.1 to 3.9) and had significantly longer hospital stays, compared with those who did not (7.7 vs 6.0 days, p=0.004). The risk of death (RR 1.5, 95% CI 0.9 to 2.5) and rehospitalisation (RR 1.03, 95% CI 0.7 to 1.5) were not different between those who did and did not generate questions.
The comparisons between search-supported and control groups were not statistically significant (table 2).
View this table:

Table 2

Primary/subgroup analysis
Among patients who prompted questions, the subgroup of patients (31 patients) whose questions were answered and whose attending physicians received hand-delivered information had a significantly lower risk of death or transfer to an ICU compared with the control group (0 vs 10 deaths or transfers, 0% vs 13.7%, p=0.03). There were no significant differences between these groups in ICU transfer (0 vs 8 (11%), p=0.1), death (0 vs 2 (2.7%), p=1.0) rehospitalisation (5 vs 14 rehospitalisations, 16.1% vs 19.1%, RR 0.8, 95% CI 0.3 to 2.1, p=0.7) and days of hospitalisation (5.5 vs 6.8, p=0.3).


To our knowledge, this is the first randomised study that attempts to measure the impact of bibliographic assistance by physicians on clinically important outcomes for admitted patients.
Many questions arise for physicians during patient care. Ely et al9 identified 1101 questions that emerged during patient visits over a period of 732 h in the primary care ambulatory setting, which averages approximately three questions every 2 h. Sackett and Straus10 identified 98 questions generated during the care of 166 hospitalised patients in a period of 30 days.
In this study, we found that one in five patients generated at least one clinical question. Those questions were identified during case discussion and not during patient visits. This could have led to a difference in the number and complexity of questions compared with the previously mentioned studies. It is important to note that numerous questions were dismissed because they were resolved immediately using resources like UpToDate. This could be the explanation for the difference between the number of questions reported herein and by Sackett and Straus.10
In this study, we found that patients who generated questions had a twofold increase in the risk of being transferred to an ICU and had a significantly longer hospital stay compared with those who did not. We have not been able to find similar studies; therefore we could not compare our results with other experiences. Although it was not explored in the present study, one explanation for the increase in the risk of being transferred to an ICU and the longer hospital stay of those patients who generated questions could be that these patients had more complex pathologies than those who did not generate questions.
A systematic review by Weightman and Williamson4 that included 28 studies and evaluated the impact of bibliographic assistance on different outcomes found that most of the studies evaluated changes in physicians’ decisions (surrogate outcomes) and only six studies reported outcomes that could have been considered as clinically relevant. All of these studies had observational designs.
Two randomised controlled trials11 12 evaluated the usefulness of bibliographic assistance on changing physicians’ attitudes towards searching for information and their satisfaction but did not measure important patient outcomes. Banks et al13 in a case-control study evaluated the impact of facilitating information access for physicians who cared for hospitalised patients on the length of hospital stay. We intended to measure important patient outcomes using a randomised design attempting to reduce the risk of bias.
The primary analysis results did not show benefits of the intervention on the outcomes evaluated. This could be explained, as shown by the post hoc power analysis, by the limited number of patients enrolled. It is now clear that the type of intervention we evaluated and its impact on those outcomes would require a larger sample in order to prove its benefits.
The published results that are found in the literature regarding the impact of bibliographic assistance on medical practice are heterogeneous.4 Some studies have demonstrated benefits on important patient outcomes like the one performed by Banks et al,13 which suggest that facilitating information access for physicians who take care of hospitalised patients could result in a shorter length of hospital stay.
In a review performed by Bryant and Gray,14 they state that there is not only a limited amount of literature on this subject, but that it is also based on trials with small sample sizes and with high heterogeneity in quality, data analysis, way of reporting results and design. This makes it difficult to apply the results to daily practice.
Hence, considering the low methodological quality of the studies and the inconsistency of their results, we can conclude that the quality of the existing evidence regarding the impact of bibliographic assistance on important patient outcomes is poor. In this context, this study attempts to bring light to the existing evidence with a design that reduces the risk of biased results. Nevertheless, there are some weaknesses of our study that could make the interpretation of its results difficult. First, it has limited statistical power to prove the intervention benefits or to believe that this was a negative study. Second, we did not measure whether the information provided to the attending physicians was actually used in patient care. These data could have been useful for understanding why the two groups did not differ in outcomes. Finally, only questions that arose during morning reports from Mondays through Thursdays were answered. This delay in the identification and answer of questions that might have arisen from Fridays to Sundays could have negatively affected the impact of the intervention.
In the primary analysis, our results did not reach statistical significance. However, we found that bibliographic assistance might have an impact on the subgroup of patients whose attending physicians received hand-delivered information. This intervention seemed to decrease the rate of transfer to ICUs and in-hospital mortality. According to the criteria proposed by Sun et al,15 it is unlikely that the differences found in the subgroup of patients whose physicians received hand-delivered information are due to a real effect of the intervention, since the variable was measured after the allocation of the randomisation, and the number of events in one group was 0, making it difficult to appropriately estimate the effect. We believe that the differences observed in this subgroup probably stem from differences in prognosis and not from the effects of the intervention. Nevertheless, we consider that the hypothesis of the existence of a subgroup of patients, who could particularly benefit from some type of bibliographic assistance, should be considered when designing future studies.


Admitted patients frequently raise questions that require the assignment of specific resources to be answered. Those patients who generate questions seem to have a higher risk of being transferred to an ICU and a longer hospital stay. The usefulness of the bibliographic assistance to change patient important outcomes could not be demonstrated in this study. The results suggest the existence of a subgroup of patients who might benefit from interventions such as delivering information by hand. This hypothesis could be tested in future studies.


We appreciate Melissa Kucharczyk’s contribution to the translation of this article into English.


  • Competing interests None.


Enhanced by Zemanta

Management of asthma in pregnancy guided by measurement of fraction of exhaled nitric oxide: a double-blind, randomised controlled trial

Management of asthma in pregnancy guided by measurement of fraction of exhaled nitric oxide: a double-blind, randomised controlled trial
Ms Heather Powell MMedSc,Vanessa E Murphy PhD,Prof D Robin Taylor MD,Prof Michael J Hensley PhD,Kirsten McCaffery PhD,Warwick Giles PhD,Vicki L Clifton PhD,Prof Peter G Gibson MBBS
The Lancet – 10 September 2011 ( Vol. 378, Issue 9795, Pages 983-990 )
DOI: 10.1016/S0140-6736(11)60971-9


ber 201

Asthma exacerbations during pregnancy are common and can be associated with substantial maternal and fetal morbidity. Treatment decisions based on sputum eosinophil counts reduce exacerbations in non-pregnant women with asthma, but results with the fraction of exhaled nitric oxide (FENO) to guide management are equivocal. We tested the hypothesis that a management algorithm for asthma in pregnancy based on FENO and symptoms would reduce asthma exacerbations.


We undertook a double-blind, parallel-group, controlled trial in two antenatal clinics in Australia. 220 pregnant, non-smoking women with asthma were randomly assigned, by a computer-generated random number list, before 22 weeks’ gestation to treatment adjustment at monthly visits by an algorithm using clinical symptoms (control group) or FENO concentrations (active intervention group) used to uptitrate (FENO >29 ppb) or downtitrate (FENO <16 ppb) inhaled corticosteroid dose. Participants, caregivers, and outcome assessors were masked to group assignment. Longacting β2 agonist and minimum dose inhaled corticosteroid were used to treat symptoms when FENO was not increased. The primary outcome was total asthma exacerbations (moderate and severe). Analysis was by intention to treat. This study is registered with the Australian and New Zealand Clinical Trials Registry, number 12607000561482.


111 women were randomly assigned to the FENO group (100 completed) and 109 to the control group (103 completed). The exacerbation rate was lower in the FENO group than in the control group (0·288 vs 0·615 exacerbations per pregnancy; incidence rate ratio 0·496, 95% CI 0·325—0·755; p=0·001). The number needed to treat was 6. In the FENO group, quality of life was improved (score on short form 12 mental summary was 56·9 [95% CI 50·2—59·3] in FENO group vs 54·2 [46·1—57·6] in control group; p=0·037) and neonatal hospitalisations were reduced (eight [8%] vs 18 [17%]; p=0·046).


Asthma exacerbations during pregnancy can be significantly reduced with a validated FENO-based treatment algorithm.


National Health and Medical Research Council of Australia.

Morning Report Questions

Hypercalcemia in Pregnancy

In our Clinical Problem-Solving series, information about a real patient is presented in stages to an expert clinician, who responds to the information, sharing his or her reasoning with the reader.  The latest article, “A Problem in Gestation,” was first presented as an Interactive Medical Case, giving readers the opportunity to test their diagnostic skills.
Primary hyperparathyroidism occurs rarely during pregnancy. The morbidity associated with primary  hyperparathyroidism during pregnancy is substantial, with complications reported in up to 67% of affected mothers and 80% of fetuses and neonates, usually in the presence of severe hypercalcemia.

Clinical Pearls

 How should levels of parathyroid hormone (PTH) and vitamin D be interpreted in a pregnant woman with  hypercalcemia?
PTH levels are typically in the low-to-midnormal range during pregnancy. A normal PTH level in a pregnant woman with hypercalcemia is consistent with primary hyperparathyroidism. Although an elevated level of  1,25-dihydroxyvitamin D is a recognized cause of hypercalcemia in nonpregnant patients with certain neoplastic or granulomatous disorders (e.g., lymphoma, sarcoidosis, or tuberculosis), in pregnant patients, the elevated level may  simply reflect the physiological increase in 1,25-dihydroxyvitamin D during normal pregnancy.
 What are the complications associated with hyperparathyroidism during pregnancy?
Fetal complications associated with maternal hyperparathyroidism include restriction of intrauterine growth, low  birth weight, preterm delivery, stillbirth, miscarriage, and neonatal tetany. The maternal complications are similar to those seen in nonpregnant women and include nephrolithiasis, pancreatitis, bone disease, changes in mental status,  and hypercalcemic crisis.

Morning Report Questions

Q: How should severe hyperparathyroidism in pregnancy be managed?
A: Parathyroidectomy is the only definitive therapy and is generally recommended for cases of symptomatic and  severe hypercalcemia. The second trimester is generally preferred for surgery, but for patients in whom medical  management is ineffective, surgical intervention may be necessary irrespective of the gestational age.
Q: How can the success of a parathyroidectomy be determined intraoperatively?
A: Intraoperative PTH monitoring takes advantage of the short half-life of PTH in plasma (3 to 4 minutes) and the  availability of a rapid assay for PTH. A reduction in PTH levels of more than 50% is considered to be an indicator of  successful removal of the adenoma. Postoperative monitoring of this patient’s serum calcium levels should be  continued.