From the Departments of Psychiatry (Drs Druss, Rohrbaugh, and Rosenheck and Ms Levinson) and Public Health (Drs Druss and Rosenheck), Yale University, and Northeast Program Evaluation Center, VA Healthcare System (Ms Levinson), West Haven, Conn.
This randomized trial evaluated an integrated model of primary medical care for a cohort of patients with serious mental disorders.
A total of 120 individuals enrolled in a Veterans Affairs (VA) mental health clinic were randomized to receive primary medical care through an integrated care initiative located in the mental health clinic (n = 59) or through the VA general medicine clinic (n = 61). Veterans who obtained care in the integrated care clinic received on-site primary care and case management that emphasized preventive medical care, patient education, and close collaboration with mental health providers to improve access to and continuity of care. Analyses compared health process (use of medical services, quality of care, and satisfaction) and outcomes (health and mental health status and costs) between the groups in the year after randomization.
Patients treated in the integrated care clinic were significantly more likely to have made a primary care visit and had a greater mean number of primary care visits than those in the usual care group. They were more likely to have received 15 of the 17 preventive measures outlined in clinical practice guidelines. Patients assigned to the integrated care clinic had a significantly greater improvement in health as measured by the physical component summary score of the 36-Item Short-Form Health Survey than patients assigned to the general medicine clinic (4.7 points vs −0.3 points, P<.001). There were no significant differences between the 2 groups in any of the measures of mental health symptoms or in total health care costs.
On-site, integrated primary care was associated with improved quality and outcomes of medical care.
AN EXTENSIVE literature has demonstrated a link between availability of primary care services and improved quality and outcomes of medical care.1,2 Primary medical care may be particularly important for vulnerable populations, for whom geographic and socioeconomic disadvantage may make it difficult to successfully obtain access to appropriate medical care.3 Patients with mental illness constitute one such vulnerable population. Socioeconomic disadvantage,4 difficulties in obtaining and maintaining health insurance,5 symptoms such as cognitive limitations and lack of motivation, and physician discomfort in treating these patients may all combine to limit these individuals' ability to obtain medical care.6
For patients with mental illnesses treated in the public sector, specialty mental health clinics are likely to be the first, and often the only, points of contact with the health care system.7 During the mid-1970s, mental health care policymakers began to advocate for public sector psychiatrists to be designated as primary care providers.8,9 More recent proposals have suggested providing psychiatrists with additional medical training to permit them to provide their patients with a full range of medical services.10 However, public sector mental health care facilities rarely devote substantial time or resources to their patients' medical care.11 When researchers have taken medical histories and administered physical examinations to patients treated in these clinics, fewer than half of the medical illnesses had previously been recognized.12,13
There is almost no literature describing or evaluating programs for improving the medical care of patients with mental illnesses. To our knowledge, only one previous article14 in the literature described a program integrating medical treatment for patients with serious mental disorders; the authors of that article concluded that such models appeared feasible and warranted systematic study using randomized designs.
This study compares the delivery of integrated medical care provided in a mental health clinic with usual care in a general medicine clinic for patients with serious mental disorders. We test the hypothesis that integrated care can increase access to primary care services, raise quality of preventive care, and improve health-related quality of life.
Subjects were recruited from a Veterans Affairs (VA) mental health clinic treating approximately 5000 outpatients at an academic medical center. All mental health care providers were asked to refer any patients whom they thought would benefit from primary care to be assigned a medical treater. All patients were eligible for enrollment in the study except for those who had a current primary care provider or an urgent or multiple serious chronic problems. Patients who already had a primary care provider listed in VA electronic records (approximately half of the clinic's 5000 patients) were not eligible for enrollment. The family practitioner prescreened referrals to the clinic, which was authorized to treat routine but not urgent or complex medical problems. Patients determined by the family practitioner to have had a medical hospitalization in the past 6 months or 4 or more serious chronic conditions were referred to the general medical clinics.
A research assistant obtained informed consent from all eligible referrals who agreed to participate in the study. Participants were then randomized to receive care in either the integrated care clinic or the VA general medicine clinic (usual care), using computer-generated random numbers. The recruitment and study procedures were approved by local VA and university institutional review boards.
The psychiatry service assumed clinical responsibility for the primary medical care of all patients randomized to the integrated care intervention and paid the salaries of all clinic staff through clinical funds. The clinic was located contiguous to the mental health clinics.
The clinic was staffed by a nurse practitioner (1 full-time equivalent [FTE]), a part-time family practitioner (0.5 FTE), a nurse case manager (1 FTE), and an administrative assistant (0.5 FTE). The medical nurse practitioner was the main provider of basic medical care. The family practitioner supervised the nurse practitioner and acted as a liaison to physicians in the psychiatry and medical services. The registered nurse provided patient education, liaison with mental health care providers, and case management services. The administrative assistant scheduled appointments and took telephone messages for the clinic.
Clinic staff emphasized patient education, preventive services, and close contact with mental health care providers, including e-mail, telephone, and face-to-face discussion about patients. Patients were prompted with telephone reminders the day before appointments, and whenever possible, clinic appointments were scheduled immediately following mental health visits to minimize barriers to attendance. When appointments were missed, clinic staff made active efforts to reschedule visits through contacting patients, their family members, and/or mental health care providers.
One provider from the integrated clinic served as a liaison to each of 3 mental health teams, attending weekly team meetings. Mental health care providers were notified about patients' medical status, were asked to keep the integrated care clinic abreast of changes in patients' psychiatric status, and were encouraged to coordinate efforts with the integrated care clinic to ensure that patients attended medical appointments and followed through with needed medical tests.
Veterans randomized to the usual care group in this study were referred to the VA general medicine clinic, located in a building adjacent to the mental health clinic. For each patient randomized to usual care, a referral form was sent and verbal contact was made with the clinic administrator. This process ensured that all veterans referred for care were provided a primary care provider, following the referral pattern that was available before introduction of the integrated care clinic.
Twenty-nine veterans assigned to the general medicine clinic were treated by a medical attending physician, 28 by a nurse practitioner or physician assistant, and 11 by a medical resident. Similar to findings in larger studies,15 we did not find significant differences in process or outcomes of care across provider types in the general medicine clinic (although there was limited statistical power for these subanalyses).
Use of the following categories of service was assessed at baseline and then for each 6-month period after entry into the study: for medical visits, primary care visits (ie, visits to usual source of care as identified in VA administrative records), visits to specialty or consultant providers, inpatient days, and number of emergency department visits; for psychiatric visits, outpatient visits, inpatient days, and emergency department visits.
Data on VA service use were gathered from the hospital's administrative records. Data on service use outside the VA for the same types of services were collected in interviews at baseline, 6-month, and 12-month follow-up. Non-VA services comprised 14% of outpatient specialty visits and 8% of inpatient days across the treatment conditions.
Indicators of quality of preventive care were drawn from US Preventive Services Task Force16 and VA17 guidelines. Because of the cohort's low socioeconomic status, high levels of substance use, and lack of primary care at baseline, all participants were considered high risk and thus eligible for interventions such as influenza vaccine and hepatitis screening, which are generally targeted toward such high-risk populations. Compliance with these services were drawn from review of electronic and paper medical records every 6 months.
Satisfaction with medical care was rated using a 47-item questionnaire that covered the following subdomains: access, provider characteristics (information, attention to patient preferences, emotional support, and courtesy), coordination, continuity of care, and overall care.18,19 The score for each subscale was calculated as the mean number of questions in that domain for which the individuals reported difficulties during either the 6-month or 12-month follow-up.
The 36-Item Short-Form Health Survey (SF-36) is a well-validated measure of health status constructed for use in the Medical Outcomes Study.20- 22 The physical component summary23 was the primary clinical outcome measure for the study. For patients with serious mental disorders, the physical subscales have been demonstrated to have good internal consistency, test-retest reliability, and concurrent and discriminative validity.24,25 Because the SF-36 mental subscales are less useful in this population,24 we instead mainly relied on the Symptom Checklist–9026 and the Addiction Severity Index27 to assess mental symptoms at baseline at follow-up. These were assessed in unblinded interviews at baseline and every 6 months after randomization. The interviews were conducted by a research assistant with master's degree–level training and extensive interview experience.
Costs were calculated by multiplying the number of units of each type of service by the mean unit costs for those services. Local VA unit costs were drawn from the cost distribution report, a facility-by-facility accounting of inpatient and outpatient expenditures that identifies both direct and indirect costs of care, including staff salaries, equipment costs, and depreciation costs.28,29
Direct costs for the integrated care clinic were calculated based on staff salaries and benefits and other expenditures, including equipment. Unit costs for the integrated care clinic were calculated by multiplying those costs by the ratio of direct to indirect costs for the psychiatry service and then dividing the clinic expenditures by the typical number of clinic visits during the period of study, following a method described previously.28
For non-VA services, inpatient mental and general medical unit costs were based on national inpatient expenditure data published by the American Hospital Association.30 Outpatient unit costs (general medical, specialty medical, and mental health) were based on mean US fees for office visits by specialty.31
All analyses were conducted as intention to treat. To ensure that randomization was successful, bivariate tests were first used to compare baseline demographic, diagnostic, and health status variables between the 2 groups. Bivariate tests were also used to compare the baseline characteristics of dropouts to the remainder of the sample.
Dichotomous service use, satisfaction, and quality of preventive care variables were analyzed as comparisons between groups during the year after randomization. Since there were no significant baseline differences between the 2 groups in demographic, diagnostic, or health status variables (Table 1), bivariate tests were used to compare each of these variables between groups.
Random regression was used for analyses of primary outcomes (health status and costs) during the study period. This method makes it possible to compare the difference in change between groups over time and to conduct intention-to-treat analyses that include subjects with missing data at 1 or more follow-up periods.33 Each equation modeled the dependent variable as a function of randomization group, period (baseline, 6-month, or 1-year follow-up), and the group × time interaction, which represents the difference in change between the 2 groups over time.
Because cost estimates are highly nonnormally distributed, cost differences were modeled using censored normal models for log-transformed cost plus $1. Means were retransformed from the log scale using the smearing estimator technique developed by Duan.34,35
Analyses were conducted using the SAS system, version 8.0 (SAS Institute Inc, Cary, NC). All tests of statistical significance were 2-tailed and used an α level of P<.05.
Of 211 patients referred for primary care medical services, 181 were eligible for randomization (Figure 1). Altogether, 30 patients had multiple chronic conditions or urgent needs that required direct referral to the general medicine clinic. A total of 120 patients consented to participate (Figure 1). Of the 61 veterans who declined, most (51%) opted out of randomization to be assigned directly to the integrated care clinic.
Screening and enrollment process.
Of the 120 veterans who were initially randomized, 76.3% completed the 6-month follow-up survey, 69.2% completed 12-month follow-up, and 66.7% completed both 6- and 12-month surveys. There were similar rates of attrition in the 2 clinics (Figure 1). There were no statistically significant differences in demographic, diagnostic, or health status variables between those with and without missing 6- or 12-month survey data. Because VA utilization, quality, and cost measures were collected via administrative and chart review, data for these variables were available for 100% of subjects randomized into the study. Data for use of non-VA services (a small portion of overall service use) were available only for individuals who completed the follow-up surveys.
Four of the 120 subjects were transferred from the integrated care clinic to the general medicine clinic after randomization. Three of these were found to have urgent medical conditions on initial evaluation, and the fourth was transferred because of a language barrier. There were no significant baseline differences between these crossovers and the remainder of the sample. No subjects assigned to the general medicine clinic were transferred or used any services in the integrated care clinic.
The case manager kept records of interventions that she provided throughout the study period. (These interventions were recorded for the clinic as a whole rather than linked to specific participants in the study.) During the study, the case manager recorded 739 interventions: (1) telephone reminders to patients about upcoming appointments and blood tests (29%), (2) escorting patients to medical appointments (23%), (3) booking transportation from home to the clinic or specialty clinics (18%), (4) communicating with providers in other clinics (17%), (5) picking up medications at the pharmacy (7%), and (6) making home visits to patients' homes to deliver medications or equipment (6%). In addition to these specific interventions, the case manager provided general psychosocial support to patients, encouraging them to call or visit if any problems arose.
Discussions with administrators in both the mental health and general medical clinics confirmed that there were no similar medical case management services targeted toward individuals with mental disorders in either of these 2 settings.
There were no significant differences between the 2 groups in demographic, diagnostic, or health status data at the time of randomization except for prevalence of cardiac disease, which was higher in the integrated care group. Almost all patients were male, reflecting the veteran population from which the sample was drawn. Using an algorithm developed by the National Advisory Mental Health Council that includes diagnosis, Global Assessment of Functioning score, and hospitalization history,32 more than three quarters of patients met criteria for severe mental illness.
After enrollment in the study, a similar range of medical problems was reported in chart reviews among patients with at least 1 visit in each of the 2 groups. During the 1-year study period, more than half of patients with at least 1 visit in each group were found to have at least 1 medical diagnosis not previously recorded in their VA medical records (Table 1).
Patients in the integrated clinic were significantly more likely than those in the general medicine clinic to make a primary care visit in the year after referral (91.5% vs 72.1%; χ21 = 7.5, P = .006) (Table 2). They were also significantly less likely to have an emergency department visit during the year after referral than those in the general medicine clinics (11.9% vs 26.2%; P = .04). There were no significant differences in rates of other categories of service use across the 2 treatment conditions.
Fewer than half (44.2%) of patients had received 1 or more of the preventive interventions in any setting in the year before baseline; on average, patients had received a mean of 1.2 of the possible 17 measures (Table 3). In the year after random assignment, patients in the integrated care clinic were significantly more likely than those in the general medicine clinic to have received 15 of the 17 preventive measures. The 2 groups had similar rates of hemoccult testing. Veterans in the integrated care clinic were significantly less likely than those in the general medicine clinic to have one of the indicators, use of a pneumonia vaccine (Pneumovax). However, among patients 65 years and older, the typical target population for use of this vaccination,16 these differences were not significant.
In the year after randomization, veterans assigned to the integrated care clinic reported significantly fewer problems in 6 of 8 satisfaction domains: access, attention to patient preferences, courtesy, coordination, continuity, and overall care (Table 4). The largest effect was in continuity of care, where only 1.3% of those in integrated care reported a problem, compared with 22.5% of those in the general medical clinic. There was no significant difference between the 2 groups on satisfaction with emotional support or information.
During the year after randomization, subjects in the integrated care clinic had a 4.7-point increase (ie, improvement) in the physical component summary score, whereas subjects in the general medicine clinic had a 0.3-point decline in the score (Table 5). In random regression models, the group × time interaction, which reflects the difference in change between the 2 groups, was significant (t170 = 3.7, P<.001). Although there are no absolute guidelines for clinically significant change on the physical component summary, the average change throughout 1 year in the intervention group (4.7 points) is similar to the effect size seen for effective treatment of duodenal ulcers.36
None of the corresponding group × time interactions for the Symptom Checklist–90 (t160 = 1.62, P = .11), the alcohol (t171 = 0.86, P = .39) or drug (t172 = 0.53, P = .6) subscales of the Addiction Severity Index, or the SF-36 mental component summary (t170 = 0.17, P = .87) were statistically significant (Table 5).
The mean costs per subject treated in the integrated care clinic (logged and then retransformed) were $13 010 (SD, $13 271) vs $14 543 (SD, $15 871) for patients in the general medicine clinic. The group × time interaction term was not significant in the random regression model (t238 = −0.43, P = .67). Primary care costs in the integrated care clinic were estimated at $1582 per patient ($266 per visit), in contrast to $398 per patient ($148 per visit) for the general medicine clinic (t238 = 2.4, P = .02 for group × time interaction in random regression model). This was largely a function of the fact that because the clinic was in its startup phase, clinicians did not have full caseloads. There were no other significant differences in specific components of costs. The significant difference in primary care costs appeared to be offset by large nonsignificant difference in impatient costs between the 2 groups after follow-up ($2673 in the general medical clinic vs $410 in the integrated care clinic group; t238 = −1.32, P = .19).
The study found that for a cohort of patients with serious mental illness, integrated, on-site delivery of primary care was feasible, promoted greater access to primary care and preventive care, and resulted in a significantly larger improvement in health status than usual care. Although the confidence intervals around cost estimates are wide because of the modest sample size, the intervention appeared to be cost neutral when considering total health care expenditures for subjects in each group.
Before baseline, the subjects had received little medical care. Half of medical problems were not documented in VA records, and patients had very low rates of preventive services. Rates of primary care visits and preventive care improved for both the integrated care and the general medicine clinics, implying that any referral for primary care can provide an important first step in improving access to medical care for patients with serious mental disorders. However, patients in the integrated care clinic improved substantially more than those in the general medical clinics. This improvement appeared to be specific to physical health domains, rather than a more general effect on emotional well-being or mental symptoms.
At least 2 broad categories of "active ingredients" in the clinic may have contributed to improved outcomes. First, the clinic used additional staff resources to improve access and adherence to care, including outreach by the case manager, extra time for visits in the clinic, and flexibility in scheduling appointments. This clinic targeted a caseload of only half that carried by practitioners in the VA general medical clinics. However, the clinic provided added value for those additional expenditures in terms of improved quality and clinical outcomes of care. Furthermore, the intervention appeared to be cost neutral in terms of overall expenditures, which are predominantly a function of inpatient rather than outpatient service use.
The second way in which the clinic is likely to have improved care was through a basic reorganization that allowed greater integration of medical and mental health care services. At its most fundamental level, integration involves breaking down boundaries to improve the transfer of information.37 Integration across service lines has been shown to improve care for patients with serious mental illness38,39 and in the treatment of depression in primary care.40- 42 For the integrated care clinic, the on-site location, common chart, and enhanced channels of communication, including joint meetings, e-mail, and in-person contact, facilitated the development of common goals and sharing of information between medical and mental health care providers.
The study has several limitations. The sampling strategy was based on referrals rather than a population-based sampling strategy. The modest sample size provided only limited statistical power for cost estimates, particularly for inpatient service use, in which SDs are highest and distributions least normal. A sample size of 3 to 4 times that used in the present study would probably be needed to make more definitive statements about differences in costs or cost-effectiveness between integrated and usual care.43 The sample size and length of follow-up did not allow for the measurement of more distal outcomes, such as mortality and adverse medical events. Limited resources did not permit the use of blinded interviews, although the possibility of interviewer bias was mitigated by the use of standardized, structured interviews. Similarly, it was impossible to blind participants to their treatment assignment, raising the possibility of bias due to knowledge of that assignment (ie, a Hawthorne effect).
Finally, the VA has a unique population and structural characteristics that may limit generalizability to non-VA settings.44- 46 Most notably, mental health and medical care are already provided in a quasi-integrated fashion in the VA, since both types of services are provided in the same facility.7 The fact that community mental health centers and other public sector mental health facilities do not have in-house medical facilities increases both the potential challenges and benefits of providing on-site primary care in those facilities.
Despite these limitations, the study provides evidence that integrating medical treatment can improve the care and health status of patients with serious mental disorders. We hope that the study can serve as an impetus for further research and program development focused on improving medical care in this vulnerable population.
Accepted for publication April 3, 2001.
This study was funded in part by the VA Connecticut Mental Illness Research, Education, and Clinical Center and by grant K08 MH01556 from the National Institute of Mental Health, Rockville, Md.
We thank Elizabeth Rogers, MD, and Thomas Kosten, MD, who provided expert guidance in designing the clinic and invaluable administrative support in its implementation. We also express our gratitude to Madeleine Pellerin, APRN, Marilyn Ollayos, RN, and Brian Tobin, MD, without whose superb clinical work the study could not have been possible.
Corresponding author and reprints: Benjamin G. Druss, MD, MPH, 950 Campbell Ave/116A, West Haven, CT 06516 (e-mail: email@example.com).
Thank you for submitting a comment on this article. It will be reviewed by JAMA Psychiatry editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 123
Customize your page view by dragging & repositioning the boxes below.
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.