Добавил:
Sekretar
kiopkiopkiop18@yandex.ru
t.me/Prokururor I Вовсе не секретарь, но почту проверяю
Опубликованный материал нарушает ваши авторские права? Сообщите нам.
Вуз:
Предмет:
Файл:Ординатура / Хирургия / Библиотека им академика М.И. Перельмана / Книга_3091_Библиотеки_им_академика_М_И_Перельмана
.pdf
86
Table 4.1
(continued)
SOURCE
OF BIAS SPECIFIC BIAS EXPLANATION PREVENTION
Pygmalion effect/
Rosenthal effect
When the same
interventionists are used for
different arms, their higher
expectations for one arm
positively inuence the
outcome of that arm
– Use different interven-
tionists for different
arms but insure similar
levels of expertise
Expectancy bias/
Optimistic
bias/“True
believer”
Principal investigator’s
strength of commitment to a
specic outcome or treatment
arm promotes preferences in
staff and participants
– Investigator adopts a
scientic mindset of
equipoise throughout all
aspects of trial
– Investigator limits trial
involvement to
supervising the
intervention
Early unblinding
to results
Knowledge of outcome
before completion of
follow-up changes
expectations for remaining
treatment and outcome
assessment
– Protocols for unblinding
to various outcomes are
pre-specied and
approved by a Data and
Safety Monitoring Board
– Interim results
evaluated by Data and
Safety Monitoring
Board only, presented
to them by an unblinded
biostatistician
Unintended
treatments
Inadvertent and differential
non-trial treatments
Non-specic
attention/
Hawthorne effect
Differential attention of any
type improves outcomes
– Use attention control
comparator
– Include attention as a
component of treatment
Placebo response Differential beliefs about
efcacy and/or contextual
factors in the treatment
setting promote placebo
response
– Use placebo control
– Include contextual
factors as components
of treatment
Interventionist
expertise
Differential expertise of
interventionists across arms
– Use highly experienced
interventionists for all
arms
– Manualize treatment
protocols
– Ongoing supervision
and delity checks of
interventionists
(continued)
4 Hypothesized Pathway andBias
https://t.me/medicina_free

87
Table 4.1
(continued)
SOURCE
OF BIAS SPECIFIC BIAS EXPLANATION PREVENTION
Implementation/
Adherence
Different demands in trial
arms promote differential
ability to implement them
and/or willingness to adhere
to them
– Feasibility pilot studies
to assess and improve
adherence to respective
protocols
Dissimilar
treatments
Because treatments are not
identical, they trigger
differential reactivity to
them
Ascertainment
bias
Differences in patient contact
by trial arm inuence staff
awareness of events and
outcomes and participant
ability to recall them
– Use one standardized
approach for outcome
assessment in all
participants
– Separate reports of
outcomes obtained
during the course of
intervening from those
obtained using the
standardized trial
protocol
“Faking good”/
Reactive
self-reports/
Social desirability
Differential desire to please,
by arm, promotes spurious
self-reports
– Objective measures,
rather than self-reports,
whenever possible,
especially for the
primary outcome
Post-
randomization
selection bias
Differential dropout results in
post-randomization non-
equivalence between arms
– Encourage dropouts to
drop the intervention
but stay in the trial
– Minimize burden for
dropouts by obtaining
permission to assess
primary outcome only
– Budget travel to
participant location for
outcome assessment
– Provide generous
participant incentives to
complete nal outcome
assessment
– Intent-to-treat analyses
with conservative
assumptions for missing
data on the primary
endpoint
Overcoming These Challenges in a Behavioral Tria
https://t.me/medicina_free

88
SELECTED EXPERIENCE
FROMBEHAVIORAL TRIALS
The Hypothesized Pathway inaSuccessful Behavioral Trial
The Diabetes Prevention Program was among the greatest successes reported to
date for a lifestyle program’s ability to improve a chronic disease outcome [
16, 31,
32]. The aim was to compare the benets of lifestyle, metformin, and placebo on
preventing the development of diabetes in patients who were insulin resistant.
Results showed that lifestyle was 30% better than the best drug available and 60%
better than a placebo pill.
This lifestyle treat-
ment was developed
progressively and sys-
tematically over
approximately
40years in an array to
studies done by a vari-
ety of investigators.
(See Chapter 3:
Behavioral Treatment
Development, Table
3.9.) This extensive
development resulted
in the ability to articu-
late a quantied
hypothesized pathway
by which the treatment
would translate into a reduction in diabetes incidence (Fig.4.5) [32]. It can be seen
that this pathway “sticks its neck out.” It portrays two components, each of which is
linked to a quantied implementation target and behavioral risk factor target.
Physical activity has a direct path to the primary outcome and an indirect path to it
through its ability to sustain weight loss over and above changes in dietary intake.
Results of the trial supported the hypothesis that this was the pathway by which the
treatment reduced the incidence of diabetes. At the conclusion of the 6-month life-
style treatment, 50% of participants met the goal of ≥7% loss of body weight, and
74% met the goal of ≥150minutes of physical activity/week [16]. By the end of the
average of 3.2years of follow-up, 38% continued to meet the body weight goal, and
58% continued to meet the physical activity goal [16]. Although the percentages of
people expected to meet the behavioral risk factor targets were not specied a priori,
the success of the trial suggests that the percentage of participants who achieved
Fig. 4.5 Hypothesized pathway in the Diabetes Prevention
Program
4 Hypothesized Pathway andBias
https://t.me/medicina_free

89
each target was sufcient to reduce diabetes incidence. These percentages of suc-
cess can be embedded into future hypothesized pathways as clinically signicant
targets. Further support for the validity of the hypothesized model is provided by the
10-year follow-up of the program [33]. There were no differences in diabetes inci-
dence among the three randomized arms in the interval between the 3.2-year end of
treatment and the 10-year follow-up. This is tracked with posttreatment weight
regain over the same interval.
The Hypothesized Pathway Explains aNull Trial
The aim of the Women’s Health Initiative Dietary Modication Trial was to deter-
mine if a low-fat eating pattern would reduce risk of cardiovascular disease, colorec-
tal cancer, and breast cancer. A total of 48,385 women were randomized to a diet
intervention or a usual care comparison in a 40:60 ratio, respectively. This was a
null trial in which there was no benet of the dietary intervention on any of the three
primary clinical outcomes. This null result, in combination with the extraordinary
expenditure of resources expended in this trial, justied working back through the
hypothesized pathway to determine what happened.
The behavioral target of the intervention was a low-fat eating pattern, operational-
ized as ≤20% of intake from fat, 5 servings/day of vegetables and fruits, and 6 serv-
ings/day of grains. The results for the cardiovascular disease outcome are presented
in Table4.2 [34]. It can be seen that the diet improved but dietary goals were not met
at the end of the 6-year follow-up period.
A post hoc, per-protocol
investigation was aimed at
determining benet if partici-
pants had achieved dietary
goals. The treated group was
broken down into quartiles
based upon the dietary
changes achieved by 1 year.
Rates of cardiovascular dis-
ease at 6years were compared
in those who were in the lowest quartile in the treated arm relative to those in the
usual care comparator. Those who had an average intake of saturated fat <6.1%, had
an average intake of trans fat <1.1%, or ate ≥6.5 servings of vegetables and fruits/
day had a lower incidence of cardiovascular events than those randomized to usual
care (HR=0.81–0.88).
Although post hoc ndings are suggestive but not conclusive, they provide a valu-
able opportunity to consider reasonable next steps in a program of research after a
Table 4.2 Expected vs. observed dietary changes in the
Women’s Health Initiative Dietary Modication Trial
Goal Baseline 1year 6years
Percent energy
from fat
≤20% 37.8% 24.3% 28.8%
Vegetable/fruit
servings/day
5 3.6 5.1 4.9
Grains servings/
day
6 4.7 5.1 4.3
Selected Experience fromBehavioral Trials
https://t.me/medicina_free

90
null trial. Because a priori goals specied in the hypothesized pathway were not
met, this was a failure of the treatment, not the hypothesis. Post hoc analyses sug-
gested that the specic target for vegetable intake should be increased from 5 to 6.5
servings/day. They also suggested that the treatment be rened to target saturated
and trans fat rather than total fat. A rened hypothesized pathway, and a more tar-
geted intervention, may provide a conclusive test of the impact of diet on cardiovas-
cular disease. But before such a rigorous replication is undertaken, it would be wise
to conduct a small proof-of-concept study to determine if a rened and more tar-
geted intervention is strong enough to achieve the revised clinically signicant tar-
gets on vegetable, saturated fat, and trans fat intake.
Consequences ofMistaking aFailed Treatment foraFailed
Hypothesis
The Trials of Hypertension Prevention (TOHP) Collaborative Research Group tri-
als aimed to determine the best approach for preventing the development of hyper-
tension in persons with high normal diastolic blood pressure. In the rst of two
trials, the Phase I TOHP-I trial tested the feasibility and efcacy of seven nonphar-
macologic interventions on the primary endpoint of diastolic blood pressure [29].
These interventions included three lifestyle treatments (weight reduction, sodium
restriction, stress management) and four dietary supplements. All were compared
against a usual care control. The importance of TOHP-I was that only those inter-
ventions that were efcacious would go on to be tested in the larger Phase II
TOHP-II trial which examined the impact of the interventions on the incidence of
hypertension [35].
TOHP-I results indicated that only the weight loss and sodium restriction groups
were effective at lowering diastolic blood pressure. Stress management was ineffec-
tive at both 6 and 18months suggesting a failure of the hypothesis that reduction in
stress was associated with a reduction in blood pressure. From the Abstract:
“Despite good compliance, stress management did not reduce diastolic blood pressure
signicantly (P>.05).”
However, a closer look raises the possibility that this was instead a failure of the
intervention aimed at managing stress. Although attendance at stress sessions was
86%, Table4.3 shows that at the 18-month end of treatment, the stress management
group experienced a signicant increase, and the usual care group a decrease, in the
frequency of hassles, the primary measure of stress (+1.9 vs. −0.5, respectively,
p < 0.05). This translated into no difference between arms on diastolic blood
pressure at 18months, although both were below the clinically signicant cutpoint
for hypertension of 80mmHg.
4 Hypothesized Pathway andBias
https://t.me/medicina_free

91
In contrast, Table 4.3 shows that the weight outcome in TOHP-I followed the
expected pattern. Participants in the weight reduction intervention lost weight, and
the usual care controls gained weight (−3.8kg vs. +0.1kg, respectively, p<0.01).
This translated into a statistically signicant 2.6mmHg difference between arms on
diastolic blood pressure at 18months (p<0.01). Only the treated group achieved
the clinically signicant cutpoint for hypertension of <80mmHg.
Because the stress management intervention did not produce a statistically signi-
cant reduction in blood pressure in TOHP-I, it did not move forward to be evaluated
for its impact on incidence of hypertension in TOHP-II.However, the weight reduc-
tion treatment was evaluated in TOHP-II.It produced an average of 2.0kg of weight
loss and achieved a mean blood pressure of 81.5mmHg at 18months, both of which
were statistically different from usual care (p<0.001) due, to a certain extent, to the
large sample size. The primary endpoint, incidence of hypertension, was reduced by
22% at 18months (p = 0.05) and by 13% at 48months (p =0.06). This nding
resulted in the recommendation to include weight reduction in clinical practice
guidelines for patients with high normal blood pressure.
The failure to test the stress management intervention in TOHP-II was a missed
opportunity. This decision was made based upon the inability to distinguish between
a failure of the stress intervention and a failure of the hypothesis that reduction in
stress improves diastolic blood pressure. The “red ags” were the increase in stress
in the treated group and the decrease in stress in the usual care group. Whatever was
going on in these two arms, both arms decreased diastolic blood pressure from a
baseline of 82mmHg (above the cutpoint for hypertension of 80mmHg) to below
this cutpoint.
Table 4.3 Comparison of treatment effects in TOHP-I and TOHP-II at the 18-month
follow-up
TOHP- I TOHP-II
N
Behavioral
target:
∆ 0–18 months
Diastolic
blood pressure
target:
X
18months N
Behavioral
target:
∆ 0–18 months
Diastolic
blood pressure
target:
X
18months
Stress
management
Treated
Usual care
242
589
+1.9
∗a
−0.5
78.4 mmHg
ns
78.9mmHg
—
—
—
—
—
—
Weight
reduction
Treated
Usual care
308
589
−3.8kg
∗∗
+0.1kg
77.5 mmHg
∗∗
80.1mmHg
595
596
−2.0kg
∗∗∗
+0.7kg
81.5 mmHg
∗∗∗
82.6mmHg
a
Frequency of Daily Hassles Scale
ns not signicant
∗
p<0.05
∗∗
p<0.01
∗∗∗
p<0.001
Selected Experience from Behavioral Trials
https://t.me/medicina_free

92
This is an excellent example of how critical it is to make the distinction between a
failure of the hypothesis and a failure of the treatment. The existence of a quantied
hypothesized pathway would have helped make this distinction. In the face of a
failed stress intervention, a reasonable next step would have been to increase its
strength in a renement study and replicate for the purpose of determining whether
or not it should be a candidate for further evaluation in TOHP-II.Because the stress
intervention was not evaluated in TOHP-II, it is unclear how it would have fared
alone, or in combination with the other lifestyle factors. Another trial is needed. The
clinical implication of this mistake is that experts in hypertension prevention inter-
pret the TOHP results to mean that preventive efforts should focus on weight, but
not on stress.
RECOMMENDATIONS
It is tempting to take the easy road in an academic career. It is, for example, com-
paratively easy to conduct a randomized trial guided by a complex conceptual
model, compare treated to controls on a wide variety of outcomes, show a statistically
signicant difference on one or more of these outcomes, judge the treatment to be
successful, get a publication needed to advance an academic career, and decide the
job is done. This is a reasonable strategy, supported by a culture that includes not
only investigators but also funders, institutions, and reviewers.
The problem with this “easy road” is that this is not good science. The result could
have little to do with improving a chronic disease. It could be statistically, but not
clinically, signicant. It could be explained by simple design decisions such as the
choice of the control, the size of the sample, or the number of comparisons
conducted.
The “road not taken” is the harder
road. It is the one that aims to iden-
tify behavioral treatments that
improve chronic disease endpoints
for the purpose of maximizing
effective management. Should this
road be taken, the roadmap for the
trip is progressive treatment devel-
opment guided by a hypothesized
pathway. The pathway is created in the earliest stages of development and guides
the studies, designs, and milestones evaluated at each subsequent stage. As an
understanding of the treatment grows, the hypothesized pathway becomes simpler,
more targeted, and more precise, and treatment evaluation progresses toward bigger,
The Road Not Taken
“. . . Two roads diverged in the wood and I –
I took the one less traveled by,
And that has made all the difference.”
Robert Frost
(1874–1963)
4 Hypothesized Pathway andBias
https://t.me/medicina_free

93
more rigorous, and more ambitious trials. The end game is an evidence-based
behavioral treatment that meets the rigorous standards of evidence established in
medical research.
For those who choose “the road not taken,” several recommendations are offered.
Stick Your Neck Out
Karl Popper, the great philosopher of science, has provided behavioral trialists with
two gifts that should be considered seriously. First, he encourages us to welcome
failure as an opportunity to rene, simplify, and progress. This mindset is consistent
with one of the key mantras of Silicon Valley: “Failure provides the seedbed for
innovation.” Second, Popper encourages humility. Any claims about the benets of
a treatment can be overturned in the next trial. Embracing failure and humility in
one’s science and career encourages the freedom to have intellectual curiosity.
“Stick your neck out” means guiding your research program with a quantied
hypothesized pathway. It means making bold hypotheses, seeing failure as an
opportunity for renement, persisting in the effort to understand, and progressing
toward simplication. In behavioral treatments for chronic diseases, the web of
causal factors is complex and progress can be slow. Those who are willing to “stick
your neck out” will be aligning the method to the complexity of the problem.
Advance Academically asaBehavioral Trialist
Aspiring behavioral trialists may believe they are faced with a dilemma. Either
advance one’s academic career or do good science. Academic advancement is based
upon products which most often take the form of external grants and publications.
Doing good science as a trialist is characterized by a process that features treatments
that fail and papers that have difculties getting published.
The contradictory goals of academic advancement and good science are beginning
to dissolve in the eld of behavioral treatments for chronic diseases with recent
evolutions in funding and publication practices. The National Institutes of Health
now offer a variety of funding mechanisms for early treatment development studies
and funding mechanisms that combine early feasibility studies with conrmatory
trials but make success in the former contingent for continued funding for the latter.
On the publication side, there has been an emergence of journals directed toward
early phase studies. Publishing potential is maximized if early studies are posi-
tioned within the context of a progressive program of research, rather than an end
Recommendations
https://t.me/medicina_free

94
unto themselves. Failures, guided by a priori hypothesized pathways, become
important topics for papers if they not only document the failure but articulate why
it is likely to have occurred and how it is a springboard to the next study guided by
a rened hypothesized pathway. Guidelines now exist for the publication of inter-
vention development studies [36].
Because behavioral treatment development is a slow process, it is wise to have other
lines of research with shorter timelines for publications. Fruitful second lines of
research can be developed through collaborations with investigators who are lead-
ing ongoing epidemiological studies or clinical trials. These investigators have a
responsibility to their funding agency to show productivity in exchange for the large
amount of resources they have been given to conduct such investigations. Afliating
with these investigators, learning how to work with their datasets, and writing
papers from them is mutually benecial. Beyond this, there are now many public
use datasets that exist for completed studies. These datasets can be accessed without
requiring collaboration with the principal investigator.
Become anExpert inBehavioral Clinical Trial Biases
Rigorous behavioral clinical trials require bridging disciplines and synthesizing
insights. The challenge in a behavioral trial is to preserve the randomization over
long periods of time, in the presence of treatment arms that often “look and feel”
very different from one another, and under conditions where investigators often
have a long-standing commitment to the treatment under investigation. Since the
treatment is behavioral, mastery of biases in experimental design is needed. Since
the outcome is a chronic disease or surrogate, mastery of biases in clinical trials
is needed.
Interdisciplinary sophistication in the range of potential biases that could occur in a
behavioral trial makes it clear that it is a mistake to assume that once randomization
is accomplished, the problems with bias are over. In fact, new challenges are now
beginning.
4 Hypothesized Pathway andBias
https://t.me/medicina_free

95
REFERENCES
1. Lewens T (2016) The meaning of science: an introduction to the philosophy of science. Basic
Books, NewYork
2. Piantadosi S (2017) Clinical trials: a methodologic perspective, 3rd edn. Wiley, Hoboken
3. Magee B (1973) Karl Popper. Viking, New York
4. Hume D (1739-1740) A treatise of human nature. Edited by DF Norton, MJ Norton (2000).
Oxford University Press, Oxford
5. Popper KR (1959) The logic of scientic discovery. Basic Books, New York
6. Feyerabend P (1975) Against method: outline of an anarchist theory of knowledge. Verso,
NewYork
7. Campbell DT (1988) Methodology and epistemology for social science: selected papers.
University of Chicago Press, Chicago
8. Fisher RA (1935) The design of experiments. Oliver and Boyd, Edinburgh
9. Susser M (1973) Causal thinking in the health sciences. Concepts and strategies of epidemiol-
ogy. Oxford University Press, New York
10. Medawar PB (1979) Advice to a young scientist. Harper & Row, New York
11. Sackett DL (1979) Bias in analytic research. J Chron Dis 32:51–63
12. Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs
for generalized causal inference. Houghton Mifin, Boston
13. Shapiro SH, Louis TA (1983) Clinical trials: issues and approaches. Marcel Dekker, New York
14. Law MR, Morris JK, Wald NJ (2009) Use of blood pressure lowering drugs in the prevention
of cardiovascular disease: meta-analysis of 147 randomised trials in the context of expecta-
tions from prospective epidemiological studies. BMJ 338:b1665.
https://doi.org/10.1136/bmj.
b1665
15. Naci H, Brugts JJ, Fleurence R, Tsoi B, Toor H, Ades AE (2013) Comparative benets of
statins in the primary and secondary prevention of major coronary events and all-cause mor-
tality: a network meta-analysis of placebo-controlled and active-comparator trials. Eur J Prev
Cardiol 20:641–657
16. Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, Nathan
DM, Diabetes Prevention Program Research Group (2002) Reduction in the incidence of type
2 diabetes with lifestyle intervention or metformin. New Engl J Med 346:393–403
17. Kosaka K, Noda M, Kuzuya T (2005) Prevention of type 2 diabetes by lifestyle intervention: a
Japanese trial in IGT males. Diab Res Clin Pract 67:152–162
18. Saito T, Watanabe M, Nishida J, Izumi T, Omura M, Takagi T, Fukunaga R, Bandai Y, Tajima
N, Nakamura Y, Ito M, Zensharen Study for Prevention of Lifestyle Diseases Group (2011)
Lifestyle modication and prevention of type 2 diabetes in overweight Japanese with impaired
fasting glucose levels. Arch Intern Med 171:1352–1360
19. Sakane N, Sato J, Tsushita K, Tsujii S, Kotani K, Tsuzaki K, Tominaga M, Kawazu S, Sato
Y, Usui T, Kamae I, Yoshida T, Kiyohara Y, Sato S, Kuzuya H, Japan Diabetes Prevention
Program (JDPP) Research Group (2011) Prevention of type 2 diabetes in a primary healthcare
setting: three-year results of lifestyle intervention in Japanese subjects with impaired glucose
tolerance. BMC Public Health 11:40. https://doi.org/10.1186/1471-2458-11-40
20. Lindahl B, Nilsson TK, Borch-Johnsen K, Oder ME, Soderberg S, Widman L, Johnson O,
Hallmans G, Jansson J (2009) A randomized lifestyle intervention with 5-year follow-up in
subjects with impaired glucose tolerance: pronounced short-term impact but long-term adher-
ence problems. Scand J Pub Health 37:434–442
21. Pan XR, Li GW, Hu YH, Wang JX, Yang WY, An ZX, Hu ZX, Lin J, Xiao JZ, Cao HB, Liu PA,
Jiang XG, Jiang YY, Wang JP, Zheng H, Zhang H, Bennett PH, Howard BV (1997) Effects of
diet and exercise in preventing NIDDM in people with impaired glucose tolerance. Diabetes
Care 20:537–544
References
https://t.me/medicina_free
Соседние файлы в папке Библиотека им академика М.И. Перельмана
