Sophisticated research design in chiropractic and manipulative therapy; what you learn depends on how you ask. Part C: Mixed Methods: “why can’t science and chiropractic just be friends?”



Published May 25, 2016
Lyndon Amorin-Woods


Many commentators have recognised the limitations and inapplicability of the traditional quantitative pyramid hierarchy especially with respect to complementary and alternative (CAM) health care, observing the way Evidence-based Practice [EBP] is sometimes implemented is controversial, not only within the chiropractic profession, but in all other healthcare disciplines, including medicine itself. A phased approach to the development and evaluation of complex interventions can help researchers define the research process and complex interventions may require use of both qualitative and quantitative methods. The chiropractic profession has little to fear from evidence-based practice; in fact it should be used productively to improve patient care, clinical outcomes and the standing of the profession in the eyes of the public, other health professions and legislators. 
Abstract 180 | PDF Downloads 129



Evidence-Based Practice, Mixed Methods, Research Design

1. Jonas W. The evidence house: How to build an inclusive base for complementary medicine. West J Med.2001;175(2):79-80
2. Pincus T. Analyzing long-term outcomes of clinical care without randomized controlled clinical trials: the consecutive patient questionnaire database. Adv Mind Body Med 1997;13:3-31
3. Cassel E. The nature of suffering and the goals of medicine. N Engl J Med 1982;306(11):639-45
4. Feinstein A. "Clinical Judgment" revisited: the distraction of quantitative models. Ann Intern Med 1994;120(9):799-805
5. Yue Q, Bergquist C, Gerden B. Safety of St. John's wort. Lancet 2000;355:576-7
6. Linde K, Jonas W. Evaluating complementary and alternative medicine: the balance of rigor and relevance. In: Jonas WB, Levin JS, eds. Essentials of complementary and alternative medicine. Philadelphia: Lippincott Williams & Wilkins; 1999
7. Walach H, Falkenberg T, Fonnebo V, Lewith G, Jonas W. Circular instead of hierarchical: methodological principles for the evaluation of complex interventions. BMC Med Research Methodol 2006;6(1):29
8. Shadish WRJ., Cokk TD., Leviton LC., editors. Foundations of program evaluation. Theories of practice. Newbury Park, CA: Sage; 1991
9. Wittmann WW, Walach H. Evaluating complementary medicine: Lessons to be learned from evaluation research. In: Lewith G, Jonas WB, Walach H., editors. In Clinical research in complementary therapies: principles, problems, and solutions. London: Churchill Livingston; 2002:93-108
10. Triano JJ. What constitutes evidence for best practice? J Manipulative Physiol Ther 2008;31:637-643
11. Amorin-Woods L, Parkin-Smith G. Clinical decision-making to facilitate appropriate patient management in chiropractic practice: 'the 3-questions model'. Chiropr Man Therap 2012;20(1):6
12. Leboeuf-Yde C, Lanlo O, Walker B. How to proceed when evidence-based practice is required but very little evidence available? Chiropr Man Thera. 2013;21(1):24
13. Martel J, Dugas C, Dubois J-D, Descarreaux M. A randomised controlled trial of preventive spinal manipulation with and without a home exercise program for patients with chronic neck pain. BMC Musculoskelet Disord 2011;12(1):41
14. Hancock MJ., Maher CG., Latimer J., McAuley JH. Selecting an appropriate placebo for a trial of spinal manipulative therapy. Aust J Physiother 2006;52(2):135-8
15. Kawchuk GN, Haugen R, Fritz J. A True Blind for Subjects Who Receive Spinal Manipulation Therapy. Arch Phys Med Rehabil 2009;90(2):366-8
16. Hawk C, Long CR, Reiter R, Davis CS, Cambron JA, Evans R. Issues in planning a placebo-controlled trial of manual methods: results of a pilot study. J Altern Complement Med 2002 Feb;8(1):21-32
17. Richards DA, Hamers JPH. RCTs in complex nursing interventions and laboratory experimental studies. Int J Nurs Stud 2009;46(4):588-92
18. Buchan H. Gaps between best evidence and practice: causes for concern. Med J Australia 2004;180:S48-S9
19. Medical Research Council. Developing and evaluating complex interventions: new guidance. London: Medical Research Council. 2008
20. Medical Research Council. A Framework for development and evaluation of RCTs for complex interventions to improve health. London: Medical Research Council. 2000
21. Sorensen LP, Stochkendahl MJ, Hartvigsen J, Nilsson NG. Chiropractic Patients in Denmark 2002: an expanded description and comparison with 1999 survey. J Manipulative Physiol Ther 2006;29(6):419-24
22. Sibbritt D, Adams J. Back pain amongst 8,910 young Australian women: a longitudinal analysis of the use of conventional providers, complementary and alternative medicine (CAM) practitioners and self-prescribed CAM. Clin Rheumatol 2010;29(1):25-32
23. Zhang A. Complementary and alternative medicine use in Australia: A national population-based study. Melbourne: RMIT University Research Repository; 2006
24. Department of Health WA. Spinal pain model of care. Perth: Health Networks Branch, Department of Health, Western Australia Perth, Western Australia: Health WA; 2009 [27th June 2015]. Available from:
25. Koes B, van Tulder M, Ostelo R, Burton A, Waddell G. Clinical guidelines for the management of low back pain in primary care: an international comparison. Spine 2001;26:2504 - 2513
26. Koes B, van Tulder M, Lin C, Macedo L, McAuley J, Maher C. An updated overview of clinical guidelines for the management of non-specific low back pain in primary care. Eur Spine J 2010;19:2075 - 2094
27. Foster N. Barriers and progress in the treatment of low back pain. BMC Me. 2011;9(1):108
28. Concato J., Shah N., Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000;342:1887-92
29. Deisboeck TS. Personalizing medicine: a systems biology perspective. Mol Syst Biol 2009;5:249
30. Pharmaceutical Research and Manufacturers of America. Pharmaceutical Industry Profile 2010
31. Kaplan BJ., Giesbrecht G, Shannon S, McLeod K. Evaluating treatments in health care: The instability of a one-legged stool. BMC Med Research Methodol 2011;11:65
32. Rosner AL. Evidence-based medicine: Revisiting the pyramid of priorities. J Bodyw Mov Ther 2012;16(1):42-9
33. Verhoef MJ, Lewith G, Ritenbaugh C, Boon H, Fleishman S, Leis A. Complementary and alternative medicine whole systems research: beyond identification of inadequacies of the RCT. Complement Ther Med 2005;13 206e12
34. West SG, Duan N, Peguegnat W, Gaist P, Des Jarais DC, Holtgrave D, et al. Alternatives to the randomized controlled trial. Am J Public Health 2008. ;98(8):1359e66
35. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 2003;290(12):1624e32
36. Hawk C, Khorsan R, Lisi AJ, Ferrance RJ, Evans MW. Chiropractic care for nonmusculoskeletal conditions: a systematic review with implications for whole systems research. J Altern Complement Med 2007;13(5): 491e512
37. White B. Making evidence-based medicine doable in everyday practice. Fam Pract Manag 2004;51:e58
38. Ritenbaugh C., Aickin M., Bradley R., Caspi O., Grimsgaard S., Musial F. Whole systems research becomes real: new results and next steps. . J Altern Complement Me. 2010;;16((1):):131-7
39. Guastello S, Koopmans, M., Pincus, D. (eds)., . Chaos and Complexity in psychology: the theory of nonlinear dynamical systems: Cambridge University Press; 2008
40. Verhoef M., Lewith G., Ritenbaugh C., Thomas K., Boon H., Fønnebø V. Whole systems research: moving forward. Focus Altern Complement Ther 2004;9(2):87-90 [1]
41. Avins A, Cherkin D, Sherman K, Goldberg H, Pressman A. Should we reconsider the routine use of placebo controls in clinical research? Trials 2012;13(44)
42. Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis 1967;20:637-48
43. Campbell M., Fitzpatrick R., Haines A., Kinmonth AL. Framework for design and evaluation of complex interventions. British Med J 2000;321:694-6
44. Foster N. Do RCTs provide the answer? The current state of play for musculoskeletal conditions and what is on the horizon. Clin Chiropr 2010;13(1):99-102
45. Creswell J, Plano Clark V. Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications 2007
46. Creswell JW, Plano Clark VL. The nature of mixed methods research. designing and conducting mixed methods research. 2nd ed. Thousand Oaks, CA: Sage; 2011:1-18
47. Borkan JM. Mixed methods studies: a foundation for primary care research. Ann Fam Med 2004;2(1):4-6
48. Morgan DL. Paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods. J Mix Methods Res 2007;1(1):48-76
49. Johnson RB, Onwuegbuzie AJ. Mixed methods research: a research paradigm whose time has come. Educ Res 2004;33(7):14-2.
50. Creswell J. Research design: qualitative, quantitative and mixed methods approaches. 2nd ed. Thousand Oaks, CA: Sage Publications 2003
51. Doyle L, Brady A-M, Byrne G. An overview of mixed methods research. J Res Nurs 2009;14(2):175-185
52. Kopansky-Giles D, Peranson J, Reeves S. P05.68. Teaching an interprofessional approach to the management of musculoskeletal problems in primary care - a pilot study. BMC Compl Alt Med 2012;12(Suppl 1):P428
53. Corbett M, Foster N, Ong BN. GP attitudes and self-reported behaviour in primary care consultations for low back pain. Fam Pract 2009;26(5):359-364
54. Ritenbaugh C, Nichter M, Nichter M, Kelly K, Sims C, Bell I, et al. Developing a patient-centered outcome measure for complementary and alternative medicine therapies I: defining content and format. BMC Compl Alternative Med 2011;11(1):135
55. Jones-Harris A. Are chiropractors in the uk primary healthcare or primary contact practitioners?: a mixed methods study. Chiropr Osteop 2010;18(1):28
56. Feinstein AR., Horwitz RI. Problems in the "evidence" of "evidence-based medicine". Am J Med 1997;103:529-35
57. Mykhalovskiy E., Weir L. The problem of evidence-based medicine: directions for social science. Soc Sci Med 2004;59:1059-69
58. McManus C. Engineering quality in health care. Qual Health Care 1996;5(3):127
59. Rolfe G. Complexity and uniqueness in nursing practice: Commentary on Richards and Hamers. Int J Nurs Stud 2009;46 1156-1158
60. Alcantara J. The chiropractic care of children: an open response to Chiropractic & Manual Therapy’s thematic series on pediatric chiropractic. J Pediatric Maternal Fam Health 2011
61. Armstrong MP., McDonough S., Baxter GD. Clinical guidelines versus clinical practice in the management of low back pain. int J Clin Pract 2003;57(1):9-13
62. Di Iorio D., Henley E., Doughty A. A survey of primary care physician practice patterns and adherence to acute low back problem guidelines. Arch Fam Med. 2000;9(10)
63. Scott NA., Moga C., Harstall C. Managing low back pain in the primary care setting: The know-do gap. Pain Res Manage 2010;15(6):392
64. Amorin-Woods LG, Beck RW, Parkin-Smith GF, Lougheed J, Bremner AP. Adherence to clinical practice guidelines among three primary contact professions: a best evidence synthesis of the literature for the management of acute and subacute low back pain. J Can Chiropr Assoc 2014;58(3):220-37
65. Green LW. Making research relevant: if it is an evidence-based practice, where's the practice-based evidence? Fam Pract 2008;25(suppl_1):i20-4
66. Parkin-Smith G, Amorin-Woods L, Davies S, Losco B, Adams J. Spinal pain: current understanding, trends, and the future of care. J Pain Res 2015;8:741-52
67. Cooper C. Transforming health care through the use of evidence-based practice. Nursing Excellence 1998;1(1)
68. Bishop PB, Quon JA, Fisher CG, Dvorak MFS. The Chiropractic Hospital-based Interventions Research Outcomes (CHIRO) Study: a randomized controlled trial on the effectiveness of clinical practice guidelines in the medical and chiropractic management of patients with acute mechanical low back pain. Spine J 2010;10(12):1055-64
69. COST13. European guidelines for the management of low back pain. Eur Spine J 2006;15((Suppl. 2):S125-S7)
70. Walker BF, French SD. Pain in the Neck: Many (Marginally Different) Treatment Choices. Ann Int Med 2012;156(1_Part_1):52-3
71. Dunning JR., Cleland JA., Waldrop M, Arnot C, Young I, Turner M, et al. Upper cervical and upper thoracic thrust manipulation versus non-thrust mobilization in patients with mechanical neck pain: a multi-center randomized clinical trial. J Orthop Sports Phys Ther 2012;42(1):5-18
72. Dunning JR, Butts R, Mourad F, Young I, Fernandez-de-las Peñas C, Hagins M, et al. Upper cervical and upper thoracic manipulation versus mobilization and exercise in patients with cervicogenic headache: a multi-center randomized clinical trial. BMC Musculoskel Dis 2016;17(1):1-12
73. Guyatt G., Sackett D., Cook D. User's guide to the medical literature: II. How to use an article about therapy. JAMA 1993:270
74. Sackett DL., Rosenberg WMC., Muir Gray JA., Haynes RB., Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ (Clinical research ed) 1996;312(7023):71-2
75. Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research. Eval Health Prof 2006;29(1):126-53
76. Eddy DM. Evidence-based medicine: a unified approach. Health Affairs 2005;24(1):9-17
77. Rubinstein SM, Terwee CB, de Boer MR, van Tulder MW. Is the methodological quality of trials on spinal manipulative therapy for low-back pain improving? Int J Osteopath Med 2012;15(2):37-52
78. Bonetti D, Eccles M, Johnston M, Steen M, Grimshaw J, Baker R, et al. Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial. Soc Sci Med 2005;60(9 Epub):2135-47
79. Shiell A., Hawe P., Gold L. Complex interventions or complex systems? Implications for health economic evaluation. BM. 2008;336:1281-3
80. Amorin-Woods L., Parkin-Smith G., Cascioli V., Kennedy D., editors. An exploratory (pilot) non-randomised controlled trial examining chiropractic care within a therapeutic community in terms of student and patient oriented outcomes.” The Palmerston-Murdoch Pilot Project; P-MPP”. “Making it happen: improving services through collaboration” AOD conference proceedings; 2012 (August 6-8); Perth, Australia
81. Amorin-Woods L, Parkin-Smith G, Cascioli V, Kennedy D. Manual care of residents with spinal pain within a therapeutic community. Ther Communities 2016;In Press.
82. Adams J, Steel A, Chang S, Sibbritt D. Helping address the national research and research capacity needs of Australian chiropractic: introducing the Australian Chiropractic Research Network (ACORN) project. Chiropr Man Therap 2015;23(12)
83. The Spine Journal 25 Hottest Articles January to December 2011 2012 (June). Available from:
84. Baruss I. Authentic Knowing: The convergence of science and spiritual aspiration. Lafayette, Ind: Purdue University Press; 1996
85. Campbell NC, Murray, E., Darbyshire, J., Emery, J., Farmer, A., Griffiths, F., Guthrie, B., Lester, H.,Wilson, P., Kinmouth, A.M., . Designing and evaluating complex interventions to improve health care. BMJ 2007;334:455-9
86. Craig P, Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., Petticrew, M., . Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655