The words and the we’s: When is a new addiction scale not a new addiction scale?
Posted by drmarkgriffiths
“The words you use should be your own/Don’t plagiarize or take on loans/There’s always someone, somewhere/With a big nose, who knows” (Lyrics written by Morrissey from ‘Cemetry Gates’ (sic) by The Smiths)
Over the last few decades, research into ‘shopping addiction’ and ‘compulsive buying’ has greatly increased. In 2015, I along with my colleagues, developed and subsequently published (in the journal Frontiers in Psychology) a new scale to assess shopping addiction – the 7-item Bergen Shopping Addiction Scale (BSAS) which I wrote about in one of my previous blogs.
We noted in our Frontiers in Psychology paper that two scales had already been developed in the 2000s (i.e., one by Dr. George Christo and colleagues in 2003, and one by Dr. Nancy Ridgway and colleagues in 2008 – see ‘Further reading’ below), but that neither of these two instruments approached problematic shopping behaviour as an addiction in terms of core addiction criteria that are often used in the behavioural addiction field including salience, mood modification, tolerance, withdrawal, conflict, relapse, and problems. We also made the point that new Internet-related technologies have now greatly facilitated the emergence of problematic shopping behaviour because of factors such as accessibility, affordability, anonymity, convenience, and disinhibition, and that there was a need for a psychometrically robust instrument that assessed problematic shopping across all platforms (i.e., both online and offline). We concluded that the BSAS has good psychometrics, structure, content, convergent validity, and discriminative validity, and that researchers should consider using it in epidemiological studies and treatment settings concerning shopping addiction.
More recently, Srikant Amrut Manchiraju, Sadachar and Jessica Ridgway developed something they called the Compulsive Online Shopping Scale (COSS) in the International Journal of Mental Health and Addiction (IJMHA). Given that we had just developed a new shopping addiction scale that covered shopping across all media, we were interested to read about the new scale. The scale was a 28-item scale and was based on the 28 items included in the first step of BSAS development (i.e., initial 28-item pool). As the authors noted:
“First, to measure compulsive online shopping, we adopted the Bergen Shopping Addiction Scale (BSAS; Andreassen, 2015). The BSAS developed by Andreassen et al. (2015), was adapted for this study because it meets the addiction criteria (e.g., salience, mood modification, etc.) established in the DSM-5. In total, 28 items from the BSAS were modified to reflect compulsive online shopping. For example, the original item – ‘Shopping/buying is the most important thing in my life’ was modified as ‘Online shopping/buying is the most important thing in my life’… It is important to note that we are proposing a new behavioral addiction scale, specifically compulsive online shopping … In conclusion, the scale developed in this study demonstrated strong psychometric, structure, convergent, and discriminant validity, which is consistent with Andreassen et al.’s (2015) findings”.
Apart from the addition of the word ‘online’ to every item, all initial 28 items of the BSAS were used identically in the COSS. Therefore, I sought the opinion of several research colleagues about the ‘new’ scale. Nearly all were very surprised that an almost identical scale had been published. Some even questioned whether such wholescale use might constitute plagiarism (particularly as none of the developers of the COSS sought permission to adapt our scale).
According to the plagiarism.org website, several forms of plagiarism have been described including: “Copying so many words or ideas from a source that it makes up the majority of your work, whether you give credit or not” (p.1). Given the word-for-word reproduction of the 28 item–pool, an argument could be made that the COSS plagiarizes the BSAS, even though the authors acknowledge the source of their scale items. According to Katrina Korb’s 2012 article on adopting or adapting psychometric instruments:
“Adapting an instrument requires more substantial changes than adopting an instrument. In this situation, the researcher follows the general design of another instrument but adds items, removes items, and/or substantially changes the content of each item. Because adapting an instrument is similar to developing a new instrument, it is important that a researcher understands the key principles of developing an instrument…When adapting an instrument, the researcher should report the same information in the Instruments section as when adopting the instrument, but should also include what changes were made to the instrument and why” (p.1).
Dr. Manchiraju and his colleagues didn’t add or remove any of the original seven items, and did not substantially change the content of any of the 28 items on which the BSAS was based. They simply added the word ‘online’ to each existing item. Given that the BSAS was specifically developed to take into account the different ways in which people now shop and to include both online and offline shopping, there doesn’t seem to be a good rationale for developing an online version of the BSAS. Even if there was a good rationale, the scale could have made reference to the Bergen Shopping Addiction Scale in the name of the ‘new’ instrument. In a 2005 book chapter ‘Selected Ethical Issues Relevant to Test Adaptations’ by Dr. Thomas Oakland (2005), he noted the following in relation to plagiarism and psychometric test development:
“Psychologists do not present portions of another’s work or data as their own, even if the other work or data source is cited … Plagiarism occurs commonly in test adaptation work (Oakland & Hu, 1991), especially when a test is adapted without the approval of its authors and publisher. Those who adapt a test by utilizing items from other tests without the approval of authors and publishers are likely to be violating ethical standards. This practice should not be condoned. Furthermore, this practice may violate laws in those countries that provide copyright protection to intellectual property. In terms of scale development, a measure that has the same original items with only one word added to each item (which only adds information on the context but does not change the meaning of the item) does not really constitute a new scale. They would find it really hard to demonstrate discriminant validity between the two measures”.
Again, according to Oakland’s description of plagiarism specifically in relation to the development of psychometric tests (rather than plagiarism more generally), the COSS appears to have plagiarized the BSAS particularly as Oakland makes specific reference to the adding of one word to each item (“In terms of scale development, a measure that has the same original items with only one word added to each item … does not really constitute a new scale”).
Still, it is important to point that I have no reason to think that this use of the BSAS was carried out maliciously. Indeed, it may well be that the only wrongdoing was lack of familiarity with the conventions of psychometric scale development. It may be that the authors took one line in our original Frontiers in Psychology paper too literally (“the BSAS may be freely used by researchers in their future studies in this field”). However, the purpose of this sentence was to give fellow researchers permission to use the validated scale in their own studies and to avoid the inconvenience of having to request permission to use the BSAS and then waiting for an answer. Another important aspect here is that the BSAS (which may be freely used) consists of seven items only, not 28. The seven BSAS items were extracted from an initial item pool in accordance with our intent to create a brief shopping addiction scale. Consequently, there exists only one version of BSAS, the 7-item version. Here, Dr. Manchiraju and his colleagues seem to have misinterpreted this when referring to a 28-item BSAS.
(Please note: This blog is adapted using material from the following paper: Griffiths, M.D., Andreassen, C.S., Pallesen, S., Bilder, R.M., Torsheim, T. Aboujaoude, E.N. (2016). When is a new scale not a new scale? The case of the Bergen Shopping Addiction Scale and the Compulsive Online Shopping Scale. International Journal of Mental Health and Addiction, 14, 1107-1110).
Dr. Mark Griffiths, Professor of Behavioural Addiction, International Gaming Research Unit, Nottingham Trent University, Nottingham, UK
Aboujaoude, E. (2014). Compulsive buying disorder: a review and update. Current Pharmaceutical Design, 20, 4021–4025.
Andreassen, C. S., Griffiths, M. D., Pallesen, S., Bilder, R. M., Torsheim, T., & Aboujaoude, E. (2015). The Bergen Shopping Addiction Scale: reliability and validity of a brief screening test. Frontiers in Psychology, 6, 1374. doi: 10.3389/fpsyg.2015.01374
Christo, G., Jones, S., Haylett, S., Stephenson, G., Lefever, R. M., & Lefever, R. (2003). The shorter PROMIS questionnaire: further validation of a tool for simultaneous assessment of multiple addictive behaviors. Addictive Behaviors, 28, 225–248.
Griffiths, M.D. (2005). A ‘components’ model of addiction within a biopsychosocial framework. Journal of Substance Use, 10, 191-197.
Griffiths, M.D., Andreassen, C.S., Pallesen, S., Bilder, R.M., Torsheim, T. Aboujaoude, E.N. (2016). When is a new scale not a new scale? The case of the Bergen Shopping Addiction Scale and the Compulsive Online Shopping Scale. International Journal of Mental Health and Addiction, 14, 1107-1110.
Korb, K. (2012). Adopting or adapting an instrument. Retrieved September 12, 2016, from: http://korbedpsych.com/R09aAdopt.html
Manchiraju, S., Sadachar, A., & Ridgway, J. L. (2016). The Compulsive Online Shopping Scale (COSS): Development and Validation Using Panel Data. International Journal of Mental Health and Addiction, 1-15. doi: 10.1007/s11469-016-9662-6.
Maraz, A., Eisinger, A., Hende, Urbán, R., Paksi, B., Kun, B., Kökönyei, G., Griffiths, M.D. & Demetrovics, Z. (2015). Measuring compulsive buying behaviour: Psychometric validity of three different scales and prevalence in the general population and in shopping centres. Psychiatry Research, 225, 326–334.
Maraz, A., Griffiths, M. D., & Demetrovics, Z. (2016). The prevalence of compulsive buying in non-clinical populations: A systematic review and meta-analysis. Addiction, 111, 408-419.
Oakland, T. (2005). Selected ethical issues relevant to test adaptations. In Hambleton, R., Spielberger, C. & Meranda, P. (Eds.). Adapting educational and psychological tests for cross-cultural assessment (pp. 65-92). Mahwah, NY: Erlbaum Press.
Oakland, T., & Hu, S. (1991). Professionals who administer tests with children and youth: An international survey. Journal of Psychoeducational Assessment, 9(2), 108-120.
Plagiarism.org (2016). What is plagiarism? Retrieved September 12, 2016, from: http://www.plagiarism.org/plagiarism-101/what-is-plagiarism
Ridgway, N., Kukar-Kinney, M., & Monroe, K. (2008). An expanded conceptualization and a new measure of compulsive buying. Journal of Consumer Research, 35, 622–639.
Weinstein, A., Maraz, A., Griffiths, M.D., Lejoyeux, M. & Demetrovics, Z. (2016). Shopping addiction and compulsive buying: Features and characteristics of addiction. In V. Preedy (Ed.), The Neuropathology Of Drug Addictions And Substance Misuse (Vol. 3). (pp. 993-1008). London: Academic Press.
About drmarkgriffithsProfessor MARK GRIFFITHS, BSc, PhD, CPsychol, PGDipHE, FBPsS, FRSA, AcSS. Dr. Mark Griffiths is a Chartered Psychologist and Distinguished Professor of Behavioural Addiction at the Nottingham Trent University, and Director of the International Gaming Research Unit. He is internationally known for his work into gambling and gaming addictions and has won many awards including the American 1994 John Rosecrance Research Prize for “outstanding scholarly contributions to the field of gambling research”, the 1998 European CELEJ Prize for best paper on gambling, the 2003 Canadian International Excellence Award for “outstanding contributions to the prevention of problem gambling and the practice of responsible gambling” and a North American 2006 Lifetime Achievement Award For Contributions To The Field Of Youth Gambling “in recognition of his dedication, leadership, and pioneering contributions to the field of youth gambling”. In 2013, he was given the Lifetime Research Award from the US National Council on Problem Gambling. He has published over 800 research papers, five books, over 150 book chapters, and over 1500 other articles. He has served on numerous national and international committees (e.g. BPS Council, BPS Social Psychology Section, Society for the Study of Gambling, Gamblers Anonymous General Services Board, National Council on Gambling etc.) and is a former National Chair of Gamcare. He also does a lot of freelance journalism and has appeared on over 3500 radio and television programmes since 1988. In 2004 he was awarded the Joseph Lister Prize for Social Sciences by the British Association for the Advancement of Science for being one of the UK’s “outstanding scientific communicators”. His awards also include the 2006 Excellence in the Teaching of Psychology Award by the British Psychological Society and the British Psychological Society Fellowship Award for “exceptional contributions to psychology”.
Posted on February 5, 2017, in Addiction, Case Studies, Compulsion, Gender differences, I.T., Obsession, Psychiatry, Psychology and tagged Behavioural addiction, Cemetry Gates (song), Compulsive Buying, Compulsive shopping, Morrissey, Plagiarism, Psychometric scale construction, Psychometric scales, Shopaholism, Shopping addiction, The Smiths. Bookmark the permalink. Leave a comment.