Scaling up: A brief look at the latest tool to assess addictive gaming

To date, there has been a lack of agreement among researchers as to the precise name and definition of video game addiction (both online and offline). However, there is a general consensus that excessive gaming can lead to a wide range of physical and psychological problems, and therefore necessary to explore the nature and the scale of the phenomenon. In doing so, it is important to use psychometrically validated measurement tools. Unfortunately, there is lack of these in the literature so far. Along with some colleagues (led by Dr. Daniel King), we recently published a paper examining all the instruments that have been used to assess problematic video gaming in the journal Clinical Psychology Review.

Our paper noted that pathological video-gaming, or its proposed DSM-V classification of “Internet Use Disorder”, is of increasing interest to scholars and practitioners in allied health disciplines. Our systematic review was designed to evaluate the standards in pathological video-gaming instrumentation and guidelines for sound psychometric assessment. We assessed a total of 63 quantitative studies, including eighteen instruments (representing 58,415 participants). Our findings indicated that the instruments were generally characterized as inconsistent. The strengths of available measures included: (i) short length and ease of scoring, (ii) excellent internal consistency and convergent validity, and (iii) potentially adequate data for development of standardized norms for adolescent populations. However, the key limitations included: (a) inconsistent coverage of core addiction indicators, (b) varying cut-off scores to indicate clinical status, (c) a lack of a temporal dimension, (d) untested or inconsistent dimensionality, and (e) inadequate data on predictive validity and inter-rater reliability. An emerging consensus suggested that pathological video-gaming is commonly defined by (1) withdrawal, (2) loss of control, and (3) conflict.

Most of the tools in current use have been modified from other questionnaires without their reliability and validity being tested. This includes those based on internet addiction (e.g., Kimberley Young’s Internet Addiction Test), pathological gambling (using the DSM–IV criteria), or behavioural addictions. An additional problem is that many of the measures focus exclusively on Massively Multiplayer Online Role Playing Game (MMORPG) users. In order to cover the whole range of online gamers, I recently helped co-develop an empirically based questionnaire consisting of 18 items called the Problematic Online Gaming Questionnaire (POGQ) that we published in the journal PLoS ONE.

In a recent 2011 study, some of my Hungarian colleagues (led by Dr. Koronczai) claimed in the journal Cyberpsychology, Behavior and Social Networking that a suitable measure should fit the following six criteria. It should have: (i) comprehensiveness (i.e., examining more, possibly all, aspects of problematic online gaming); (ii) brevity (in order to assess the more impulsive population as well and to facilitate incorporation into time-limited surveys); (iii) reliability and validity for different methods of data collection (e.g., online, paper-and-pencil self-rating, face-to-face); (iv) reliability and validity for different age groups (e.g., adolescents and adults); (v) cross-cultural reliability and validity; (vi) been validated on clinical samples. The measure should also serve as a basis for defining cutoff scores for dependence.

The POGQ is a short comprehensive measure and therefore fits to the first two requirements. It was also found to be a psychometrically adequate measure in a large convenience sample of adult online gamers. However, there is great need for a measure that is also suitable for survey type research in an offline data collection setting, and is reliable and valid for adolescents. Therefore, we modified the original POGQ to a 12-item version and applied it to an offline adolescent sample using pen-and-pencil data collection method (and published the findings in the journal Cyberpsychology, Behavior and Social Networking). This way both the third and the fourth points of the six criteria above were fulfilled.

The aim of or most recent study was twofold. The first goal was to explore the psychometric properties of the POGQ on a nationally representative adolescent sample as until recently it had only been used on adult gamer samples. The second goal was to assess the prevalence of problematic online gaming in a nationwide adolescent sample, as there have been only two nationally representative studies carried out on adolescents in the US and Germany.

The results of or study showed that the 12-item POGQ-SF had appropriate psychometric properties according to the statistical analysis performed on a nationally representative sample of adolescents. The analysis showed that 8.2% of gamers (4.6% of the whole sample) belonged to the at-risk group. We also found an additional 13.3% of adolescents (23.9% of gamers) showed symptoms of problematic online gaming above the average. Gamers belonging to the at-risk class were more likely to be male, more likely to play for five or more hours a day, have lower grade point average, have lower self-esteem, and higher depression score than gamers belonging to the other two classes. All these results are in line with findings of other studies confirming the validity of the measurement tool.

Despite the robustness of the study, an important limitation was that it was only carried out among Hungarian adolescents. For generalizability it must be applied and psychometrically tested on cross-cultural samples as well (see the aforementioned Criterion 5). It is also a future goal to confirm the POGQ on clinical samples (Criterion 6). This would allow all the six criteria requirements presented in the introduction to be met. The current POGQ is both short (Criterion 2) and comprehensive (Criterion 1), and assesses problematic online gaming in different age groups (Criterion 4) with different data collection methods (Criterion 3). We hope that the POGQ will facilitate future research and will serve as an adequate tool for assessing problematic online gaming.

Dr Mark Griffiths, Professor of Gambling Studies, International Gaming Research Unit, Nottingham Trent University, Nottingham, UK

Further reading

Demetrovics, Z., Urbán, R., Nagygyörgy, K., Farkas, J., Griffiths, M.D., Pápay, O. & Oláh, A. (2012). The development of the Problematic Online Gaming Questionnaire (POGQ). PLoS ONE, 7(5): e36417. doi:10.1371/journal.pone.0036417.

Gentile, D. (2009). Pathological video-game use among youth ages 8 to 18: A national study. Psychological Science, 20, 594-602.

Gentile, D.A., Choo, H., Liau, A., et al. (2011). Pathological video game use among youths: A two-year longitudinal study. Pediatrics, 127, E319-E329.

King, D.L., Haagsma, M.C.^, Delfabbro, P.H.,Gradisar, M.S.^, Griffiths, M.D. (2013). Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clinical Psychology Review, 33, 331-342.

Koronczai, B., Urban, R., Kokonyei, G., et al. (2011). Confirmation of the three-factor model of problematic internet use on off-line adolescent and adult samples. Cyberpsychology, Behavior and Social Networking, 14, 657–664.

Kuss, D.J. & Griffiths, M.D. (2012). Online gaming addiction in children and adolescents: A review of empirical reearch. Journal of Behavioral Addictions, 1, 3-22.

Pápay, O., Urbán, R., Griffiths, M.D., Nagygyörgy, K., Farkas, J. Kökönyei, G., Felvinczi, K., Oláh, A., Elekes, Z., Demetrovics, Z. (2013). Psychometric properties of the Problematic Online Gaming Questionnaire Short-Form (POGQ-SF) and prevalence of problematic online gaming in a national sample of adolescents. Cyberpsychology, Behavior, and Social Networking, doi:10.1089/cyber.2012.0484.

Rehbein, F., Kleimann, M, & Mossle, T. (2010). Prevalence and risk factors of video game dependency in adolescence: results of a German nationwide survey. CyberPsychology, Behavior and Social Networking, 13, 269–277.