Abstract
Hoarding disorder (HD) involves extreme difficulties discarding possessions and significant clutter in living areas. Although hoarding occurs worldwide, cross-cultural research remains in nascent stages, hampered in part by a lack of validated measures in non-English languages. We aimed to validate a Spanish translation of the Hoarding Rating Scale (HRS), a widely used measure of core HD symptoms. Our sample (N = 736) included participants responding in English (n = 548; 45.4% female; 7.9% Latinx) or Spanish (n = 188; 46.3% female; 79.9% Latinx) to questionnaires via Amazon’s Mechanical Turk. An item response theory (IRT) approach was used to test differential item functioning (DIF) of the English and Spanish HRS. We also examined convergent validity of each language version with other HD. Initial comparisons revealed that hoarding symptoms were elevated in the Spanish-speaking sample compared to the English-speaking sample. DIF tests flagged the clutter item for potential bias (McFadden’s β = .069), but closer examination revealed that the impact was negligible. The Spanish HRS was significantly linked with other hoarding measures (Saving Inventory-Revised: β = .497, p < .001; Obsessive–Compulsive Inventory-Revised–Hoarding Subscale: β = .329, p = .008), controlling for mood, anxiety, stress, and non-hoarding OCD symptoms. However, the Spanish HRS was not significantly associated with Clutter Image Rating scores. Findings supported the utility of the HRS to measure of HD symptoms in Spanish speakers, though cross-linguistic assessment of clutter and the applicability of clinical cutoffs with Spanish-speaking samples merits further study.
Similar content being viewed by others
Availability of Data and Material
Deidentified data are available upon request from the authors.
Code Availability
Model scripts are available on RPubs.
References
Abramowitz, J. S., & Deacon, B. J. (2006). Psychometric properties and construct validity of the Obsessive-Compulsive Inventory—Revised: Replication and extension with a clinical sample. Journal of Anxiety Disorders, 20(8), 1016–1035.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Publishing.
Arditte, K. A., Çek, D., Shaw, A. M., & Timpano, K. R. (2016). The importance of assessing clinical phenomena in Mechanical Turk research. Psychological Assessment, 28(6), 684. https://doi.org/10/f8x5v9
Ayers, C. R., Saxena, S., Golshan, S., & Wetherell, J. L. (2010). Age at onset and clinical features of late life compulsive hoarding. International Journal of Geriatric Psychiatry: A Journal of the Psychiatry of Late Life and Allied Sciences, 25(2), 142–149. https://doi.org/10/dsgcdc
Bados, A., Solanas, A., & Andrés, R. (2005). Psychometric properties of the Spanish version of depression, anxiety and stress scales (DASS). Psicothema, 17(4), 679–683.
Behrend, T. S., Sharek, D. J., Meade, A. W., & Wiebe, E. N. (2011). The viability of crowdsourcing for survey research. Behavior Research Methods, 43(3), 800. https://doi.org/10/dncq9f
Brown, C. A., & Weisman de Mamani, A. (2017). A comparison of psychiatric symptom severity in individuals assessed in their mother tongue versus an acquired language: A two-sample study of individuals with schizophrenia and a normative population. Professional Psychology: Research and Practice, 48(1), 1.
Cappelleri, J. C., Lundy, J. J., & Hays, R. D. (2014). Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures. Clinical Therapeutics, 36(5), 648–662. https://doi.org/10/652
Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). Lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of statistical software, 39(8), 1. https://doi.org/10/gf4tx2
Coles, M. E., Frost, R. O., Heimberg, R. G., & Steketee, G. (2003). Hoarding behaviors in a large college sample. Behaviour Research and Therapy, 41(2), 179–194.
Crane, P. K., Belle, G. van, & Larson, E. B. (2004). Test bias in a cognitive test: differential item functioning in the CASI. Statistics in Medicine, 23(2), 241–256. https://doi.org/10/bvmbwr
Crane, P. K., Gibbons, L. E., Ocepek-Welikson, K., Cook, K., Cella, D., Narasimhalu, K., et al. (2007). A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Quality of Life Research, 16(1), 69.
Crawford, J. R., & Henry, J. D. (2003). The Depression Anxiety Stress Scales (DASS): Normative data and latent structure in a large non-clinical sample. British Journal of Clinical Psychology, 42(2), 111–131.
Daza, P., Novy, D. M., Stanley, M. A., & Averill, P. (2002). The depression anxiety stress scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24(3), 195–205.
Fernández de la Cruz, L., Nordsletten, A. E., & Mataix-Cols, D. (2016). Ethnocultural aspects of hoarding disorder. Current Psychiatry Reviews, 12(2), 115–123.
Foa, E. B., Huppert, J. D., Leiberg, S., Langner, R., Kichic, R., Hajcak, G., & Salkovskis, P. M. (2002). The Obsessive-Compulsive Inventory: development and validation of a short version. Psychological Assessment, 14(4), 485. https://doi.org/10/dkmzv8
Fontenelle, I. S., Rangé, B. P., Prazeres, A. M., Borges, M. C., Versiani, M., & Fontenelle, L. F. (2010). The Brazilian Portuguese Version of the Saving Inventory–Revised: Internal Consistency, Test-Retest Reliability, and Validity of a Questionnaire to Assess Hoarding. Psychological Reports, 106(1), 279–296.
Fontenelle, L. F., & Grant, J. E. (2014). Hoarding disorder: a new diagnostic category in ICD-11? Brazilian Journal of Psychiatry, 36, 28–39.
Frost, R. O., Steketee, G., & Grisham, J. R. (2004). Measurement of compulsive hoarding: saving inventory-revised. Behaviour Research and Therapy, 42(10), 1163–1182.
Frost, R. O., Steketee, G., Tolin, D. F., & Renaud, S. (2008). Development and validation of the clutter image rating. Journal of Psychopathology and Behavioral Assessment, 30(3), 193-203.
Fullana, M. A., Tortella-Feliu, M., Caseras, X., Andión, Ó., Torrubia, R., & Mataix-Cols, D. (2005). Psychometric properties of the Spanish version of the Obsessive-Compulsive Inventory—Revised in a non-clinical sample. Journal of Anxiety Disorders, 19(8), 893–903.
Geisinger, K. F. (1994). Cross-cultural normative assessment: translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6(4), 304.
González, A. E. M., Piqueras, J. A., & Marzo, J. C. (2011). Validación del inventario de obsesiones y compulsiones revisado (OCI-R) para su uso en población adolescente española. Anales De Psicología/annals of Psychology, 27(3), 763–773.
Grisham, J. R., Frost, R. O., Steketee, G., Kim, H.-J., & Hood, S. (2006). Age of onset of compulsive hoarding. Journal of Anxiety Disorders, 20(5), 675–686. https://doi.org/10/b3snnd
Guttfreund, D. G. (1990). Effects of language usage on the emotional experience of Spanish-English and English-Spanish bilinguals. Journal of Consulting and Clinical Psychology, 58(5), 604.
Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology: A review and comparison of strategies. Journal of Cross-Cultural Psychology, 16(2), 131–152.
Lovibond, S. H., & Lovibond, P. F. (1996). Manual for the depression anxiety stress scales. Psychology Foundation of Australia.
Melli, G., Chiorri, C., Smurra, R., & Frost, R. O. (2013). Psychometric properties of the paper-and-pencil and online versions of the Italian Saving Inventory—Revised in nonclinical samples. International Journal of Cognitive Therapy, 6(1), 40–56.
Mueller, A., Crosby, R. D., Frost, R. O., Leidel, B., Bleich, S., Glaesmer, H., et al. (2009). Fragebogen zum zwanghaften Horten (FZH)—Validierung der deutschen Version des Saving Inventory-Revised. [German Compulsive Hoarding Inventory (FZH)—Evaluation of the German version of the Saving Inventory-Revised.]. Verhaltenstherapie, 19(4), 243–250. https://doi.org/10/dfjjsj
Noe-Bustamante, L., Lopez, M. H., & Krogstad, J. M. (2020). US Hispanic population surpassed 60 million in 2019, but growth has slowed. Fact Tank, News in the Numbers. Pew Research Center.
Nordsletten, A. E., Fernández de la Cruz, L., Aluco, E., Alonso, P., López-Solà, C., Menchón, J. M., et al. (2018). A transcultural study of hoarding disorder: Insights from the United Kingdom, Spain, Japan, and Brazil. Transcultural Psychiatry, 55(2), 261–285.
Postlethwaite, A., Kellett, S., & Mataix-Cols, D. (2019). Prevalence of hoarding disorder: A systematic review and meta-analysis. Journal of Affective Disorders, 256, 309–316.
Revelle, W., & Revelle, M. W. (2015). Package ‘psych.’ The Comprehensive R Archive Network, 337, 338.
Rodriguez, C. I., Herman, D., Alcon, J., Chen, S., Tannen, A., Essock, S., & Simpson, H. B. (2012). Prevalence of hoarding disorder in individuals at potential risk of eviction in New York City: a pilot study. The Journal of Nervous and Mental Disease, 200(1).
Saxena, S., Ayers, C. R., Maidment, K. M., Vapnik, T., Wetherell, J. L., & Bystritsky, A. (2011). Quality of life and functional impairment in compulsive hoarding. Journal of Psychiatric Research, 45(4), 475–480.
Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274.
Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models.
Timpano, K. R., Broman-Fulks, J. J., Glaesmer, H., Exner, C., Rief, W., Olatunji, B. O., et al. (2013). A taxometric exploration of the latent structure of hoarding. Psychological Assessment, 25(1), 194.
Timpano, K. R., Çek, D., Fu, Z.-F., Tang, T., Wang, J.-P., & Chasson, G. S. (2015). A consideration of hoarding disorder symptoms in China. Comprehensive Psychiatry, 57, 36–45.
Tolin, D. F., Frost, R. O., & Steketee, G. (2010). A brief interview for assessing compulsive hoarding: the Hoarding Rating Scale-Interview. Psychiatry Research, 178(1), 147–152.
Tolin, D. F., Frost, R. O., Steketee, G., & Fitch, K. E. (2008a). Family burden of compulsive hoarding: results of an internet survey. Behaviour Research and Therapy, 46(3), 334–344.
Tolin, D. F., Frost, R. O., Steketee, G., Gray, K. D., & Fitch, K. E. (2008b). The economic and social burden of compulsive hoarding. Psychiatry Research, 160(2), 200–211.
Tolin, D. F., Meunier, S. A., Frost, R. O., & Steketee, G. (2011). Hoarding among patients seeking treatment for anxiety disorders. Journal of Anxiety Disorders, 25(1), 43–48.
Tortella-Feliu, M., Fullana, M. A., Caseras, X., Andión, Ó., Torrubia, R., & Mataix-Cols, D. (2006). Spanish version of the Savings Inventory–Revised: adaptation, psychometric properties, and relationship to personality variables. Behavior Modification, 30(5), 693–712.
Tsuchiyagaito, A., Horiuchi, S., Igarashi, T., Kawanori, Y., Hirano, Y., Yabe, H., & Nakagawa, A. (2017). Factor structure, reliability, and validity of the Japanese version of the Hoarding Rating Scale-Self-Report (HRS-SR-J). Neuropsychiatric Disease and Treatment, 13, 1235.
Walker, C. M. (2011). What’s the DIF? Why differential item functioning analyses are an important part of instrument development and validation. Journal of Psychoeducational Assessment, 29(4), 364–376.
Funding
The authors did not receive financial support for the conduct of the research and/or preparation of the article.
Author information
Authors and Affiliations
Contributions
As first and senior authors, respectively, CS and KT took the lead in conceptualizing and writing the manuscript. CS, JM, EB, CR, and KT all played roles in the design and implementation of the research study. EB, CS, and KT were responsible for data collection, and CS conducted the primary statistical analyses in the manuscript. All authors played a role in the management and security of study data. All authors contributed to and have approved the final manuscript.
Corresponding author
Ethics declarations
Experiment Participants
All study procedures were approved by the University of Miami Institutional Review Board, and all participants provided informed consent.
Conflicts of Interest
Dr. Carolyn Rodriguez has served as a consultant for Allergan, BlackThorn Therapeutics, Rugen Therapeutics, and Epiodyne, receives research grant support from Biohaven Inc., and a stipend from APA Publishing for her role as Deputy Editor at The American Journal of Psychiatry. Caitlin A. Stamatis, Jordana Muroff, Elizabeth S. Bocanegra, and Kiara R. Timpano declare that they have no financial or other relationships relevant to the subject of this manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Appendix
Appendix
Escala De La Acumulación (EDLA)
Las siguientes 5 preguntas son sobre su experiencia con la acumulación compulsiva de objetos. Por favor, responda las preguntas con respecto a su experiencia en la SEMANA PASADA.
-
1.
Debido al desorden (desorganización y amontonamiento) de sus cosas o a la cantidad de cosas que tiene, ¿qué tan difícil es para usted usar las habitaciones en su casa?
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
Nada difícil | Levemente difícil | Moderadamente difícil | Muy difícil | Extremadamente difícil |
-
2.
¿Qué tan difícil se le hace botar (deshacerse, reciclar, vender, regalar) cosas comunes que otras personas botarían?
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
Nada difícil | Levemente difícil | Moderadamente difícil | Muy difícil | Extremadamente difícil |
-
3.
¿Actualmente, qué tanto problema tiene recolectando cosas gratuitas o comprando más cosas de las que necesita o puede usar o pagar? [Use la escala a continuación.]
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
Ningún problema | Problema leve | Problema moderado | Mucho problema | Problema extremo |
-
4.
¿Hasta qué punto tiene usted angustia debido al reguero (desorden y amontonamiento) de sus cosas, o a la dificultad de botar (desechar) cosas o al problema de comprar o adquirir cosas?
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
Nada | Angustia leve | Angustia moderada | Mucha angustia | Angustia extrema |
-
5.
¿Hasta qué punto se afecta su vida (rutina diaria, trabajo/escuela, actividades sociales, actividades familiares, dificultades económicas) debido al reguero (desorden y amontonamiento) de sus cosas, a la dificultad para botarlas (desecharlas) o al problema de comprar o adquirir cosas?
0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
---|---|---|---|---|---|---|---|---|
Nada | Levemente afectada | Moderadamente afectada | Muy afectada | Extremadamente afectada |
Rights and permissions
About this article
Cite this article
Stamatis, C.A., Muroff, J., Bocanegra, E.S. et al. A Spanish Translation of the Hoarding Rating Scale: Differential Item Functioning and Convergent Validity. J Psychopathol Behav Assess 43, 946–959 (2021). https://doi.org/10.1007/s10862-021-09894-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-021-09894-z