Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos

El trolling mediante las nuevas tecnologías es un comportamiento disruptivo, molesto y destructivo, con una gran relevancia psicosocial, legal y jurídica. No existen estudios en la literatura científica que hayan examinado las propiedades de un instrumento para evaluarlo. El propósito del presente estudio fue observar las propiedades del Cuestionario Revisado de Trolling de Buckels et al. en una muestra de adultos argentinos. Se constituyó una muestra intencional de 837 participantes argentinos (edad promedio=28,4 años; 61% mujeres). Completaron el Cuestionario Revisado de Trolling de Buckels et al., un cuestionario de personalidad oscura (maquiavelismo, psicopatía y narcicismo), de adicción a internet, de cyberstalking y preguntas sociodem... Ver más

Guardado en:

0123-9155

1909-9711

26

2023-05-29

101

113

Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-CompartirIgual 4.0.

info:eu-repo/semantics/openAccess

http://purl.org/coar/access_right/c_abf2

Acta Colombiana de Psicología - 2023

id 57c033d41661b41ce39d4e5e3744d5fc
record_format ojs
institution UNIVERSIDAD CATÓLICA DE COLOMBIA
thumbnail https://nuevo.metarevistas.org/UNIVERSIDADCATOLICADECOLOMBIA/logo.png
country_str Colombia
collection Acta Colombiana de Psicología
title Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
spellingShingle Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
Resett, Santiago
González Caino, Pablo Christian
title_short Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
title_full Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
title_fullStr Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
title_full_unstemmed Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
title_sort propiedades psicométricas del cuestionario revisado de trolling en adultos argentinos
title_eng Psychometric Properties of the Revised Trolling Questionnaire in Argentinean Adults
description El trolling mediante las nuevas tecnologías es un comportamiento disruptivo, molesto y destructivo, con una gran relevancia psicosocial, legal y jurídica. No existen estudios en la literatura científica que hayan examinado las propiedades de un instrumento para evaluarlo. El propósito del presente estudio fue observar las propiedades del Cuestionario Revisado de Trolling de Buckels et al. en una muestra de adultos argentinos. Se constituyó una muestra intencional de 837 participantes argentinos (edad promedio=28,4 años; 61% mujeres). Completaron el Cuestionario Revisado de Trolling de Buckels et al., un cuestionario de personalidad oscura (maquiavelismo, psicopatía y narcicismo), de adicción a internet, de cyberstalking y preguntas sociodemográficas. Un análisis factorial exploratorio como confirmatorio indicó una correcta estructura unifactorial. La consistencia interna fue adecuada: α de Cronbach = .80 y Omega coefficient (ω) = .81. La validez concurrente del cuestionario se observó con el cyberstalking, la personalidad oscura (maquiavelismo, narcisismo y psicopatía) y el uso problemático de Internet. El maquiavelismo y la disfuncionalidad eran las variables más asociadas al trolling. De este modo, la versión al español argentino de dicho test mostró evidencia de adecuadas propiedades psicométricas.
description_eng Trolling with new technologies is a disruptive, deceptive, and destructive behavior, with great psychosocial, legal, and economical relevance. However, there are no studies in the scientific literature that have examined the properties of questionnaires to assess them. Therefore, the purpose of the present study was to observe the psychometric properties of the Revised Trolling Questionnaire by Buckels et al.’s in a sample of Argentinean adults. An intentional sample of 837 participants from Argentina (mean age = 28.4 years; 61% female) was formed. They completed the Buckels et al.’s Revised Trolling Questionnaire, measures of dark personality, Internet addiction, cyberstalking, and socio-demographic questions. Exploratory and confirmatory factorial analyses indicated a one-factor structure with correct fit statistics. Internal consistency was adequate: Cronbach’s α = .80 and Omega coefficient (ω) = .81. Concurrent validity of the trolling questionnaire was observed with dark personality (Machiavellianism, narcissism and psychopathy), problematic Internet use (symptomatology and disfunctionality), and cyberstalking. Machiavellianism and disfunctionality were the most significant variables associated with trolling. Therefore, the Argentinean Spanish version of this test showed evidence of adequate psychometric properties.
author Resett, Santiago
González Caino, Pablo Christian
author_facet Resett, Santiago
González Caino, Pablo Christian
citationvolume 26
citationissue 2
citationedition Núm. 2 , Año 2023 :Acta Colombiana de Psicología
publisher Universidad Católica de Colombia
ispartofjournal Acta Colombiana de Psicología
source https://actacolombianapsicologia.ucatolica.edu.co/article/view/4682
language Inglés
format Article
rights Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-CompartirIgual 4.0.
info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by-nc-sa/4.0
http://purl.org/coar/access_right/c_abf2
Acta Colombiana de Psicología - 2023
references_eng Akhtar, S., & Morrison, C. (2019). The prevalence and impact of online trolling of UK members of parliament. Computers in Human Behavior, 99, 322-327. https://doi. org/10.1016/j.chb.2019.05.015 Aydın, A., Arda, B., Güneş. B., & Erbaş, O. (2021). Psychopathology of Cyberbullying and Internet Trolling. Journal of Experimental and Basic Medical Sciences, 2(3), 380-391. https://www.jebms.org/full-text/79 Bentler, P. M. (1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112(3), 400-404. Boomsma, A., & Hoogland, J. J. (2001). The Robustness of LISREL Modeling Revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural Equation Models: Present and Future. A Festschrift in Honor of Karl Jöreskog (pp. 139-168). Scientific Software International. Brown, T. A. (2006). Confirmatory factor analysis for applied research. Guilford Press. Buckels, E. E., Trapnell, P. & Andjelovic, T., & Paulhus, D. L. (2018). Internet Trolling and Everyday Sadism: Parallel Effects on Pain Perception and Moral Judgment. Journal of Personality, 87(2), 328-340. https://doi. org/10.1111/jopy.12393 Buckels, E., Trapnell, P., & Paulhus, D. (2014). Trolls just want to have fun. Personality and Individual Differences, 67, 97-102. https://doi.org/10.1016/j.paid.2014.01.016 Byrne, B. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Routledge. Byrne, B. (2012). Structural equation modeling with MPLUS: Basic concepts, applications, and programming. Routledge. Case, C., & King, D. (2018). Internet Trolling Victimization: An Empirical Examination of Incidence in Undergraduate Business Students. Research in Higher Education Journal, 34, 32-40. https://www.aabri.com/ manuscripts/172726.pdf Chou, C.-P., & Bentler, P. M. (1995). Estimation and tests in structural equation modeling. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 37–55). Sage. Cook, C., Corcoran, L., Mc Guckin, C., & Prentice, G. (2015). Cyberbullying or Cyber Aggression? A Review of Existing Definitions of Cyber-Based Peer-to-Peer Aggression. Societies, 5(2), 245-255. https://doi. org/10.3390/soc5020245 Craker, N., & March, E. (2016). The dark side of Facebook®: The Dark Tetrad, negative social potency, and trolling behaviours. Personality and Individual Differences, 102, 79-84. https://doi.org/10.1016/j.paid.2016.06.043 Cupani, M. (2012). Análisis de Ecuaciones Estructurales: conceptos, etapas de desarrollo y un ejemplo de aplicación. Tesis, 1,186-199. https://rdu.unc.edu.ar/bitstream/ handle/11086/22039/16.pdf?sequence=1&isAllowed=y Curran, P. J., West, S. G, & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29. https://web.archive. org/web/20170808040148id_/http://hbanaszak.mjr. uw.edu.pl/TempTxt/CurranEtAl_1996_RobustnessOfTe stStatistToNonormalityInCFA.pdf DeVellis, R. F. (2012). Scale Development: Theory and Applications. Sage. Dynel, M. (2016). “Trolling is not stupid”: Internet trolling as the art of deception serving entertainment. Intercultural Pragmatics, 13(3), 353-381. https://doi.org/10.1515/ ip-2016-0015 Fichman, P., & Sanfilippo, M. R. (2016). Online trolling and its perpetrators: Under the cyberbridge. Rowman & Littlefield. Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics And Sex and Drugs and Rock “N” Roll. Sage. Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Quantitative Psychology and Measurement, 3(55), Article e55. https://doi.org/10.3389/fpsyg.2012.00055 Furian, L., & March, E. (2023). Trolling, the Dark Tetrad, and the four-facet spectrum of narcissism. Personality and Individual Differences, 208, Article e112169. https:// doi.org/10.1016/j.paid.2023.112169 Furnham, A., Richards, S. C. & Paulhus, D. L. (2013). The Dark Triad of personality: A 10 year review. Social and Personality Psychology Compass, 7(3), 199-216. https:// doi.org/10.1111/spc3.12018 Gani, A. (2016, February 9). Internet trolling: quarter of teenagers suffered online abuse last year. The Guardian. https://www.theguardian.com/uk-news/2016/feb/09/ internet-trolling-teenagers-online-abuse-hate-cyberbullying González Caino, P., & Resett, S. (2020). Predicción del Trolling desde el sadismo y la adicción a Internet en jóvenes adultos de Buenos Aires. Interacciones, 6(3), Article e178. http://dx.doi.org/10.24016/2020.v6n3.178 Hair, J. F., Black, W. C., Babin, B.J., & Anderson, R.E. (2010). Multivariate Data Analysis (7th Edition). Pearson. Hardaker, C. (2010). Trolling in asynchronous computer mediated communication: From user discussions to academic definitions. Journal of Politeness Research, 6(2), 215-242. https://doi.org/10.1515/jplr.2010.011 Hardaker, C. (2013). “Uh... not to be nitpicky, but... the past tense of drag is dragged, not drug”: An overview of trolling strategies. Journal of Language Aggression and Conflict, 1(1), 58–86. https://doi.org/10.1075/ jlac.1.1.04har Hartung, C., Little, C., S., Allen, E., K., & Page, M. (2011). A psychometric comparison of two self-report measures of bullying and victimization: Differences by sex and grade. School Mental Health, 3, 44-57. https://doi. org/10.1007/s12310-010-9046-1 Herring, S.C., Job-Sluder, K., Scheckler, R., & Barab, S. (2002). Searching for Safety Online: Managing “Trolling” in a Feminist Forum. The Information Society, 18(5), 371-384. https://doi.org/10.1080/01972240290108186 Hidalgo-Fuentes, S. (2023). La relación de los factores de personalidad y la conducción agresiva: los Cinco Grandes y la Tríada Oscura. Acta Colombiana de Psicología, 26(1), 188-199. https://www.doi.org/10.14718/ACP.2023.26. 1.12 Hilvert-Bruce, Z., & Neill, J. (2020). I’m just trolling: The role of normative beliefs in aggressive behaviour in online gaming. Computers in Human Behavior, 102, 303- 311. https://doi.org/10.1016/j.chb.2019.09.003 Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118 Jones, D. & Paulhus, D. (2010). Different Provocations Trigger Aggression in Narcissists and Psychopaths. Social Psychological and Personality Science, 1(1), 12- 18. https://doi.org/10.1177/1948550609347591 Jones, D., & Paulhus, D. (2014). Introducing the short Dark Triad (SD3): A brief measure of dark personality traits. Assessment, 21(1), 28–41. https://doi. org/10.1177/1073191113514105 Kaplan, R. M., & Saccuzzo D. P. (2006). Pruebas psicológicas: principios, aplicaciones y temas. (6th edition). International Thomson. Kline, R. (2015). Principles and practice of structural equation modeling (4th edition). Guilford. Komaç, G., & Çağıltay, K. (2019, 6-7 November). An Overview of Trolling Behavior in Online Spaces and Gaming Context. Paper presented at 1st International Informatics and Software Engineering Conference, Ankara, Turkey. https://doi.org/10.1109/ UBMYK48245.2019.8965625 Kurniasanti, K.S, Asanti, P., Ismail, R.I., Nasrun. M.W.S., & Wiguna, T. (2019). Internet addiction: a new addiction? Medical Journal of Indonesia, 28(1), 82-91. https://mji. ui.ac.id/journal/index.php/mji/article/view/2752 Lam-Figueroa, N., Contreras-Pulache, H., Mori-Quispe, E., Nizama-Valladolid, M., Gutiérrez, C., HinostrozaCamposano, W., Torrejón Reyes, E., HinostrozaCamposano, R., Coaquira-Condori, E., & HinostrozaCamposano, W. (2011). Adicción a internet: Desarrollo y validación de un instrumento en escolares adolescentes de Lima, Perú. Revista Peruana de Medicina Experimental y Salud Pública, 28(3), 462-469. https:// doi.org/10.17843/rpmesp.2011.283.524 Lenhart, A., Ybarra, M., & Price-Feeney, M. (2016). Nonconsensual Image Sharing: One In 25 Americans Has Been A Victim Of “Revenge Porn”. Data & Society Research Institute. https://datasociety.net/pubs/oh/ Nonconsensual_Image_Sharing_2016.pdf Leone, M. (2017). The art of trolling. Unpublished manuscript, University of Turin. Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. http:// dx.doi.org/10.6018/analesps.30.3.199361 Loewenthal, K. M. (2001). An introduction to psychological tests and scales (2nd edition). Psychology Press. Lopes, B., & Yu, H. (2017). Who do you troll and Why: An investigation into the relationship between the Dark Triad Personalities and online trolling behaviours towards popular and less popular Facebook profiles. Computers in Human Behavior, 77, 69-76. https://doi.org/10.1016/j. chb.2017.08.036 March, E. (2019). Psychopathy, sadism, empathy, and the motivation to cause harm: New evidence confirms malevolent nature of the internet troll. Personality and Individual Differences, 141, 133-137. https://doi. org/10.1016/j.paid.2019.01.001 March, E., Grieve, R., Marrington, J., & Jonason, P. K. (2017). Trolling on Tinder® (and other dating apps): examining the role of the Dark Tetrad and impulsivity. Personality and Individual Differences, 110, 139-143. https://doi.org/10.1016/j.paid.2017.01.025 March, E., Litten, V., Sullivan, D. H., & Ward, L. (2020). Somebody that I (used to) know: Gender and dimensions of dark personality traits as predictors of intimate partner cyberstalking. Personality and Individual Differences, 163, Article 110084. https://doi.org/10.1016/j.paid.2020. 110084 March, E., & Steele, G. (2020). High Esteem and Hurting Others Online: Trait Sadism Moderates the Relationship Between Self-Esteem and Internet Trolling. Cyberpsychology Behavior, and Social Network, 23(7), 441-446. https://doi.org/10.1089/cyber.2019.0652 Mehari, K. R., Farrell, A. D., & Le, A. H. (2014). Cyberbullying among adolescents: Measures in search of a construct. Psychology of Violence, 4(4), 399–415. https://doi.org/10.1037/a0037521 Miller, J., Lynam, D., Hyatt, C., & Campbell, K. (2017). Controversies in Narcissism. Annual review of clinical psychology, 13(1), 291-315. https://doi.org/10.1146/ annurev-clinpsy-032816-045244 Miller, J., Price, J., Gentile, B., Lynam D., & Campbell, W. (2012). Grandiose and vulnerable narcissism from the perspective of the interpersonal circumplex. Personalilty and Individual Differences, 53(4), 507–512. https://doi. org/10.1016/j.paid.2012.04.026 Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: segunda edición. Psicothema, 25(2), 151-157. https://doi. org/10.7334/psicothema2013.24 Muris, P., Merckelbach, H., Otgaar, H., & Meijer, E. (2017). The malevolent side of human nature: A meta-analysis and critical review of the literature on the dark triad (narcissism, Machiavellianism, and psychopathy). Perspectives on Psychological Science, 12(2), 183–204. https://doi.org/10.1177/1745691616666 070 Navarro, J., Marcum, C., Higgins, G., & Ricketts, M. (2015). Addicted to the Thrill of the Virtual Hunt: Examining the Effects of Internet Addiction on the Cyberstalking Behaviors of Juveniles. Deviant Behavior, 37(8), 893- 903. https://doi.org/10.1080/01639625.2016.1153366 Navarro-Carrillo, G., Torres-Marín, J., & Carretero-Dios, H. (2021). Do trolls just want to have fun? Assessing the role of humor-related traits in online trolling behavior. Computers in Human Behavior, 114, Article e106551. https://doi.org/10.1016/j.chb.2020.106551 Nitschinsk, L, Tobin, S.J., & Vanman, E.J. (2022). The Disinhibiting Effects of Anonymity Increase Online Trolling. Cyberpsychology, Behavior, and Social Network, 25(6), 377-383. https://doi.org/10.1089/ cyber.2022.0005 Oliden, P. & Zumbo, B. (2008). Coeficientes de fiabilidad para escalas ordinales. Psicothema, 20(4), 896-901. https://www.psicothema.com/pdf/3572.pdf Ortiz, S. M. (2020). Trolling as a Collective Form of Harassment: An Inductive Study of How Online Users Understand Trolling. Social Media & Society, 6(2), Article e205630512092851. https://doi.org/10.1177/20 56305120928512 Paulhus, D. L, & Williams, K. M. (2002). The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy. Journal of Research in Personality, 36(6), 556–563. https://doi.org/10.1016/S0092-6566(02)00505-6 Petrosyan, A. (2023, April 3). Number of internet and social media users worldwide as of January 2023. Statista. https://www.statista.com/statistics/617136/digital-popu lation-worldwide/ Phillips, W. (2015). This is why we can’t have nice things: Mapping the relationship between online trolling and mainstream culture. The MIT Press. Pineda, D., Sandín, B., & Muris, P. (2020). Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad. Current Psychology, 39, 1873–1881. https://doi. org/10.1007/s12144-018-9888-5 Resett, S., & González Caino, P. (2019). Propiedades psicométricas de un Cuestionario de Trolling en una muestra argentina. Revista Argentina de Ciencias del Comportamiento, 11(1), 48-57. https://doi. org/10.32348/1852.4206.v11.n1.20870 Resett, S., & González Caino, P. (2020). Un modelo para predecir el cyberstalking a partir de la personalidad y el uso de TIC. Revista Argentina de Ciencias del Comportamiento (Suplemento), 12(1), 135-136. https:// dialnet.unirioja.es/servlet/articulo?codigo=7447330 Resett, S., González Caino, P., & Zapata, J. (2022). Propiedades Psicométricas del Dirty Dozen en Adultos Masculinos Recluidos en Establecimientos Penitenciarios. Revista Iberoamericana de Diagnóstico y Evaluación, 2(63), 103- 118. https://doi.org/10.21865/RIDEP63.2.08 Sanfilippo, M. R., Fichman, P., & Yang, S. (2018). Multidimensionality of online trolling behaviors. The Information Society, 34(1), 27–39. https://doi.org/10. 1080/01972243.2017.1391911 Sanfilippo, M. R., Yang, S., & Fichman, P. (2017). Trolling here, there, and everywhere: perceptions of trolling behaviors in context. Journal of the Association for Science and Technology, 68(10), 2313–2337. https://doi. org/10.1002/asi.23902 Schaafsma, J., & Antheunis, M. (2018). Under the bridge: An in-depth examination of online trolling in the gaming context. New Media & Society, 20(9), 3323-3340. https://doi.org/10.1177/1461444817748578. Shachaf, P., & Hara, N. (2010). Beyond vandalism: Wikipedia trolls. Journal of Information Science, 36(3), 357-370. https://doi.org/10.1177/0165551510365390 Sheridan, L. & Grant, T. (2007). Is cyberstalking different? Psychology, Crime and Law, 13(6), 627-640. https://doi. org/10.1080/10683160701340528 Shorey, R., Cornelius, T. & Strauss, C. (2015). Stalking in College Student Dating Relationships: A Descriptive Investigation. Journal of Family Violence, 30(7), 935- 942. https://doi.org/10.1007/s10896-015-9717-7 Sest, N., & March, E. (2017). Constructing the cyber-troll: Psychopathy, sadism, and empathy. Personality and Individual Differences, 119, 69-72. https://doi. org/10.1016/j.paid.2017.06.038 Slonje, R., Smith, P., & Frisén, A. (2013). The nature of cyberbullying, and strategies for prevention. Computers in Human Behavior, 29(1), 26-32. https://doi.org/10.1016/j. chb.2012.05.024 Smoker, M. & March, E. (2017). Predicting Perpetration of Intimate Partner Cyberstalking: Gender and the Dark Tetrad. Computers in Human Behavior, 72, 390-396. https://doi.org/10.1016/j.chb.2017.03.012 Solís-Salazar, M. (2015). The dilemma of combining positive and negative items in scales. Psicothema, 27(2), 192-199. https://doi.org/10.7334/psicothema2014.266 Soto, A., de Miguel, N., & Pérez Díaz, V. (2018). An approach to addiction to new technologies: A proposal for prevention in the school environment and rehabilitation treatment. Papeles del Psicólogo, 39(2), 120-126. https:// doi.org/10.23923/pap.psicol2018.2867 Spitzberg, B. H., & Cupach, W. R. (2007). The state of the art of stalking: Taking stock of the emerging literature. Aggression and Violent Behavior, 12(1), 64–86. https:// doi.org/10.1016/j.avb.2006.05.001 Suárez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30, 149- 158. https://doi.org/10.7334/psicothema2018.33 Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics (6th edition). Allyn & Bacon/Pearson Education. Van Sonderen, E., Sanderman R., & Coyne J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLOS ONE, 8, Article e68967. https://doi.org/10.1371/journal. pone.0068967 Vize, C., Collison, K., Miller, J., & Lynam, D. (2020). The “core” of the Dark Triad: A test of competing hypotheses. Personality Disorders: Theory, Research, and Treatment, 11(2), 91-99. https://doi.org/10.1037/per0000386 Volkmer, S.A., Gaube, S., Raue, M., & Lermer, E. (2023).Troll story: The dark tetrad and online trolling revisited with a glance at humor. PLoS One,18(3), Article e0280271. https://doi.org/10.1371/journal.pone.0280271 Widyanto, L., & Griffiths, M.D. (2011). An Empirical Study of Problematic Internet Use and SelfEsteem. International Journal of Cyber Behavior, Psychology and Learning, 1(1), 13-24. https://doi. org/10.4018/ijcbpl.2011010102 Wilson, C., Sheridan, L., & Garratt-Reed, D. (2022). Examining Cyberstalking Perpetration and Victimization: A Scoping Review. Trauma Violence Abuse, 6, Article e15248380221082937. https://doi. org/10.1177/15248380221082937 Young, K. S. (2011). CBT-IA: The first treatment model for internet addiction. Journal of Cognitive Psychotherapy, 25(4), 304-312. https://doi. org/10.1891/0889-8391.25.4.304 Zezulka, L. & Seigfried-Spellar, K. (2016). Differentiating Cyberbullies and Internet Trolls by Personality Characteristics and Self-Esteem. Journal of Digital Forensics, Security and Law, 11(3), Article 5. https://doi. org/10.15394/jdfsl.2016.1415
type_driver info:eu-repo/semantics/article
type_coar http://purl.org/coar/resource_type/c_6501
type_version info:eu-repo/semantics/publishedVersion
type_coarversion http://purl.org/coar/version/c_970fb48d4fbd8a85
type_content Text
publishDate 2023-05-29
date_accessioned 2023-05-29T15:54:25Z
date_available 2023-05-29T15:54:25Z
url https://actacolombianapsicologia.ucatolica.edu.co/article/view/4682
url_doi https://doi.org/10.14718/ACP.2023.26.2.9
issn 0123-9155
eissn 1909-9711
doi 10.14718/ACP.2023.26.2.9
citationstartpage 101
citationendpage 113
url4_str_mv https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4825
url2_str_mv https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4674
url3_str_mv https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4785
_version_ 1797159126502998016
spelling Propiedades psicométricas del Cuestionario Revisado de Trolling en adultos argentinos
El trolling mediante las nuevas tecnologías es un comportamiento disruptivo, molesto y destructivo, con una gran relevancia psicosocial, legal y jurídica. No existen estudios en la literatura científica que hayan examinado las propiedades de un instrumento para evaluarlo. El propósito del presente estudio fue observar las propiedades del Cuestionario Revisado de Trolling de Buckels et al. en una muestra de adultos argentinos. Se constituyó una muestra intencional de 837 participantes argentinos (edad promedio=28,4 años; 61% mujeres). Completaron el Cuestionario Revisado de Trolling de Buckels et al., un cuestionario de personalidad oscura (maquiavelismo, psicopatía y narcicismo), de adicción a internet, de cyberstalking y preguntas sociodemográficas. Un análisis factorial exploratorio como confirmatorio indicó una correcta estructura unifactorial. La consistencia interna fue adecuada: α de Cronbach = .80 y Omega coefficient (ω) = .81. La validez concurrente del cuestionario se observó con el cyberstalking, la personalidad oscura (maquiavelismo, narcisismo y psicopatía) y el uso problemático de Internet. El maquiavelismo y la disfuncionalidad eran las variables más asociadas al trolling. De este modo, la versión al español argentino de dicho test mostró evidencia de adecuadas propiedades psicométricas.
Resett, Santiago
González Caino, Pablo Christian
26
2
Núm. 2 , Año 2023 :Acta Colombiana de Psicología
Artículo de revista
Acta Colombiana de Psicología
Universidad Católica de Colombia
http://purl.org/coar/resource_type/c_6501
Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-CompartirIgual 4.0.
Akhtar, S., & Morrison, C. (2019). The prevalence and impact of online trolling of UK members of parliament. Computers in Human Behavior, 99, 322-327. https://doi. org/10.1016/j.chb.2019.05.015 Aydın, A., Arda, B., Güneş. B., & Erbaş, O. (2021). Psychopathology of Cyberbullying and Internet Trolling. Journal of Experimental and Basic Medical Sciences, 2(3), 380-391. https://www.jebms.org/full-text/79 Bentler, P. M. (1992). On the fit of models to covariances and methodology to the Bulletin. Psychological Bulletin, 112(3), 400-404. Boomsma, A., & Hoogland, J. J. (2001). The Robustness of LISREL Modeling Revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural Equation Models: Present and Future. A Festschrift in Honor of Karl Jöreskog (pp. 139-168). Scientific Software International. Brown, T. A. (2006). Confirmatory factor analysis for applied research. Guilford Press. Buckels, E. E., Trapnell, P. & Andjelovic, T., & Paulhus, D. L. (2018). Internet Trolling and Everyday Sadism: Parallel Effects on Pain Perception and Moral Judgment. Journal of Personality, 87(2), 328-340. https://doi. org/10.1111/jopy.12393 Buckels, E., Trapnell, P., & Paulhus, D. (2014). Trolls just want to have fun. Personality and Individual Differences, 67, 97-102. https://doi.org/10.1016/j.paid.2014.01.016 Byrne, B. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Routledge. Byrne, B. (2012). Structural equation modeling with MPLUS: Basic concepts, applications, and programming. Routledge. Case, C., & King, D. (2018). Internet Trolling Victimization: An Empirical Examination of Incidence in Undergraduate Business Students. Research in Higher Education Journal, 34, 32-40. https://www.aabri.com/ manuscripts/172726.pdf Chou, C.-P., & Bentler, P. M. (1995). Estimation and tests in structural equation modeling. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 37–55). Sage. Cook, C., Corcoran, L., Mc Guckin, C., & Prentice, G. (2015). Cyberbullying or Cyber Aggression? A Review of Existing Definitions of Cyber-Based Peer-to-Peer Aggression. Societies, 5(2), 245-255. https://doi. org/10.3390/soc5020245 Craker, N., & March, E. (2016). The dark side of Facebook®: The Dark Tetrad, negative social potency, and trolling behaviours. Personality and Individual Differences, 102, 79-84. https://doi.org/10.1016/j.paid.2016.06.043 Cupani, M. (2012). Análisis de Ecuaciones Estructurales: conceptos, etapas de desarrollo y un ejemplo de aplicación. Tesis, 1,186-199. https://rdu.unc.edu.ar/bitstream/ handle/11086/22039/16.pdf?sequence=1&isAllowed=y Curran, P. J., West, S. G, & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29. https://web.archive. org/web/20170808040148id_/http://hbanaszak.mjr. uw.edu.pl/TempTxt/CurranEtAl_1996_RobustnessOfTe stStatistToNonormalityInCFA.pdf DeVellis, R. F. (2012). Scale Development: Theory and Applications. Sage. Dynel, M. (2016). “Trolling is not stupid”: Internet trolling as the art of deception serving entertainment. Intercultural Pragmatics, 13(3), 353-381. https://doi.org/10.1515/ ip-2016-0015 Fichman, P., & Sanfilippo, M. R. (2016). Online trolling and its perpetrators: Under the cyberbridge. Rowman & Littlefield. Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics And Sex and Drugs and Rock “N” Roll. Sage. Flora, D. B., LaBrish, C., & Chalmers, R. P. (2012). Old and new ideas for data screening and assumption testing for exploratory and confirmatory factor analysis. Frontiers in Quantitative Psychology and Measurement, 3(55), Article e55. https://doi.org/10.3389/fpsyg.2012.00055 Furian, L., & March, E. (2023). Trolling, the Dark Tetrad, and the four-facet spectrum of narcissism. Personality and Individual Differences, 208, Article e112169. https:// doi.org/10.1016/j.paid.2023.112169 Furnham, A., Richards, S. C. & Paulhus, D. L. (2013). The Dark Triad of personality: A 10 year review. Social and Personality Psychology Compass, 7(3), 199-216. https:// doi.org/10.1111/spc3.12018 Gani, A. (2016, February 9). Internet trolling: quarter of teenagers suffered online abuse last year. The Guardian. https://www.theguardian.com/uk-news/2016/feb/09/ internet-trolling-teenagers-online-abuse-hate-cyberbullying González Caino, P., & Resett, S. (2020). Predicción del Trolling desde el sadismo y la adicción a Internet en jóvenes adultos de Buenos Aires. Interacciones, 6(3), Article e178. http://dx.doi.org/10.24016/2020.v6n3.178 Hair, J. F., Black, W. C., Babin, B.J., & Anderson, R.E. (2010). Multivariate Data Analysis (7th Edition). Pearson. Hardaker, C. (2010). Trolling in asynchronous computer mediated communication: From user discussions to academic definitions. Journal of Politeness Research, 6(2), 215-242. https://doi.org/10.1515/jplr.2010.011 Hardaker, C. (2013). “Uh... not to be nitpicky, but... the past tense of drag is dragged, not drug”: An overview of trolling strategies. Journal of Language Aggression and Conflict, 1(1), 58–86. https://doi.org/10.1075/ jlac.1.1.04har Hartung, C., Little, C., S., Allen, E., K., & Page, M. (2011). A psychometric comparison of two self-report measures of bullying and victimization: Differences by sex and grade. School Mental Health, 3, 44-57. https://doi. org/10.1007/s12310-010-9046-1 Herring, S.C., Job-Sluder, K., Scheckler, R., & Barab, S. (2002). Searching for Safety Online: Managing “Trolling” in a Feminist Forum. The Information Society, 18(5), 371-384. https://doi.org/10.1080/01972240290108186 Hidalgo-Fuentes, S. (2023). La relación de los factores de personalidad y la conducción agresiva: los Cinco Grandes y la Tríada Oscura. Acta Colombiana de Psicología, 26(1), 188-199. https://www.doi.org/10.14718/ACP.2023.26. 1.12 Hilvert-Bruce, Z., & Neill, J. (2020). I’m just trolling: The role of normative beliefs in aggressive behaviour in online gaming. Computers in Human Behavior, 102, 303- 311. https://doi.org/10.1016/j.chb.2019.09.003 Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118 Jones, D. & Paulhus, D. (2010). Different Provocations Trigger Aggression in Narcissists and Psychopaths. Social Psychological and Personality Science, 1(1), 12- 18. https://doi.org/10.1177/1948550609347591 Jones, D., & Paulhus, D. (2014). Introducing the short Dark Triad (SD3): A brief measure of dark personality traits. Assessment, 21(1), 28–41. https://doi. org/10.1177/1073191113514105 Kaplan, R. M., & Saccuzzo D. P. (2006). Pruebas psicológicas: principios, aplicaciones y temas. (6th edition). International Thomson. Kline, R. (2015). Principles and practice of structural equation modeling (4th edition). Guilford. Komaç, G., & Çağıltay, K. (2019, 6-7 November). An Overview of Trolling Behavior in Online Spaces and Gaming Context. Paper presented at 1st International Informatics and Software Engineering Conference, Ankara, Turkey. https://doi.org/10.1109/ UBMYK48245.2019.8965625 Kurniasanti, K.S, Asanti, P., Ismail, R.I., Nasrun. M.W.S., & Wiguna, T. (2019). Internet addiction: a new addiction? Medical Journal of Indonesia, 28(1), 82-91. https://mji. ui.ac.id/journal/index.php/mji/article/view/2752 Lam-Figueroa, N., Contreras-Pulache, H., Mori-Quispe, E., Nizama-Valladolid, M., Gutiérrez, C., HinostrozaCamposano, W., Torrejón Reyes, E., HinostrozaCamposano, R., Coaquira-Condori, E., & HinostrozaCamposano, W. (2011). Adicción a internet: Desarrollo y validación de un instrumento en escolares adolescentes de Lima, Perú. Revista Peruana de Medicina Experimental y Salud Pública, 28(3), 462-469. https:// doi.org/10.17843/rpmesp.2011.283.524 Lenhart, A., Ybarra, M., & Price-Feeney, M. (2016). Nonconsensual Image Sharing: One In 25 Americans Has Been A Victim Of “Revenge Porn”. Data & Society Research Institute. https://datasociety.net/pubs/oh/ Nonconsensual_Image_Sharing_2016.pdf Leone, M. (2017). The art of trolling. Unpublished manuscript, University of Turin. Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. http:// dx.doi.org/10.6018/analesps.30.3.199361 Loewenthal, K. M. (2001). An introduction to psychological tests and scales (2nd edition). Psychology Press. Lopes, B., & Yu, H. (2017). Who do you troll and Why: An investigation into the relationship between the Dark Triad Personalities and online trolling behaviours towards popular and less popular Facebook profiles. Computers in Human Behavior, 77, 69-76. https://doi.org/10.1016/j. chb.2017.08.036 March, E. (2019). Psychopathy, sadism, empathy, and the motivation to cause harm: New evidence confirms malevolent nature of the internet troll. Personality and Individual Differences, 141, 133-137. https://doi. org/10.1016/j.paid.2019.01.001 March, E., Grieve, R., Marrington, J., & Jonason, P. K. (2017). Trolling on Tinder® (and other dating apps): examining the role of the Dark Tetrad and impulsivity. Personality and Individual Differences, 110, 139-143. https://doi.org/10.1016/j.paid.2017.01.025 March, E., Litten, V., Sullivan, D. H., & Ward, L. (2020). Somebody that I (used to) know: Gender and dimensions of dark personality traits as predictors of intimate partner cyberstalking. Personality and Individual Differences, 163, Article 110084. https://doi.org/10.1016/j.paid.2020. 110084 March, E., & Steele, G. (2020). High Esteem and Hurting Others Online: Trait Sadism Moderates the Relationship Between Self-Esteem and Internet Trolling. Cyberpsychology Behavior, and Social Network, 23(7), 441-446. https://doi.org/10.1089/cyber.2019.0652 Mehari, K. R., Farrell, A. D., & Le, A. H. (2014). Cyberbullying among adolescents: Measures in search of a construct. Psychology of Violence, 4(4), 399–415. https://doi.org/10.1037/a0037521 Miller, J., Lynam, D., Hyatt, C., & Campbell, K. (2017). Controversies in Narcissism. Annual review of clinical psychology, 13(1), 291-315. https://doi.org/10.1146/ annurev-clinpsy-032816-045244 Miller, J., Price, J., Gentile, B., Lynam D., & Campbell, W. (2012). Grandiose and vulnerable narcissism from the perspective of the interpersonal circumplex. Personalilty and Individual Differences, 53(4), 507–512. https://doi. org/10.1016/j.paid.2012.04.026 Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: segunda edición. Psicothema, 25(2), 151-157. https://doi. org/10.7334/psicothema2013.24 Muris, P., Merckelbach, H., Otgaar, H., & Meijer, E. (2017). The malevolent side of human nature: A meta-analysis and critical review of the literature on the dark triad (narcissism, Machiavellianism, and psychopathy). Perspectives on Psychological Science, 12(2), 183–204. https://doi.org/10.1177/1745691616666 070 Navarro, J., Marcum, C., Higgins, G., & Ricketts, M. (2015). Addicted to the Thrill of the Virtual Hunt: Examining the Effects of Internet Addiction on the Cyberstalking Behaviors of Juveniles. Deviant Behavior, 37(8), 893- 903. https://doi.org/10.1080/01639625.2016.1153366 Navarro-Carrillo, G., Torres-Marín, J., & Carretero-Dios, H. (2021). Do trolls just want to have fun? Assessing the role of humor-related traits in online trolling behavior. Computers in Human Behavior, 114, Article e106551. https://doi.org/10.1016/j.chb.2020.106551 Nitschinsk, L, Tobin, S.J., & Vanman, E.J. (2022). The Disinhibiting Effects of Anonymity Increase Online Trolling. Cyberpsychology, Behavior, and Social Network, 25(6), 377-383. https://doi.org/10.1089/ cyber.2022.0005 Oliden, P. & Zumbo, B. (2008). Coeficientes de fiabilidad para escalas ordinales. Psicothema, 20(4), 896-901. https://www.psicothema.com/pdf/3572.pdf Ortiz, S. M. (2020). Trolling as a Collective Form of Harassment: An Inductive Study of How Online Users Understand Trolling. Social Media & Society, 6(2), Article e205630512092851. https://doi.org/10.1177/20 56305120928512 Paulhus, D. L, & Williams, K. M. (2002). The Dark Triad of personality: Narcissism, Machiavellianism, and psychopathy. Journal of Research in Personality, 36(6), 556–563. https://doi.org/10.1016/S0092-6566(02)00505-6 Petrosyan, A. (2023, April 3). Number of internet and social media users worldwide as of January 2023. Statista. https://www.statista.com/statistics/617136/digital-popu lation-worldwide/ Phillips, W. (2015). This is why we can’t have nice things: Mapping the relationship between online trolling and mainstream culture. The MIT Press. Pineda, D., Sandín, B., & Muris, P. (2020). Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad. Current Psychology, 39, 1873–1881. https://doi. org/10.1007/s12144-018-9888-5 Resett, S., & González Caino, P. (2019). Propiedades psicométricas de un Cuestionario de Trolling en una muestra argentina. Revista Argentina de Ciencias del Comportamiento, 11(1), 48-57. https://doi. org/10.32348/1852.4206.v11.n1.20870 Resett, S., & González Caino, P. (2020). Un modelo para predecir el cyberstalking a partir de la personalidad y el uso de TIC. Revista Argentina de Ciencias del Comportamiento (Suplemento), 12(1), 135-136. https:// dialnet.unirioja.es/servlet/articulo?codigo=7447330 Resett, S., González Caino, P., & Zapata, J. (2022). Propiedades Psicométricas del Dirty Dozen en Adultos Masculinos Recluidos en Establecimientos Penitenciarios. Revista Iberoamericana de Diagnóstico y Evaluación, 2(63), 103- 118. https://doi.org/10.21865/RIDEP63.2.08 Sanfilippo, M. R., Fichman, P., & Yang, S. (2018). Multidimensionality of online trolling behaviors. The Information Society, 34(1), 27–39. https://doi.org/10. 1080/01972243.2017.1391911 Sanfilippo, M. R., Yang, S., & Fichman, P. (2017). Trolling here, there, and everywhere: perceptions of trolling behaviors in context. Journal of the Association for Science and Technology, 68(10), 2313–2337. https://doi. org/10.1002/asi.23902 Schaafsma, J., & Antheunis, M. (2018). Under the bridge: An in-depth examination of online trolling in the gaming context. New Media & Society, 20(9), 3323-3340. https://doi.org/10.1177/1461444817748578. Shachaf, P., & Hara, N. (2010). Beyond vandalism: Wikipedia trolls. Journal of Information Science, 36(3), 357-370. https://doi.org/10.1177/0165551510365390 Sheridan, L. & Grant, T. (2007). Is cyberstalking different? Psychology, Crime and Law, 13(6), 627-640. https://doi. org/10.1080/10683160701340528 Shorey, R., Cornelius, T. & Strauss, C. (2015). Stalking in College Student Dating Relationships: A Descriptive Investigation. Journal of Family Violence, 30(7), 935- 942. https://doi.org/10.1007/s10896-015-9717-7 Sest, N., & March, E. (2017). Constructing the cyber-troll: Psychopathy, sadism, and empathy. Personality and Individual Differences, 119, 69-72. https://doi. org/10.1016/j.paid.2017.06.038 Slonje, R., Smith, P., & Frisén, A. (2013). The nature of cyberbullying, and strategies for prevention. Computers in Human Behavior, 29(1), 26-32. https://doi.org/10.1016/j. chb.2012.05.024 Smoker, M. & March, E. (2017). Predicting Perpetration of Intimate Partner Cyberstalking: Gender and the Dark Tetrad. Computers in Human Behavior, 72, 390-396. https://doi.org/10.1016/j.chb.2017.03.012 Solís-Salazar, M. (2015). The dilemma of combining positive and negative items in scales. Psicothema, 27(2), 192-199. https://doi.org/10.7334/psicothema2014.266 Soto, A., de Miguel, N., & Pérez Díaz, V. (2018). An approach to addiction to new technologies: A proposal for prevention in the school environment and rehabilitation treatment. Papeles del Psicólogo, 39(2), 120-126. https:// doi.org/10.23923/pap.psicol2018.2867 Spitzberg, B. H., & Cupach, W. R. (2007). The state of the art of stalking: Taking stock of the emerging literature. Aggression and Violent Behavior, 12(1), 64–86. https:// doi.org/10.1016/j.avb.2006.05.001 Suárez, J., Pedrosa, I., Lozano, L., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30, 149- 158. https://doi.org/10.7334/psicothema2018.33 Tabachnick, B. G., & Fidell, L. S. (2014). Using multivariate statistics (6th edition). Allyn & Bacon/Pearson Education. Van Sonderen, E., Sanderman R., & Coyne J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLOS ONE, 8, Article e68967. https://doi.org/10.1371/journal. pone.0068967 Vize, C., Collison, K., Miller, J., & Lynam, D. (2020). The “core” of the Dark Triad: A test of competing hypotheses. Personality Disorders: Theory, Research, and Treatment, 11(2), 91-99. https://doi.org/10.1037/per0000386 Volkmer, S.A., Gaube, S., Raue, M., & Lermer, E. (2023).Troll story: The dark tetrad and online trolling revisited with a glance at humor. PLoS One,18(3), Article e0280271. https://doi.org/10.1371/journal.pone.0280271 Widyanto, L., & Griffiths, M.D. (2011). An Empirical Study of Problematic Internet Use and SelfEsteem. International Journal of Cyber Behavior, Psychology and Learning, 1(1), 13-24. https://doi. org/10.4018/ijcbpl.2011010102 Wilson, C., Sheridan, L., & Garratt-Reed, D. (2022). Examining Cyberstalking Perpetration and Victimization: A Scoping Review. Trauma Violence Abuse, 6, Article e15248380221082937. https://doi. org/10.1177/15248380221082937 Young, K. S. (2011). CBT-IA: The first treatment model for internet addiction. Journal of Cognitive Psychotherapy, 25(4), 304-312. https://doi. org/10.1891/0889-8391.25.4.304 Zezulka, L. & Seigfried-Spellar, K. (2016). Differentiating Cyberbullies and Internet Trolls by Personality Characteristics and Self-Esteem. Journal of Digital Forensics, Security and Law, 11(3), Article 5. https://doi. org/10.15394/jdfsl.2016.1415
info:eu-repo/semantics/article
info:eu-repo/semantics/openAccess
http://purl.org/coar/resource_type/c_2df8fbb1
http://purl.org/redcol/resource_type/ART
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/version/c_970fb48d4fbd8a85
http://creativecommons.org/licenses/by-nc-sa/4.0
http://purl.org/coar/access_right/c_abf2
Text
Acta Colombiana de Psicología - 2023
Publication
Inglés
text/xml
Psychometric Properties of the Revised Trolling Questionnaire in Argentinean Adults
https://actacolombianapsicologia.ucatolica.edu.co/article/view/4682
Trolling with new technologies is a disruptive, deceptive, and destructive behavior, with great psychosocial, legal, and economical relevance. However, there are no studies in the scientific literature that have examined the properties of questionnaires to assess them. Therefore, the purpose of the present study was to observe the psychometric properties of the Revised Trolling Questionnaire by Buckels et al.’s in a sample of Argentinean adults. An intentional sample of 837 participants from Argentina (mean age = 28.4 years; 61% female) was formed. They completed the Buckels et al.’s Revised Trolling Questionnaire, measures of dark personality, Internet addiction, cyberstalking, and socio-demographic questions. Exploratory and confirmatory factorial analyses indicated a one-factor structure with correct fit statistics. Internal consistency was adequate: Cronbach’s α = .80 and Omega coefficient (ω) = .81. Concurrent validity of the trolling questionnaire was observed with dark personality (Machiavellianism, narcissism and psychopathy), problematic Internet use (symptomatology and disfunctionality), and cyberstalking. Machiavellianism and disfunctionality were the most significant variables associated with trolling. Therefore, the Argentinean Spanish version of this test showed evidence of adequate psychometric properties.
Journal article
text/html
application/pdf
2023-05-29T15:54:25Z
2023-05-29T15:54:25Z
2023-05-29
0123-9155
https://doi.org/10.14718/ACP.2023.26.2.9
https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4825
https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4674
https://actacolombianapsicologia.ucatolica.edu.co/article/download/4682/4785
1909-9711
113
101
10.14718/ACP.2023.26.2.9