Big Five Personality Prediction from Essays through Vocabulary Graphs and Contextual Transformer Representations
DOI:
https://doi.org/10.21063/jtif.2026.V14.2.954Kata Kunci:
Personality Prediction, Big Five Personality, Text Analysis, Graph-Enhanced Embedding, Multi-Label EvaluationAbstrak
This study develops an approach to predict personality traits based on the Big Five model through essay text by combining global and contextual information using a Vocabulary Graph Convolutional Network (VGCN) and Bidirectional Encoder Representations from Transformers (BERT). VGCN is used to capture global relationships between words through a vocabulary graph representation built based on NPMI weights, while BERT plays a role in producing richer and more contextual text representations. Experimental results show that the integration of structural and contextual features can provide good performance in multi-label classification tasks. Based on the grid search process and 5-fold cross-validation, the best model configuration obtained a macro F1 score of 0.6827 and a weighted F1 score of 0.6829 in out-of-fold prediction. The evaluation results for each feature show that the recall value is close to 1.0, while the precision value ranges from 0.50 to 0.56. This condition indicates a tendency for the model to produce more positive predictions. Furthermore, the results of the study highlight the importance of optimizing the prediction threshold value to obtain a more optimal compromise between precision and recall. Overall, the integration of graph-based semantic information with contextual representations from BERT shows that the VGCN-BERT approach has good potential for application in multi-label personality classification
Referensi
[1] E. Kerz, Y. Qiao, S. Zanwar, and D. Wiechmann, “Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features,” Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, pp. 182–194, Jan. 2022, doi: 10.18653/v1/2022.wassa-1.17.
[2] R. R. McCrae and O. P. John, “An Introduction to the Five‐Factor Model and Its Applications,” J. Pers., vol. 60, no. 2, pp. 175–215, Jun. 1992, doi: 10.1111/j.1467-6494.1992.tb00970.x.
[3] Z. Ren, Q. Shen, X. Diao, and H. Xu, “A sentiment-aware deep learning approach for personality detection from text,” Inf. Process. Manag., vol. 58, no. 3, May 2021, doi: 10.1016/j.ipm.2021.102532.
[4] S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, “Deep Learning-Based Text Classification,” Apr. 30, 2022, Association for Computing Machinery. doi: 10.1145/3439726.
[5] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North, Stroudsburg, PA, USA: Association for Computational Linguistics, 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.
[6] M. Koroteev V., “BERT: A review of Applications in Natural Language Processing and Understanding,” arXiv (Cornell University), Mar. 2021, doi: 10.48550/arxiv.2103.11943.
[7] A. Subakti, H. Murfi, and N. Hariadi, “The performance of BERT as data representation of text clustering,” J. Big Data, vol. 9, no. 1, Dec. 2022, doi: 10.1186/s40537-022-00564-9.
[8] A. Kazameini, S. Fatehi, Y. Mehta, S. Eetemadi, and E. Cambria, “Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles,” arXiv (Cornell University), Oct. 2020, doi: 10.48550/arxiv.2010.01309.
[9] M. Reza, F. Derakhshi, M. A. Balafar, M. Ramezani, M.-R. Feizi-Derakhshi, and M.-A. Balafar, “Text-Based Automatic Personality Prediction Using KGrAt-Net; A Knowledge Graph Attention Network Classifier”, doi: 10.48550/arXiv.2205.13780.
[10] M. Waqas et al., “TraitBertGCN: Personality Trait Prediction Using BertGCN with Data Fusion Technique,” International Journal of Computational Intelligence Systems, vol. 18, no. 1, Dec. 2025, doi: 10.1007/s44196-025-00792-w.
[11] Y. Lin et al., “BERTGCN: Transductive text classification by combining GCN and BERT,” arXiv (Cornell University), May 2021, doi: 10.48550/arxiv.2105.05727.
[12] Z. Lu, P. Du, and J.-Y. Nie, “VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification,” in Advances in Information Retrieval (ECIR 2020), Lecture Notes in Computer Science, vol. 12035, J. M. Jose et al., Eds. Cham: Springer International Publishing, 2020, pp. 369–382, doi: 10.1007/978-3-030-45439-5_25.
[13] E. Mamani-Condori and J. Ochoa-Luna, “Aggressive language detection using VGCN-BERT for Spanish texts,” Lecture Notes in Computer Science, pp. 359–373, Jan. 2021, doi: 10.1007/978-3-030-91699-2_25.
[14] J. W. Pennebaker and L. A. King, “Linguistic styles: Language use as an individual difference.,” J. Pers. Soc. Psychol., vol. 77, no. 6, pp. 1296–1312, 1999, doi: 10.1037/0022-3514.77.6.1296.
[15] A. S. Aribowo, N. H. Cahyana, and Y. Fauziah, “Enhancing Semi-Supervised Sentiment Analysis Through Hyperparameter Tuning Within Iterations: A Comparative Study Using Grid Search and Random Search,” 2024, pp. 248–260. doi: 10.2991/978-94-6463-366-5_23.
[16] Z. C. Lipton, C. Elkan, and B. Narayanaswamy, “Thresholding classifiers to maximize F1 score,” arXiv (Cornell University), Feb. 2014, doi: 10.48550/arxiv.1402.1892.
[17] M. Apidianaki, “From Word Types to Tokens and Back: A Survey of Approaches to Word Meaning Representation and Interpretation,” 2023, doi: 10.1162/coli_a_00474.
[18] T. Wolf et al., “Transformers: State-of-the-Art Natural Language Processing,” Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45, Jan. 2020, doi: 10.18653/v1/2020.emnlp-demos.6.
[19] B. Xue, C. Zhu, X. Wang, and W. Zhu, “The Study on the Text Classification Based on Graph Convolutional Network and BiLSTM †,” Applied Sciences (Switzerland), vol. 12, no. 16, Aug. 2022, doi: 10.3390/app12168273.
[20] A. Naz, H. U. Khan, A. Bukhari, B. Alshemaimri, A. Daud, and M. Ramzan, “Machine and deep learning for personality traits detection: a comprehensive survey and open research challenges,” Artif. Intell. Rev., vol. 58, no. 8, Aug. 2025, doi: 10.1007/s10462-025-11245-3.
[21] T. Agrawal, D. Agarwal, M. Balazia, N. Sinha, and F. Bremond, “Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding,” Jan. 2023, doi: 10.5220/0010841400003124.
[22] O. Galal, A. H. Abdel-Gawad, and M. Farouk, “Rethinking of BERT sentence embedding for text classification,” Neural Comput. Appl., vol. 36, no. 32, pp. 20245–20258, Nov. 2024, doi: 10.1007/s00521-024-10212-3.
[23] X. Liu and C. Wang, “An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models,” Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp. 2286–2300, Jan. 2021, doi: 10.18653/v1/2021.acl-long.178.
[24] N. Gkouti, P. Malakasiotis, S. Toumpis, and I. Androutsopoulos, “Should I try multiple optimizers when fine-tuning pre-trained Transformers for NLP tasks? Should I tune their hyperparameters?,” Feb. 2024, [Online]. Available: http://arxiv.org/abs/2402.06948
[25] J. Dodge, G. Ilharco, R. Schwartz, A. Farhadi, H. Hajishirzi, and N. Smith, “Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping,” Feb. 2020, [Online]. Available: http://arxiv.org/abs/2002.06305
[26] M. C. Hinojosa Lee, J. Braet, and J. Springael, “Performance Metrics for Multilabel Emotion Classification: Comparing Micro, Macro, and Weighted F1-Scores,” Applied Sciences (Switzerland), vol. 14, no. 21, Nov. 2024, doi: 10.3390/app14219863.
Unduhan
Diterbitkan
Terbitan
Bagian
Lisensi
Hak Cipta (c) 2026 Yuliant Sibaroni, Sri Suryani
Artikel ini berlisensiCreative Commons Attribution-ShareAlike 4.0 International License.
Jurnal ini dilisensikan berdasarkan Lisensi Internasional Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).
Penulis memegang hak cipta dan memberikan jurnal hak penerbitan pertama.
Karya tersebut dapat dibagikan dan diadaptasi, bahkan untuk tujuan komersial, selama penghargaan yang sesuai diberikan dan setiap kreasi baru dilisensikan dengan ketentuan yang sama.
