Big Five Personality Prediction from Essays through Vocabulary Graphs and Contextual Transformer Representations

Yuliant Sibaroni; Sri Suryani Prasetiyowati

doi:10.21063/jtif.2026.V14.2.954

Authors

Yuliant Sibaroni Telkom University
Sri Suryani Telkom University

DOI:

https://doi.org/10.21063/jtif.2026.V14.2.954

Keywords:

Personality Prediction, Big Five Personality, Text Analysis, Graph-Enhanced Embedding, Multi-Label Evaluation

Abstract

This study develops an approach to predict personality traits based on the Big Five model through essay text by combining global and contextual information using a Vocabulary Graph Convolutional Network (VGCN) and Bidirectional Encoder Representations from Transformers (BERT). VGCN is used to capture global relationships between words through a vocabulary graph representation built based on NPMI weights, while BERT plays a role in producing richer and more contextual text representations. Experimental results show that the integration of structural and contextual features can provide good performance in multi-label classification tasks. Based on the grid search process and 5-fold cross-validation, the best model configuration obtained a macro F1 score of 0.6827 and a weighted F1 score of 0.6829 in out-of-fold prediction. The evaluation results for each feature show that the recall value is close to 1.0, while the precision value ranges from 0.50 to 0.56. This condition indicates a tendency for the model to produce more positive predictions. Furthermore, the results of the study highlight the importance of optimizing the prediction threshold value to obtain a more optimal compromise between precision and recall. Overall, the integration of graph-based semantic information with contextual representations from BERT shows that the VGCN-BERT approach has good potential for application in multi-label personality classification

References

[1] E. Kerz, Y. Qiao, S. Zanwar, and D. Wiechmann, “Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features,” Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, pp. 182–194, Jan. 2022, doi: 10.18653/v1/2022.wassa-1.17.

[2] R. R. McCrae and O. P. John, “An Introduction to the Five‐Factor Model and Its Applications,” J. Pers., vol. 60, no. 2, pp. 175–215, Jun. 1992, doi: 10.1111/j.1467-6494.1992.tb00970.x.

[3] Z. Ren, Q. Shen, X. Diao, and H. Xu, “A sentiment-aware deep learning approach for personality detection from text,” Inf. Process. Manag., vol. 58, no. 3, May 2021, doi: 10.1016/j.ipm.2021.102532.

[4] S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, “Deep Learning-Based Text Classification,” Apr. 30, 2022, Association for Computing Machinery. doi: 10.1145/3439726.

[5] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North, Stroudsburg, PA, USA: Association for Computational Linguistics, 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.

[6] M. Koroteev V., “BERT: A review of Applications in Natural Language Processing and Understanding,” arXiv (Cornell University), Mar. 2021, doi: 10.48550/arxiv.2103.11943.

[7] A. Subakti, H. Murfi, and N. Hariadi, “The performance of BERT as data representation of text clustering,” J. Big Data, vol. 9, no. 1, Dec. 2022, doi: 10.1186/s40537-022-00564-9.

[8] A. Kazameini, S. Fatehi, Y. Mehta, S. Eetemadi, and E. Cambria, “Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles,” arXiv (Cornell University), Oct. 2020, doi: 10.48550/arxiv.2010.01309.

[9] M. Reza, F. Derakhshi, M. A. Balafar, M. Ramezani, M.-R. Feizi-Derakhshi, and M.-A. Balafar, “Text-Based Automatic Personality Prediction Using KGrAt-Net; A Knowledge Graph Attention Network Classifier”, doi: 10.48550/arXiv.2205.13780.

[10] M. Waqas et al., “TraitBertGCN: Personality Trait Prediction Using BertGCN with Data Fusion Technique,” International Journal of Computational Intelligence Systems, vol. 18, no. 1, Dec. 2025, doi: 10.1007/s44196-025-00792-w.

[11] Y. Lin et al., “BERTGCN: Transductive text classification by combining GCN and BERT,” arXiv (Cornell University), May 2021, doi: 10.48550/arxiv.2105.05727.

[12] Z. Lu, P. Du, and J.-Y. Nie, “VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification,” in Advances in Information Retrieval (ECIR 2020), Lecture Notes in Computer Science, vol. 12035, J. M. Jose et al., Eds. Cham: Springer International Publishing, 2020, pp. 369–382, doi: 10.1007/978-3-030-45439-5_25.

[13] E. Mamani-Condori and J. Ochoa-Luna, “Aggressive language detection using VGCN-BERT for Spanish texts,” Lecture Notes in Computer Science, pp. 359–373, Jan. 2021, doi: 10.1007/978-3-030-91699-2_25.

[14] J. W. Pennebaker and L. A. King, “Linguistic styles: Language use as an individual difference.,” J. Pers. Soc. Psychol., vol. 77, no. 6, pp. 1296–1312, 1999, doi: 10.1037/0022-3514.77.6.1296.

[15] A. S. Aribowo, N. H. Cahyana, and Y. Fauziah, “Enhancing Semi-Supervised Sentiment Analysis Through Hyperparameter Tuning Within Iterations: A Comparative Study Using Grid Search and Random Search,” 2024, pp. 248–260. doi: 10.2991/978-94-6463-366-5_23.

[16] Z. C. Lipton, C. Elkan, and B. Narayanaswamy, “Thresholding classifiers to maximize F1 score,” arXiv (Cornell University), Feb. 2014, doi: 10.48550/arxiv.1402.1892.

[17] M. Apidianaki, “From Word Types to Tokens and Back: A Survey of Approaches to Word Meaning Representation and Interpretation,” 2023, doi: 10.1162/coli_a_00474.

[18] T. Wolf et al., “Transformers: State-of-the-Art Natural Language Processing,” Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45, Jan. 2020, doi: 10.18653/v1/2020.emnlp-demos.6.

[19] B. Xue, C. Zhu, X. Wang, and W. Zhu, “The Study on the Text Classification Based on Graph Convolutional Network and BiLSTM †,” Applied Sciences (Switzerland), vol. 12, no. 16, Aug. 2022, doi: 10.3390/app12168273.

[20] A. Naz, H. U. Khan, A. Bukhari, B. Alshemaimri, A. Daud, and M. Ramzan, “Machine and deep learning for personality traits detection: a comprehensive survey and open research challenges,” Artif. Intell. Rev., vol. 58, no. 8, Aug. 2025, doi: 10.1007/s10462-025-11245-3.

[21] T. Agrawal, D. Agarwal, M. Balazia, N. Sinha, and F. Bremond, “Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding,” Jan. 2023, doi: 10.5220/0010841400003124.

[22] O. Galal, A. H. Abdel-Gawad, and M. Farouk, “Rethinking of BERT sentence embedding for text classification,” Neural Comput. Appl., vol. 36, no. 32, pp. 20245–20258, Nov. 2024, doi: 10.1007/s00521-024-10212-3.

[23] X. Liu and C. Wang, “An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models,” Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp. 2286–2300, Jan. 2021, doi: 10.18653/v1/2021.acl-long.178.

[24] N. Gkouti, P. Malakasiotis, S. Toumpis, and I. Androutsopoulos, “Should I try multiple optimizers when fine-tuning pre-trained Transformers for NLP tasks? Should I tune their hyperparameters?,” Feb. 2024, [Online]. Available: http://arxiv.org/abs/2402.06948

[25] J. Dodge, G. Ilharco, R. Schwartz, A. Farhadi, H. Hajishirzi, and N. Smith, “Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping,” Feb. 2020, [Online]. Available: http://arxiv.org/abs/2002.06305

[26] M. C. Hinojosa Lee, J. Braet, and J. Springael, “Performance Metrics for Multilabel Emotion Classification: Comparing Micro, Macro, and Weighted F1-Scores,” Applied Sciences (Switzerland), vol. 14, no. 21, Nov. 2024, doi: 10.3390/app14219863.