Inquiring into AI Models: GPT-4, Sabiá-3 and Deepseek-R1 on Historical News ArFcles on Brazil’s Military Dictatorship
DOI:
https://doi.org/10.21814/h2d.6680Keywords:
LLM, historical text, data engineering, digital humanities, computational social sciencesAbstract
This study analyzes how large language models (LLMs)—ChatGPT (OpenAI), Sabiá-3 (MaritacaAI), and DeepSeek (China)—interpret Brazilian historical texts from the military dictatorship (1964–1985). Using a curated dataset of sixteen OCR-processed newspaper articles pre-classified by stance (supportive, critical, or neutral), the study selected three representative texts for detailed analysis. It evaluates model responses to a political sentiment prompt through cosine similarity, lexical frequency, and class-based TF-IDF (c-TF-IDF). Results show semantic convergence among the models but notable divergence in discursive strategies. ChatGPT tends to neutralize ideological framing, DeepSeek focuses on rhetorical deconstruction, while Sabiá-3 favors literal interpretation and often misses implicit criticism or historical nuance. These patterns are linked to model architecture, linguistic design, and especially the quality and curation of training data. Despite being a Brazilian model, Sabiá-3 demonstrates interpretive shortcomings, suggesting that domestic training data alone is insufficient without critical historiographic input. The findings highlight concerns about algorithmic bias, digital sovereignty, and the cultural politics embedded in AI. The research underscores the importance of historically informed and critically curated corpora in training LLMs for underrepresented languages. Future work will broaden the dataset and explore how prompt design and model versioning affect interpretative outcomes.
Downloads
References
Abonizio, H., Almeida, T. S., Laitz, T., Malaquias Jr., R., Kerche Bonás, G., Nogueira, R., & Pires, R. (2024, outubro). Sabiá-3 Technical Report. Maritaca AI. https://arxiv.org/abs/2410.12049
Duncan, C., & McCulloh, I. (2023). Unmasking bias in ChatGPT responses. Proceedings of the IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. https://doi.org/10.1145/3625007.3627484 DOI: https://doi.org/10.1145/3625007.3627484
Grootendorst, M. (2020). Creating a class-based TF-IDF with Scikit-Learn. maartengrootendorst.com. https://maartengrootendorst.com/blog/ctfidf/
Hajikhani, A., & Cole, C. (2024). A critical review of large language models: Sensitivity, bias, and the path toward specialized AI. Quantitative Science Studies, 5(3), 736–756. https://doi.org/10.1162/qss_a_00310 DOI: https://doi.org/10.1162/qss_a_00310
Hayder, W. A. (2025). Highlighting DeepSeek-R1: Architecture, Features and Future Implications. International Journal of Computer Science and Mobile Computing, 14, 1-13. DOI: https://doi.org/10.47760/ijcsmc.2025.v14i02.001
Milyaev, S., Barinova, O., Novikova, T., Artemyev, A., & Konushin, A. (2013). Image binarization for end-to-end text recognition in natural scenes. In 2013 12th International Conference on Document Analysis and Recognition (pp. 1224–1228). IEEE. https://doi.org/10.1109/ICDAR.2013.246 DOI: https://doi.org/10.1109/ICDAR.2013.33
OpenAI. (n.d.). GPT-4 research. Retrieved September 23, 2025, from https://openai.com/pt-BR/index/gpt-4-research/?utm_source=chatgpt.com
Smith, R. (2007). An overview of the Tesseract OCR engine. In 2007 Ninth International Conference on Document Analysis and Recognition (pp. 629–633). IEEE. https://doi.org/10.1109/ICDAR.2007.4376991 DOI: https://doi.org/10.1109/ICDAR.2007.4376991
Tao, Y., Viberg, O., Baker, R. S., & Kizilcec, R. F. (2024). Cultural bias and cultural alignment of large language models. PNAS Nexus, 3, pgae346. https://doi.org/10.1093/pnasnexus/pgae346 DOI: https://doi.org/10.1093/pnasnexus/pgae346
Törnberg, P. (2023). ChatGPT-4 outperforms experts and crowd workers in annotating political Twitter messages with zero-shot learning. Amsterdam Institute for Social Science Research, University of Amsterdam. https://arxiv.org/abs/2304.06588
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Gustavo Moreira Calixto, Alan César Belo Angeluci, Elias Cunha Bitencourt

This work is licensed under a Creative Commons Attribution 4.0 International License.





