Evaluation of experts for the Credibility of Generative Journalistic Content Using the Chat GPT Application

Author

Department of Media, Faculty of Arts, Helwan University

Abstract

The current study aims to evaluate the credibility of journalistic content generated by the ChatGPT application, from the perspective of experts in the fields of digital media and artificial intelligence. The study adopts both descriptive and exploratory approaches, relying on both descriptive and exploratory methodologies. The structured interview guide was utilized as a data collection tool, applied to a purposive sample consisting of 12 experts in the fields of digital media and artificial intelligence. The study yielded several key findings, including:
)1)The study sample proposed various mechanisms for measuring the credibility and impartiality of the generated content produced by the CHATGPT application. These mechanisms include verifying multiple sources and utilizing foreign sources, engaging followers in providing comments and corrections on the generated content, implementing governance and regulatory mechanisms in journalistic institutions to ensure responsible use, holding technology and artificial intelligence companies accountable for the output content, continuously training algorithms to improve the performance of applications, and diversifying questions and testing results.
(2) All study experts exploring CHATGPT discovered errors in its generated content, signaling inaccuracies. They attributed these to the necessity of updating information and training algorithms, advocating for user involvement in reviews based on experience. They stressed the importance of verifying and regularly updating the generated information's accuracy.
)3(The study found that the majority of experts recognize ChatGPT's potential in journalism, recommending its utilization as a primary research tool to enhance accuracy and incorporate visual elements. They emphasized the importance of training journalists to effectively use the application and improve its outcomes. Additionally, experts underscored the necessity of collaboration between journalism institutions and technology companies to establish regulatory frameworks, ensuring transparency regarding data sources.
(4) More than half of the experts expected ChatGPT to complement journalism in the future, particularly in time-consuming tasks, without replacing humans. Due to journalism's creative and emotional nature, the application cannot surpass human capabilities, especially in journalistic adventures or investigative reporting.

Keywords

References

Al-Badi, M. (2023). News and modern trends: The largest Chinese search engine prepares to launch a competitor to the American AI program "ChatGPT." Journal of the Egyptian for Information Systems and Computer Technology, Egyptian Association for Information Systems and Computer Technology (ESISACT), 32, 48.
Almarzouqi, A., Aburayya, A., & Salloum, S. A. (2022). Determinants of intention to use
    medical smartwatch-based dual-stage SEM-ANN analysis. Informatics in Medicine Unlocked, 28, 100859.
Al Naffakh, H. A. H., Radhi, A. D., Hakim, B. A., Fuqdan, A. I., & Al-Attar, B. (2024).
Exploring ChatGPT's performance in news recommendation: A multi-faceted analysis. In BIO Web of Conferences (Vol. 97, p. 00121). EDP Sciences.
Al-Suwaidi, S. (2023). Majid bin Mohammed Al-Juhani, the ChatGPT AI model and a virtual dialogue on "personal development and self-improvement." Dar Al-Asala for Publishing, Translation, and Printing Services, Istanbul, p. 25.
 Alserhan, S., Alqahtani, T. M., Yahaya, N., Al-Rahmi, W. M., & Abuhassna, H. (2023). Personal learning environments: Modeling students’ self-regulation enhancement through  a learning management system platform. IEEE Access, 11, 5464-5482.
Biswas, S., Dobaria, D., & Cohen, H. L. (2023). Focus: Big Data: ChatGPT and the Future of  Journal Reviews: A Feasibility Study. The Yale Journal of Biology and Medicine, 96(3), 415.
Bogost, Ian. (2022). ChatGPT is dumber than you think. The Atlantic, 7.
Bdoor, S. Y., & Habes, M. (2024). Use Chat GPT in Media Content Production Digital Newsrooms Perspective. In Artificial Intelligence in Education: The Power and Dangers of ChatGPT in the Classroom. Cham: Springer Nature Switzerland.
Chan, A. (2023). GPT-3 and InstructGPT: technological dystopianism, utopianism, and
     “Contextual” perspectives in AI ethics and industry. AI and Ethics, 3(1), 53-64.
Chien, S. Y., & Hwang, G. J. (2023). A research proposal for an AI chatbot as virtual patient agent to improve nursing students’ clinical inquiry skills. ICAIE, 2023(2023), 13.‏
El-Sayed, W. (2024). The effectiveness of using modern technologies such as AI, metaverse, and ChatGPT in the fields of education and journalism in Egypt: An applied study in light  of the unified theory of acceptance and use of technology and the diffusion of innovations approach. The Egyptian Journal of Public Opinion Research, Cairo University, Faculty  of Media, 23(1).
Gutiérrez-Caneda, B., Vázquez-Herrero, J., & López-García, X. (2023). AI application in journalism: ChatGPT and the uses and risks of an emergent technology. Profesional de la información/Information Professional, 32(5).
Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., ... & Wu, Y. (2023). How close is chatgpt to human experts? comparison corpus, evaluation, and detection. arXiv preprint  arXiv:2301.07597.
Huang, Y., Shu, K., Yu, P. S., & Sun, L. (2024, May). From Creation to Clarification: ChatGPT's Journey Through the Fake News Quagmire. In Companion Proceedings of the ACM on Web Conference. 2024 (pp. 513-516).
Hussain, K., Khan, M. L., & Malik, A. (2024). Exploring audience engagement with ChatGPT-related content on YouTube: Implications for content creators and AI tool developers. Digital Business, 4(1), 100071.
Ibrahim, A. (2021). Factors influencing the adoption of Chatbots and AI systems, and their relationship with customer relationship management. The Egyptian Journal of  Public Opinion Research, Cairo University, Faculty of Mass Communication, 20(3),                    533-577.   Available at: https://search.mandumah.com/Record/1180949
Kohli, S. S. (2023). Using CHAT GPT to write scientific manuscripts: Frame of reference. Journal of Contemporary Orthodontics, 7(1), 1-2.
Krügel, S., Ostermaier, A., & Uhl, M. (2023). The moral authority of ChatGPT. arXiv preprint  arXiv:2301.07098.
Lee, Y. K., Lee, Y. K., Zhang, A., Choi, E., & Glass, L. (2024). Large language models
            produce responses perceived to be empathic. arXiv preprint arXiv:2403.18148.
Levine, D. M., Tuwani, R., Kompa, B., Varma, A., Finlayson, S. G., Mehrotra, A., & Beam, A. (2023). The diagnostic and triage accuracy of the GPT-3 artificial intelligence model. MedRxiv.
Mhlanga, D. (2023). The value of open AI and chat GPT for the current learning environments and the potential future uses. Available at SSRN 4439267.
Mohamed, S. (2023). Egyptian youth acceptance of using technology as an AI application: A field study. Journal of Media Research, Al-Azhar University, Faculty of Media, 66(1), 9-74.
Mollman, Steve. (2022). ChatGPT gained 1 million users in under a week. Here’s why the AI chatbot is primed to disrupt search as we know it. Yahoo! Finance, 9.
Mondal, S., Das, S., & Vrana, V. G. (2023). How to bell the cat? A theoretical review of generative artificial intelligence towards digital disruption in all walks of life.Technologies 11(2), 44.
Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & mass communication educator, 78(1), 84-93.
Qandil, A. (2023). Experts offer important tips for using ChatGPT in journalism. International Journalists' Network. Available at: https://2u.pw/BInM0VBy
Redman, A., bin Omar, O., & Ahmed, K. A. (2023). Aspects of using the ChatGPT application in the media field: An exploratory study. Middle East Journal of Public Relations Research, Egyptian Public Relations Association, (47).
Rice, S., Crouse, S. R., Winter, S. R., & Rice, C. (2024). The advantages and limitations of using ChatGPT to enhance technological research. Technology in Society, 76, 102426.
Robb, D. (2023). Chat GPT vs Google Bard: Generative AI comparison. EWeek.‏
Saad, H. (2023). Crafting creative content in educational media using AI technology ChatGPT: Exploring opportunities and challenges. Journal of Specific Education Research,  Mansoura University, Faculty of Specific Education, (75), 55-140.
Shidiq, M. (2023, May). The use of artificial intelligence-based chat-gpt and its challenges for the world of education; from the viewpoint of the development of creative writing skills. In Proceeding of international conference on education, society and humanity (Vol. 1, No. 1, pp. 353-357).
Zagorulko, D. I. (2023). ChatGPT in newsrooms: Adherence of AI-generated content to journalism standards and prospects for its implementation in digital media. Vcheni zapysky TNU imeni VI Vernadskoho.
Yahya, H. (2024). Ethics of using ChatGPT applications and platforms in content creation for journalism. Journal of Media Research and Studies, Al-Shorouk Academy, Higher International Institute for Media in Al-Shorouk, (27), 9-109.
Qandil, A. (2023). Experts offer important tips for using ChatGPT in journalism. International Journalists' Network. Available at: https://2u.pw/BInM0VBy

Files

Share

How to cite

Statistics