Sentiment Analysis to Identify Consumer Criticism of Artificial Intelligence: A ChatGPT Case Study
DOI:
https://doi.org/10.47611/jsrhs.v12i4.5782Keywords:
Sentiment Analysis, Machine Learning, Logistic Regression, Bag-of-Words, TF-IDF, Naive Bayes, Support Vector Machine, Random Forest Regressor, Criticism-Flagging, Natural Language ProcessingAbstract
As artificial intelligence becomes increasingly integrated into various aspects of our lives, understanding consumer sentiment and criticism towards artificial intelligence technologies becomes pivotal for effective utilization. This study presents a case study focusing on ChatGPT, a popular AI application, as a means to identify consumer criticism of AI use in businesses. By harnessing sentiment analysis and clear analytics, administrators can enhance their understanding of consumer feedback and thereby improve AI integration for better user experiences. Increased consumer satisfaction is important to overall business to consumer relationships and streamlined AI use will facilitate company procedures. Our methodology revolves around machine learning techniques, specifically utilizing four classifiers, Keras logistic regression, Naive Bayes, Support Vector Machine, and random forest regressor, alongside two numerical feature representations, Bag-of-Words and Term Frequency-Inverse Document Frequency. The results show that the Term Frequency-Inverse Document Frequency features combined with the random forest regressor yielded the strongest performance in identifying criticism of ChatGPT-related media, with F1 scores of 100 and 99 percent for no criticism and criticism, respectively.
Downloads
References or Bibliography
Bérubé, M., Giannelia, T., & Vial, G. (2021, January 5). Barriers to the implementation of AI in organizations: Findings from a delphi study. ScholarSpace. https://scholarspace.manoa.hawaii.edu/handle/10125/71425
Criticize synonyms: 84 synonyms & antonyms for criticize. Thesaurus.com. (n.d.). https://www.thesaurus.com/browse/criticize
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022, January 1). Comparing scientific abstracts generated by CHATGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxiv. https://www.biorxiv.org/content/10.1101/2022.12.23.521610v1
Jayaswal, V. (2020a). TFIDF Visualization. Medium. Retrieved from https://towardsdatascience.com/text-vectorization-term-frequency-inverse-document-frequency-tfidf-5a3f9604da6d.
Kumar, K. (2021). NLP Bag of Words and TF-IDF Visualization. Medium. Retrieved from https://koushik1102.medium.com/nlp-bag-of-words-and-tf-idf-explained-fd1f49dce7c4.
Kutela, B., Msechu, K., Das, S., Kidando, E. (2023, January). Chatgpt’s scientific writings: A case study on traffic safety. https://www.researchgate.net/publication/367335184_ChatGPT’s_Scientific_Writings_A_Case_Study_on_Traffic_Safety
Lakhanpal, S., Gupta, A., & Agrawal, R. (2023, August 16). Leveraging explainable AI to analyze researchers’ aspect-based sentiment about chatgpt. arXiv.org. https://arxiv.org/abs/2308.11001
Merriam-Webster. (n.d.). 84 synonyms & antonyms of criticize. Merriam-Webster. https://www.merriam-webster.com/thesaurus/criticize
Sobania, D., Briesch, M., Hanna, C., Petke, J. (2023). An Analysis of the Automatic Bug Fixing Performance of ChatGPT.
https://www.computer.org/csdl/proceedings-article/apr/2023/021400a023/1P7EqXY3ccw
Soni, N., Sharma, E. K., Singh, N., & Kapoor, A. (2019, May 3). Impact of artificial intelligence on businesses: From Research, Innovation, market deployment to future shifts in business models. arXiv.org. https://arxiv.org/abs/1905.02092
Thota, A. V. (2019, January 6). Applied machine learning: Naive bayes, linear SVM, logistic regression, and Random Forest. LinkedIn. https://www.linkedin.com/pulse/applied-machine-learning-naive-bayes-linear-svm-logistic-thota/
Tobane, W., de Winter, J. (2023, August) Using CHATGPT for Human-Computer Interaction Research: A Primer. https://www.researchgate.net/publication/367284084_Using_ChatGPT_for_Human-Computer_Interaction_Research_A_Primer
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022, February 7). A survey on sentiment analysis methods, applications, and Challenges - Artificial Intelligence Review. SpringerLink. https://link.springer.com/article/10.1007/s10462-022-10144-1
What is sentiment analysis and which businesses need sentiment analysis: ITech. iTech India. (2023, February 23). https://itechindia.co/us/blog/what-is-sentiment-analysis-and-which-businesses-need-sentiment-analysis/#:~:text=The%20latest%20sentiment%20analysis%20data,to%2080%25%20(Bain%26Company).
Published
How to Cite
Issue
Section
Copyright (c) 2023 Aarav Mulinti; Dr. Guillermo Goldsztein
![Creative Commons License](http://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright holder(s) granted JSR a perpetual, non-exclusive license to distriute & display this article.