Natural Language Generation Using Machine Learning Techniques
DOI:
https://doi.org/10.47611/jsrhs.v11i2.3342Keywords:
Artificial Intelligence, Machine Learning, Language Generation, Neural NetworksAbstract
Natural language generation is a subfield of machine learning, consisting of creating systems that can produce understandable texts in the human language. It is applied to all areas dealing with reporting and content creation, such as journalism and online chatbots. Despite natural language generation being labeled as a subfield, it covers a vast range of topics beyond the scope of this paper. Instead, this research paper aims to provide an overview on select topics within natural language generation: Word Embedding, Long Short-Term Memory (LSTM), and Encoder-Decoder Architecture. The authors have analyzed and reinterpreted so that the audience has an improved understanding of natural language generation in spite of the topic’s broad reach.
Downloads
References or Bibliography
Blue1Brown. (n.d.). Retrieved August 17, 2022, from https://www.3blue1brown.com/topics/neural-networks
Breuel, T. (2015, August 11). Benchmarking of LSTM Networks.
Dale R (2020). Natural language generation: The commercial state of the art in 2020. Natural Language Engineering 26, 481–487. https://doi.org/10.1017/S135132492000025X
Dilmegani, C. (2020). Natural language generation (NLG): What it is & how it works. AIMultiple. Retrieved August 17, 2022, from https://research.aimultiple.com/nlg/
Gatt, A., & Krahmer, E. (2018). Survey of the state of the art in natural language generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research, 61, 65–170. https://doi.org/10.1613/jair.5477
McDonald, D. (1986). (rep.). Natural Language Generation. Amherst, MA: University of Massachusetts.
Müller Andreas Christoph, & Guido, S. (2016). Introduction to machine learning with python: A guide for data scientists. Oreilly et Associates Inc.
Olah, C. (2015). [web log]. Retrieved 2022, from https://colah.github.io/posts/2015-08-Understanding-LSTMs/.
Phi, M. (2020, April 27). Illustrated Guide to Transformers Neural Network: A step by step explanation.
Reiter, E. (n.d.). (rep.). Building Natural Language Generation Systems. University of Aberdeen.
Shekhar, S. (2021, June 30). LSTM for text classification: Beginners Guide to Text Classification. Analytics Vidhya. Retrieved August 17, 2022, from https://www.analyticsvidhya.com/blog/2021/06/lstm-for-text-classification/
Published
How to Cite
Issue
Section
Copyright (c) 2022 Angelina Yang; Sadaf Halim
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright holder(s) granted JSR a perpetual, non-exclusive license to distriute & display this article.
