Large Language Model (LLM) has achieved great success in many fields over recent years, demonstrating a promising future. Nevertheless, hallucination remains a major impediment that limits the usability and reliability of LLM. In order to mitigate hallucination, researchers have proposed various approaches, among which self-reflection stands out. While the initial optimism about pure LLM self-reflection slowly fades away, its methodologies are becoming more complicated and interweaved with other approaches. Due to fact that the boundaries between self-reflection and many of its synonyms are ambiguous, and that researchers keep coining new concepts and terminologies that may overlap and intertwine intricately with each other, this paper aims to provide a clear definition of self-reflection and some frequently used terminologies. In addition, given that currently there is no systematic work sorting out papers in this field, this paper fills this gap by classifying different self-reflection methodologies and presenting paradigmatic researches in each category. By the end, this paper discusses the possible limitations and directions of future development in this field, predicting that self-reflection might evolve into a component in hybrid LLM training approaches that is critical to hallucination alleviation.
Research Article
Open Access