Kakao Brain announced that it has released ‘KoGPT’, a Korean-specific artificial intelligence (AI) language model, on the open source community GitHub.
The language model GPT-3 is an AI model that allows humans and AI to communicate based on natural language. It is a technology that is evaluated as having opened the next-generation AI era by raising the limits of deep learning.
In the existing deep learning method, when conducting emotional analysis, a lot of data is secured to understand people’s preferences and judge whether it is good or bad. By applying the GPT model, you can conduct emotional analysis by making your own decisions without additional learning.
For example, by looking at movie review comments, you can determine whether the comments are positive or negative about the movie, and you can briefly summarize the content of the article. If you enter the text ‘I watered the plant for 3 weeks’, it predicts the cause-and-effect relationship, such as ‘The plant bloomed’, and allows you to write the next story yourself.
Kakao Brain’s ‘KoGPT’ is a Korean-specific version of the GPT-3 model. It was built based on Korean data with 6 billion parameters and 200 billion tokens.
Kakao Brain explains that KoGPT understands Korean lexically and contextually and shows the results desired by the user. Perform all tasks that can be used with language, such as △ judging the positivity and negativity of a given sentence △ summarizing a long sentence △ predicting a conclusion by inferring a sentence △ understanding the context and answering a question. Because automatic writing is possible depending on the context, it can solve high-level language tasks such as writing product introductions, emotional analysis, machine reading, and machine translation, and can be used in a variety of fields.
In the future, Kakao Brain will prepare not only Korean, but also English and Japanese models and open source them. We plan to prepare Southeast Asian languages, such as Vietnamese and Malay, so that more places can enjoy the benefits of AI technology.
“We plan to increase the size and performance of GPT technology by 100 times in the future,” said Kim Il-du, CEO of Kakao Brain. “GPT requires a high level of resources and investment because it deals with large-scale data. “By opening GPT as open source, we will increase technology accessibility to general universities and startups,” he said.
CEO Kim will hold an opportunity to directly explain ‘KoGPT’, including Kakao Brain’s future direction and major research, at the ‘If Kakao 2021’ conference held on this day.
Source: Pangyo Techno Valley Official Newsroom
→ Go to ‘Asia Innovation Hub Pangyo Techno Valley 2021’ news