– Competition for leadership in global big tech technology surrounding ultra-large AI is accelerating… In Korea, Naver is the first company to take on the challenge.
– Learning 6,500 times more Korean data than GPT-3… Securing AI sovereignty with the world’s largest Korean language model of 204B scale
– Actively cooperate with domestic and foreign academia, including establishing a joint research center with Seoul National University and KAIST, expand the global AI R&D ecosystem, and strengthen AI research capabilities
– Starting with search word correction, we plan to commercialize it on various Naver services… Provide differentiated experiences to users
– ‘AI will be for everyone’ that can be easily used even by SMEs and creators who have difficulty with R&D
Naver unveiled ‘HyperCLOVA’, the first ‘ultra-scale AI’ for a domestic company, and announced plans to move beyond being an AI first mover in Korea and become a global AI technology leader. The goal is to lead the era of ‘AI for everyone’ by providing new and differentiated experiences to users, SMEs, and creators through ‘Hyperclova’, which changes the paradigm of existing Korean AI.
At the ‘NAVER AI NOW’ conference held online on the 25th, Naver disclosed the achievements and future direction of Naver AI technology since the introduction of supercomputers in October last year.
Hyperclova is a large-scale AI developed by Naver for the first time as a domestic company. Seok-geun Jeong, CEO of Naver CLOVA CIC (Company-In-Company), said in the keynote, “Global technology giants are accelerating investments in anticipation of the disruptive innovation that large-scale AI models will bring.” He added, “Korea’s AI technology is not dependent on global platforms. “We decided that we couldn’t stop at the level of using and catching up with already disclosed technologies,” he said about the development background.
Hyperclova was developed with a parameter scale of 204B (204 billion), exceeding OpenAI’s GPT-3 (175B). As the number of parameters representing the size of the AI model increases, AI can solve more problems.
Hyperclova is currently the world’s largest Korean language model, having learned more than 6,500 times more Korean data than GPT-3. Unlike GPT-3, where English accounts for most of the learning data, the Korean language account for 97% of Hyperclova’s learning data. It also means securing AI sovereignty by developing a language model optimized for Korean, unlike the English-centered global AI model.
Take the lead in technology with global-level infrastructure, data, and AI expertise
To this end, Naver became the first domestic company to introduce a supercomputer with a performance of 700 petaflops (PF) last October, and has the infrastructure to process large amounts of data.
Hyperclova’s ability to process large-scale data accumulated while operating Korea’s largest Internet platform is also an important competitive advantage of Hyperclova. Naver built a large amount of Korean data worth 560 billion tokens to develop Hyperclova.
In addition to supercomputer infrastructure and Korean data, Naver’s world-class AI research and development capabilities are also important factors in Hyperclova’s own development. Last year, Naver was recognized for its technology by presenting 43 regular papers at the Global Top AI Conference, the most among domestic companies. In addition, through close and strong industry-academia cooperation, such as establishing the ‘Seoul National University-Naver Hyperscale AI Research Center’ with Seoul National University and the ‘KAIST-Naver Hypercreative AI Research Center’ with the KAIST AI Graduate School. We are further accelerating joint AI research.
Naver plans to expand the language model to languages other than Korean in the future and continue to develop Hyperclova with ‘multimodal AI’ that understands not only language but also videos and images.
Differentiating user experience by commercializing Hyperclova on Naver services
Hyperclova completely changes the paradigm of AI development and application, allowing AI to be used more and more widely in everyday life. Previously, models were developed by securing and purifying data for each problem to be solved, but Hyperclova can be applied to a variety of problems by training a large amount of data in one ‘Big Model’. This not only allows AI to be developed more efficiently, but also significantly increases the scalability of AI.
Naver plans to provide a differentiated experience to users by applying Hyperclova’s technology to Naver services. As the first example, on the 6th, Hyperclova was applied to the search service and a function was introduced that converts the search term to the correct word or recommends an appropriate search term if the user enters the wrong search word.
Technology will become a skill for everyone, including SMEs, creators, and startups.
Furthermore, Naver plans to support Hyperclova to become a ‘capability for everyone’ who needs technological help, including SMEs, creators, and startups. Because AI can be operated using a few-shot learning method that presents simple explanations and examples, anyone can easily create an AI service even if they are not an AI expert.
For example, it will become possible for AI to automatically write appropriate marketing phrases to help sell products, for AI to quickly summarize what you need to study, or to naturally answer questions when asked about something you do not know. Naver plans to provide various types of technology through active business and research cooperation in the future.
Naver has been working under the direction of ‘technology platform’ to make users’ daily lives more convenient with cutting-edge AI technology and to add value to SME businesses and creators’ activities. In particular, in the COVID-19 pandemic situation, Clova’s natural language processing, voice recognition, and synthesis technology introduced the ‘Clova Care Call’ service for active surveillance management, contributing to work efficiency at quarantine sites.
Seok-Geun Jeong, CEO of Naver CLOVA CIC, said, “A new era of AI is opening in which things we could only imagine or even things we could not imagine before are possible using shorter time and fewer resources.” He added, “‘Hyperclova’. “Through this, we will provide a new experience to everyone who needs AI technology, including SMEs and creators.”
Source: Pangyo Techno Valley Official Newsroom
→ Go to ‘Asia Innovation Hub Pangyo Techno Valley 2021’ news