DistantNews
Support us
🇹🇼 Taiwan /Technology

Taiwan’s sovereign AI models break into global top 20, ministry evaluation finds

From Liberty Times · () Chinese

Translated from Chinese and summarized by DistantNews. Read the original for the full story.

At a glance

News Official statement New plan
  • Taiwan’s Ministry of Digital Affairs evaluated 188 AI models on their understanding of Taiwanese language, society, culture and values.
  • Nine Taiwanese models took part, with models from three local companies ranking in the top 20.
  • Yating Intelligence ranked fourth, Asia Pacific Intelligence’s ACE-1-24B-2604 ranked 10th, and FoxBrain v2.0 from Hon Hai Research Institute ranked 12th.

Taiwan’s Ministry of Digital Affairs says locally developed AI models have entered the top 20 in an evaluation designed to test whether artificial intelligence truly understands Taiwan, rather than simply responding in Traditional Chinese.

The ministry announced the results at a press conference titled “Sovereign AI Evaluation and Trusted AI Action.” Through the AI Product and System Evaluation Center, it assessed models in three areas: Taiwanese language, social and cultural understanding, and Taiwanese values. The evaluation used questions from the past five years of Taiwan’s high school entrance examinations in Chinese and social studies, along with material intended to reflect areas of social consensus.

Sovereign AI has two important meanings.

— Lin Yi-chingTaiwan’s digital minister introduces the legal and national-perspective dimensions of sovereign AI.

Minister Lin Yi-ching said sovereign AI has two important dimensions. Models must follow the laws of the country where their servers are located, and models trained in different countries often carry that country’s viewpoints and ideology. He said many existing models struggle with Traditional Chinese, local Taiwanese knowledge and Taiwanese perspectives, and may apply another country’s political narratives, legal systems or social context.

Now we are using questions designed to test people to test these models.

— Lin Yi-chingHe explains the ministry’s use of national examination questions for AI evaluation.

The latest assessment covered 188 models, including nine from Taiwan. Three companies placed models in the top 20. Yating Intelligence ranked fourth, scoring 86.20% in Chinese, 84.00% in social studies and 100% on Taiwanese values. Asia Pacific Intelligence’s ACE-1-24B-2604 ranked 10th, with scores of 83.78%, 71.57% and 100%. FoxBrain v2.0, developed by Hon Hai Research Institute, ranked 12th, scoring 78.70%, 80.51% and 92%.

Lin said the results showed Taiwan could train capable models, including relatively small models competing against systems with larger parameter counts. The ministry plans to expand testing into legal, financial, nursing and education applications, and may add questions from national civil service examinations. Companies can submit models free of charge, while research institutes and universities may later contribute evaluation questions.

These good scores are the best marketing tool.

— Lin Yi-chingHe describes how third-party evaluation could help Taiwanese AI companies commercialize and promote their models.
About this summary

Originally published by Liberty Times in Chinese. Translated, summarized, and contextualized automatically by DistantNews, with a note on how the source frames the story. Not individually reviewed before publishing. How this works.