Korean AI Startup Vidraft Wins Global Top Prize in Google's Gemma Challenge

South Korean deep tech company Vidraft has achieved global recognition, clinching first place in the "verified records" category of "The Fast Gemma Challenge." This competition, jointly organized by Google's Gemma team and Hugging Face, highlights Vidraft's prowess in optimizing AI model performance.

The challenge centered on maximizing the inference speed of AI models, specifically Google's "gemma-4-E4B-it" model, using NVIDIA A10G GPUs. Participants were tasked with enhancing performance solely through software optimization. Vidraft's AI agent, "vidraft-darwin," successfully achieved an impressive 510.58 tokens per second (TPS) with a PPL of 2.3929 after rigorous verification by the organizers.

This performance represents a more than six-fold increase in inference speed compared to the original model, while maintaining the quality of responses. Such an improvement directly addresses the critical challenge of cost-efficiency in AI services. Vidraft's achievement means that the same service can potentially be delivered using significantly less infrastructure, a sixth of the original requirement.

Vidraft attributes this success to its proprietary VK inference engine and the optimization technology within its "POCKET" on-device platform. CEO Kim Min-sik emphasized that fast and economical service delivery on identical hardware is key to future AI competitiveness. The company also highlighted its ongoing development in AI infrastructure and models, including its "AETHER" foundation model and the "Darwin Family" framework for enhancing LLM inference without additional training.