MediaTek Speeds Up Generative AI Processing at the Edge

MediaTek Inc.’s latest flagship mobile chip in its Dimensity portfolio, the Dimensity 9300+, offers increased clock speeds and is designed to accelerate on-device generative AI processing, offering broader support for LLMs, and other performance enhancements over the Dimensity 9300.

“The Dimensity 9300+ will help us continue to build a rich ecosystem of generative AI applications thanks to the chip’s broad LLM support and on-device LoRA Fusion. To enhance these AI experiences, the Dimensity 9300+ offers impressive performance and enhancements to speed up LLM inference, running tokens much faster for a better user experience,” said JC Hsu, Corporate Senior Vice President at MediaTek.

Leveraging an All-Big-Core design with 3rd generation TSMC 4nm process, Dimensity 9300+ has one Arm Cortex-X4 core operating at up to 3.4GHz, plus three Cortex-X4 cores and four Cortex-A720 cores. The Dimensity 9300+ also boasts AI processing over the previous generation thanks to MediaTek’s new NeuroPilot Speculative Decode Acceleration technology in the company’s latest generative AI engine. The powerful APU 790 AI engine allows Dimensity 9300+ to not only support LLMs with 1B, 7B, and 13B parameters, with scalability up to 33B, but also run LLMs quickly and efficiently. With NeuroPilot Speculative Decode Acceleration, Dimensity 9300+ can run LLMs with seven billion parameters at 22 tokens per second, more than 2X the rate of competitive mass market solutions.

Dimensity 9300+ integrates a 2nd generation hardware raytracing engine with an Arm Immortalis-G720 GPU, giving gamers fast raytracing experiences at a smooth 60 FPS, along with console-grade global illumination effects. The chip also leverages MediaTek’s latest HyperEngine technologies to take gaming to the next level. MediaTek Adaptive Gaming Technology (MAGT) offers a boost in power efficiency when enabled in popular game titles, helping to extend battery life and keep devices cool. Additionally, the chip integrates HyperEngine’s new Network Observation System (NOS) to improve WiFi/Cellular dual-network concurrency and leverage precise network prediction technology. When enabled, MediaTek NOS offers up to 10% power savings and up to 25% cellular data savings.

With MediaTek’s Imagiq 990 ISP that offers 18-bit RAW processing, Dimensity 9300+ enables users to take incredible photos and videos, even in low-light environments. Imagiq 990 has a built-in AI Semantic Analysis Video Engine to support advanced AI videography features including 16 scene segmentation with real-time video capture to reduce noise, increase brightness, and enhance colors. Additionally, the Dimensity 9300+ integrates MediaTek’s MiraVision 990, which has advanced AI depth engine technologies to enhance smartphone content.