NVIDIA Corporation has introduced Wednesday its new compact generative AI supercomputer that offers superior performance at lower price.

Specifically, the company said the new NVIDIA Jetson Orin Nano Super Developer kit fits the palm of a hand but has more than enough for everyone to experience generative AI capabilities and performance. The kit is available at a tag price of US$249.

Suits Wide Range of Application

In an online media briefing, Deepu Talla, Vice President and General Manager of Robotics and Edge Computing at NVIDIA said the NVIDIA Jetson™ and Isaac™ platforms provide end-to-end solutions to develop and deploy AI-powered autonomous machines and edge computing applications. Specifically, they suit manufacturing, logistics, healthcare, smart cities, and retail.

“What we’re doing is we’re taking the existing Jetson Nano and we’re increasing the performance from 40 Tera operations per second to 67 Tera operations per second. That is a 70% performance increase,” said Talla.

Available starting Wednesday, it delivers as much as a 1.7x leap in generative AI inference performance. Thus, providing a 70 percent increase in performance to 67 INT8 TOPS, and a 50 percent increase in memory bandwidth to 102GB/s compared with its predecessor.

Moreover, the Jetson Orin Nano Super is an ideal solution, whether one would create LLM chatbots based on retrieval-augmented generation or in building a visual AI agent or even deploying AI-based robots.

Moreover, Talla said, the software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit.

Jetson Orin Nano Super suits well those interested in developing skills in generative AI, robotics, or computer vision. As the AI world is moving from task-specific models into foundation models, it also provides an accessible platform to transform ideas into reality.

The software updates to boost 1.7X generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules.

Powerful Performance With Super for Generative AI

The enhanced performance of the Jetson Orin Nano Super delivers gains for all popular generative AI models and transformer-based computer vision. Furthermore, the developer kit consists of a Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board, providing an ideal platform for prototyping edge AI applications.

The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions.

Generative AI is evolving quickly. The NVIDIA Jetson AI lab offers immediate support for those cutting-edge models from the open-source community and provides easy-to-use tutorials. Developers can also get extensive support from the broader Jetson community and inspiration from projects created by developers.

Jetson runs NVIDIA AI software including NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI and NVIDIA Holoscan for sensor processing. Development time can be reduced with NVIDIA Omniverse Replicator for synthetic data generation and NVIDIA TAO Toolkit for fine-tuning pretrained AI models from the NGC catalog.

Jetson ecosystem partners offer additional AI and system software, developer tools and custom software development. They can also help with cameras and other sensors, as well as carrier boards and design services for product solutions.

18 December 2024