NVIDIA Eureka is an AI-driven agent designed to enhance robotic learning by autonomously generating reward algorithms that guide robots in mastering intricate skills. Utilizing OpenAI's GPT-4 large language model, Eureka creates software code that enables robots to learn through trial and error, significantly improving their performance in tasks such as pen spinning, opening drawers, and manipulating objects. This approach surpasses traditional human-authored programs, achieving over 50% performance improvement in more than 80% of evaluated tasks. Integrated with NVIDIA's Isaac Gym, a physics simulation platform, Eureka accelerates the training process by efficiently evaluating numerous reward candidates, facilitating rapid development of advanced robotic capabilities.

nvidia-eureka

An AI agent developed by NVIDIA that leverages GPT-4 to autonomously train robots in complex tasks through reinforcement learning.

NVIDIA Eureka

Roboto AI is an advanced platform tailored for robotics developers, enabling efficient management of complex sensor and log data. By supporting various data formats, including ROS and PX4, it facilitates seamless data ingestion, tagging, and visualization. The platform's robust features, such as custom actions for data processing and powerful multimodal search capabilities, empower users to analyze patterns, identify edge cases, and enhance collaboration through data sharing and annotation. Founded by former engineering leaders from Amazon Robotics and AWS, Roboto AI aims to accelerate the deployment of robots by using AI to streamline data processing.

roboto-ai

An AI-powered data engine designed to streamline the search, transformation, and analysis of multi-modal robotics data.

Roboto AI

NVIDIA Isaac is a comprehensive robotics development platform that provides a suite of tools, software development kits (SDKs), and simulation environments designed to accelerate the creation, testing, and deployment of AI-powered robots. The platform includes NVIDIA Isaac SDK for robot application development, Isaac Sim for realistic simulation and testing, and various hardware integrations to support advanced robotic functionalities. NVIDIA Isaac aims to streamline the robotics development process by leveraging NVIDIA's expertise in AI and high-performance computing, enabling developers to build sophisticated autonomous systems for a wide range of applications including manufacturing, healthcare, and service industries.

nvidia-isaac

NVIDIA Isaac is a comprehensive robotics development platform offering tools, SDKs, and simulation environments for building and deploying AI-powered robots.

NVIDIA Isaac

Code as Policies is a framework that leverages large language models (LLMs) to generate programs acting as policies for robotic control. By interpreting natural language commands, these models produce code that directs robots to execute complex tasks, integrating perception and control. This approach allows for the creation of both reactive and waypoint-based policies, facilitating advanced robotic behaviors across various platforms. The framework emphasizes the use of hierarchical code generation to manage intricate tasks, enhancing the adaptability and functionality of robotic systems.

code-as-policies

A framework utilizing language model-generated programs to enable robots to perform complex tasks through code-based policies.

Code as Policies

Founded in 2022 by Brett Adcock, Figure AI is a U.S.-based robotics company specializing in the development of AI-powered humanoid robots. Their flagship models, Figure 01 and the more advanced Figure 02, are designed to perform a wide range of manual tasks, particularly in sectors such as manufacturing, logistics, and warehousing. By combining advanced AI systems with human-like dexterity and mobility, Figure AI aims to address labor shortages and enhance operational efficiency across multiple industries.

figure-ai

A robotics company developing AI-powered humanoid robots designed to perform human-like tasks across various industries.

Figure AI

Founded in 2018, Sanctuary AI is a Vancouver-based company on a mission to create and deploy millions of industrial-grade humanoid robots to help address growing labor challenges. Their robots, powered by the proprietary AI control system Carbon™, are designed to mimic human movement and cognitive processes, enabling them to perform a wide range of tasks across industries such as automotive, manufacturing, and logistics. Sanctuary AI's approach focuses on developing general-purpose robots that can work alongside humans, enhancing safety, efficiency, and sustainability in the workplace.

sanctuary-ai

A company developing industrial-grade humanoid robots with human-like intelligence to address labor challenges across various industries.

Sanctuary AI

The OpenCV AI Kit (OAK) is an open-source ecosystem comprising hardware, firmware, and software designed to provide embedded spatial AI and computer vision functionalities. Powered by Intel's Myriad X Visual Processing Unit (VPU), OAK devices can run advanced neural networks for tasks such as image classification, object detection, segmentation, and depth estimation in real-time. The platform supports various models, including OAK-1, OAK-D, and OAK-D-Lite, each offering different features like 4K RGB cameras, stereo depth cameras, and USB or Power-over-Ethernet (PoE) connectivity. OAK aims to democratize access to spatial AI, enabling developers, researchers, and hobbyists to build and deploy AI-powered applications efficiently.

opencv-ai-kit-oak

An open-source hardware and software platform that integrates spatial AI and computer vision capabilities for real-time object detection and depth estimation.

OpenCV AI Kit (OAK)

YOLO (You Only Look Once) is a series of real-time object detection algorithms that utilize convolutional neural networks to detect and classify multiple objects within an image or video frame in a single evaluation. Introduced by Joseph Redmon et al. in 2015, YOLO reframes object detection as a single regression problem, significantly enhancing detection speed and accuracy compared to traditional methods. Over successive versions, YOLO has evolved to improve performance, efficiency, and adaptability, becoming a cornerstone in computer vision applications such as autonomous driving, surveillance, and robotics.

yolo-you-only-look-once

A real-time object detection algorithm that processes images in a single evaluation, enabling rapid and accurate identification of multiple objects within an image.

AI Agents for: robotics engineers