UBTECH Robotics, a leading humanoid robotics company based in Shenzhen, China, has partnered with tech giant Baidu to integrate large language models (LLMs) into its humanoid robots. Through this partnership, UBTECH aims to enhance the capabilities of its humanoid robots like Walker S with Baidu powerful AI model, Ernie Bot.
Table of Contents
UBTECH Robotics
UBTECH is a leading player in the humanoid robotics field. They’re known for robots like the consumer-focused Walker series and the more advanced Cruzr service robot. Their robots are used in a wide array of applications, from education to retail and healthcare.
What is Baidu?
One of China’s leading technology giants, often compared to Google. Baidu boasts impressive artificial intelligence research and development capabilities. They have well-developed large language models (LLMs) like ERNIE, which could power advanced robot capabilities. The latest version, ERNIE 3.5 introduced the concept of plugins to extend the model’s abilities and connect to tools like Baidu Search for real-time information.
Demo Video of UBTECH Walker S Humanoid robot with Baidu ERNIE Bot
In a demo video released by UBTECH, the Walker S humanoid robot is shown folding clothes and sorting objects on a table. The robot relies on multi-modal perception to understand its spatial environment and tasks. It then communicates with Baidu’s ERNIE Bot, an AI assistant similar to ChatGPT, to interpret the tasks and plan the steps. Guided by ERNIE Bot, Walker S is able to precisely manipulate its arms and hands to fold the clothes and segregate the objects efficiently.
Key Features of UBTECH Walker S Humanoid Robot Enhanced by Baidu ERNIE Bot
Through its integration with Baidu generative AI assistant ERNIE Bot, the Walker S humanoid robot from UBTECH showcased several new key capabilities in its demo video:
1. Task Breakdown and Planning
ERNIE Bot is able to understand tasks linguistically, then methodically break down and plan the steps for Walker S to follow.
2. Soft Object Manipulation
Guided by ERNIE Bot’s planning, Walker S demonstrated intricate manipulation of soft objects like folding clothes with its dexterous hands.
3. Intelligent Task Management
Moreover, ERNIE Bot coordinates and oversees the end-to-end process, enabling Walker S to autonomously manage fulfilling tasks.
4. Semantic Understanding and Interaction
The robot gains the ability to understand language semantics and accordingly interact with humans or ERNIE Bot during task execution.
5. Multimodal Environment Understanding
Walker S leverages various sensors to perceive its surroundings in 3D and identify objects for autonomous operations like sorting.
6. VLM-Based Object 6D Pose Recognition
Additionally, Baidu ERNIE Bot assists Walker S in applying computer vision techniques to detect object poses precisely for motions.
7. Dynamic Interference Recovery
The UBTECH robot coordinates with the Baidu ERNIE Bot to update trajectories in real time and handle any interference during autonomous operations.
Benefits of the UBTECH and Baidu Partnership
The integration of advanced LLMs like ERNIE Bot brings significant benefits to humanoid robots. It helps robots gain deeper understanding of tasks from natural language instructions. Additionally, the AI model can plan out complex steps and guide the robot in carrying out the tasks smoothly. This reduces the need for manual programming and makes robots more versatile. Moreover, experts believe such partnerships represent the future of humanoid robot applications.
Future Plans of UBTECH
UBTECH aims to further integrate AI technologies into its robots over the next 2-3 years. The company plans to deploy Walker S models on production lines of electric vehicle manufacturers this year. Additionally, it will launch its first household companion robot by the end of 2024. While humanoid robots currently only make up a small portion of its revenue, UBTECH continues heavy investments in robotics R&D to advance the technology. Overall, the collaboration with Baidu will help accelerate these efforts to develop more capable humanoid robots.
| Also Read Latest From Us
- Forget Towers: Verizon and AST SpaceMobile Are Launching Cellular Service From Space

- This $1,600 Graphics Card Can Now Run $30,000 AI Models, Thanks to Huawei

- The Global AI Safety Train Leaves the Station: Is the U.S. Already Too Late?

- The AI Breakthrough That Solves Sparse Data: Meet the Interpolating Neural Network

- The AI Advantage: Why Defenders Must Adopt Claude to Secure Digital Infrastructure







