Cover Image for Seeed Embodied AI Hackathon
Cover Image for Seeed Embodied AI Hackathon
118 Went
Private Event

Seeed Embodied AI Hackathon

Hosted by Jennie Wang & 8 others
Registration
Past Event
Welcome! To join the event, please register below.
About Event

Build Transformers and Diffusers Powered Robots with LeRobot

Hugging Face's LeRobot open-source framework, combined with NVIDIA AI and robotics technology, enables researchers and developers to drive advancements in AI robotics. Join our weekend hackathon at Circuit Launch in Mountain View!

Event Overview

  • Explore imitation learning with the open-source SO-ARM100 robotics arm kit

  • Utilize Hugging Face's LeRobot framework for advanced AI architectures like ACT and Diffusion Policy

Calling developers, engineers, and robotics enthusiasts eager to explore advanced AI and robotics.

Hands-on Experience Includes:

  1. Working with the SO-ARM100, a powerful 6DoF robotics arm designed for quick assembly, synchronized teaching tasks, and seamless integration with Hugging Face's LeRobot platform.

  2. Collecting data through teleoperation and simulation in NVIDIA Issac Lab.

  3. Training robot policies with imitation learning and developing validated policies on real-world robots powered by NVIDIA Jetson for real-time inference.

🎉🎉 Winner Prize

1st team: 2x bundles, each bundle includes 1x SO-ARM100 Kit and 1x NVIDIA Orin Nano Super Developer Kit

2nd team: 5x $100 shopping coupon for Seeed Studio bazaar

3rd team: 5x reCamera AI cameras


Hackathon Workflow

The planned collaborative workflow involves collecting data through teleoperation and simulation in Issac Lab, and storing them in the standard LeRobot Dataset format. Then they'll be used to train a robot policy with imitation learning, which is subsequently evaluated in simulation. Finally, the validated policy is deployed on real-world robots with NVIDIA Jetson for real-time inference.

We'd like to see you complete the LeRobot getting-started part by following the next steps, and also create the coolest application demo video using LeRobot to perform creative tasks :

  1. Assembled two arms using SO-ARM100 robotics arm kit and 3D printed parts

  2. Setting up imitation learning environments

  3. Data acquisition and training

  4. Deploying tasks on dual robotic arm

  5. Deploy the validated model using NVIDIA Jetson Orin

Then more tasks built upon the getting-started part would be even better:

  • Build with reCamera, such as start performing a task(pour coffee/tidy up desk, etc) by recognizing a dedicated situation through reCamera

  • Voice command controls robot arm movements with reSpeaker

Propose your task ideas, let's see how we can help and discuss further!

⏰ Timeline

Saturday

  • ​10:00 AM: Check-in & Kickoff

  • ​12:00 PM: Lunch

  • ​6:00 PM: Dinner

  • ​8:00 PM: Quiet Hours

Sunday

  • ​8:00 AM: Breakfast

  • ​12:00 PM: Lunch

  • ​4:00 PM: Demos & Snacks & Networking

We’ll conclude the hackathon with a demo session showcasing the technical projects participants have built—no company pitches.

If you’re attending only the demo session, please indicate this during signup so we can plan for food.

What We Provide

  1. SO-ARM100 Low-Cost AI Arm Kit:

    • Includes servo motors, control board, power supply, and cables

    • 6DoF robotic arm with leading and following arms

    • 3D-printed components for participants

  2. reComputer J4012 Powered by Jetson Orin NX 16GB:

    • compact and powerful computing platform for model deployment

  3. reCamera:

    • Tiny AI camera in modular design, with customizable base-board, Linux-based OS, and Node-RED integration for no-code development

  4. reSpeaker:

    • Integrates voice processing and audio playback to be a smart voice assistant

  5. Online Resources and tech support in-person:

    • Assembly, calibration, teleoperation, and more steps are available on our wiki

If you have any questions in mind, feel free to contact us anytime via email: edgeai@seeed.cc

What You'll Learn:

  • Assembly and Calibration: Get hands-on with assembling and fine-tuning the robotic arm

  • Collecting real-world robot data through teleoperation

  • Access NVIDIA Issac Lab to accelerate LeRobot's data collection, training, and verification workflow

  • Generated motion data is then used to train a policy with imitation learning


The Robotics Community Thrives When We Build Together

Join forces with LeRobot, NVIDIA, and Seeed Studio to explore building advanced robotic arms and accelerate research and innovation in AI robotics.

LeRobot, developed by Hugging Face, extends the successful paradigms from its  Transformers and Diffusers libraries into the robotics domain. LeRobot offers a comprehensive suite of tools for sharing data collection, model training, and simulation environments along with designs for low-cost manipulator kits.

NVIDIA’s AI technology, simulation, and open-source robot learning modular framework such as NVIDIA Isaac Lab can accelerate LeRobot’s data collection, training, and verification workflow. Researchers and developers can share their models and datasets built with LeRobot and Isaac Lab, creating a data flywheel for the robotics community.

Hackster.io is a dynamic community for makers and developers, where you can explore and collaborate on exciting hardware and software projects. Known for its focus on DIY electronics, IoT, and robotics, Hackster is the perfect platform to dive into hands-on experiences, enabling collaborations and knowledge-sharing with cutting-edge technologies such as edge computing, robotics, and physical AI.

Seeed is a global leader in open hardware innovation and an NVIDIA Elite Partner, We specialize in cutting-edge open hardware platforms. We aim to democratize technology through IoT and AI, empowering developers worldwide to break barriers in hardware innovation.

Location
Circuit Launch
599 Fairchild Dr, Mountain View, CA 94043, USA
118 Went