TAI AHR #01 - AI in Hardware and Robotics
Note: the location is at the bottom of this page (Ebisu Business Tower, Floor 12).
Topic
Join us for a deep dive into the topic of AI in hardware and robotics. Our speakers will cover key topics including the latest advancements in multimodal AI for enhanced machine perception, integrated task and motion planning for robots in dynamic environments, the innovative field of soft robotics, and the evolving landscape of surgical robotics.
Our Community
Tokyo AI (TAI) is a community composed of people based in Tokyo and working with, studying, or investing in AI. We are engineers, product managers, entrepreneurs, academics, and investors intending to build a strong “AI coreˮ in Tokyo. Find more in our overview: https://bit.ly/tai_overview
Schedule
17:30 - 18:00 Doors open
18:00 - 18:25 Multimodal SLMs at the Embedded Edge for Machine Perception Applications (Colin Mason)
18:30 - 18:55 Task and Motion Planning for Long-Horizon Manipulation Tasks (Jeremy Siburian)
[19:00 - 19:45 Break + Food (if sponsor available)]
19:45 - 20:10 Soft Robotics: Biomimicry, Fluid Computers, and More (Russ Islam)
20:15 - 20:40 The Next Evolution of Surgical Robotics (Joseph Isosaki)
21:00 End
Speakers
Colin Mason (profile)
Title: Multimodal SLMs at the Embedded Edge for Machine Perception Applications
Abstract: A summary of recent discussions on the state of some of the current developments and trends regarding on-device generative AI and Multimodal Small Language Models (MSLMs), and looking at how this can bring enhanced perception to machines that interact with humans along with enabling better and more useful responses. This involves the compact implementation of MLLMs as SLMs on the deep edge, taking input from various sensors of image, sound, and other sources, along with contextual information, to deliver superior perception based on data fusion. Also discussed is the issue of where that fusion should take place and the benefits of a “shift left”. This all more efficiently provides the analysis and understanding needed to deliver more useful and accurate responses in support of a machine’s human interlocutors taking into account the key issues of privacy/security, latency, and power consumption. Particular examples in the fields of Smart Mobility, Smart Living, and Smart Health will be used to illustrate the possibilities.
Bio: Colin has over 40 years as a technology professional with a background in engineering, management, sales, marketing, and operations. With more than 25 years of experience in Japan, he has worked for MNCs and startups in various industries, including semiconductors, electronics, mobile, smart grid, wireless, and software (including embedded systems, EDA, enterprise SaaS, and apps). He holds a degree in Engineering Science from the University of Edinburgh and a diploma in Japanese from the School of Oriental and African Studies, University of London. He is a Chartered Engineer and a Member of the UK’s Institute of Engineering Technology, with three granted patents in the areas of solid-state disk and data security. His current role is as Regional Director BeEmotion.AI, a provider of Human Behavioural Analytics AI. The company is an Australian-owned startup with technology development in Switzerland as a spin-out from EPFL, Lausanne.
Jeremy Siburian (Profile)
Title: Task and Motion Planning for Long-Horizon Manipulation Tasks
Abstract: To fully integrate robots into household settings, they must be capable of autonomously planning and executing diverse tasks in dynamic environments. In such cases, the robot would need to simultaneously and continuously plan for a high-level sequence of actions and the corresponding low-level motions that must be executed to achieve a given goal. This talk will provide a basic introduction to the field of Integrated Task and Motion Planning (TAMP) in robotics. We will also dive into recent research efforts in TAMP which combine AI-based task planners with robot motion planning frameworks towards solving real-world manipulation tasks, such as cooking.
Bio: Jeremy is an undergraduate researcher at Waseda University. Jeremy was previously a Robotics Research Intern at OMRON SINIC X and a Plant Automation Intern at Daimler Trucks Asia. His research interest focuses on robot learning and manipulation.
Russ Islam (profile)
Title: Soft Robotics: Biomimicry, Fluid Computers, and More
Abstract: Soft robotics is a rapidly growing field with exciting potential applications for human-robot interaction, medicine, and other domains. In this talk, we’ll explore the flexible, compliant materials and actuators that make robots “soft”, and delve into examples of biomimicry. We’ll also examine cutting-edge research on microfluidics-based computers and colloidal robotics, two promising paths toward ever-smaller robots.
Bio: Russ conducts theoretical research on condensed matter (soft and active matter), including reinforcement learning for condensed matter applications. He was an early employee or cofounder/CTO at three startups spanning robotics, computer vision, and IoT. Russ graduated from Stanford with a BS and MS in electrical engineering (optimization and control) and will start a PhD in physics at the University of Tokyo next year.
Joseph Isosaki (profile)
Title: The Next Evolution of Surgical Robotics & Humanoid Robotics
Abstract: The progression of surgery from analog (manual) to digital (Robotically Enabled) is a highly nuanced innovation journey that few fully grasp.
Unless we have a full understanding of past innovations in robotic surgery it's difficult to advance new solutions that provide legitimate value to customers…. leaving a trail of failed robotics startups by the wayside.
The emphasis of this discussion will focus on the Sigmoid Curve of Adoption, and how startups must center their Innovation Trifecta to progress meaningful innovation.
We’ll then explore the untold history of how robotic surgery took the world by storm and implications for the progression of humanoid robotics development, commercialization and adoption.
Bio: I Help Engineers, Global Leaders and Entrepreneurs find their Way
🫀MedTech Innovation 🧙♂️Master Storyteller 🪡Network Weaver 💡Strategic Vision ⛩️Japan Market Access 🤖Robotic Surgery 🔮AR/VR 🏋️♂️Stay@Home Dad of 4
I'm a Global MedTech Entrepreneur with over a decade of JNJ experience advancing Surgical Robotics, AR, VR, and Digital Ecosystems. Interdisciplinary experience spanning Design Engineering, Robotics Controls Engineering, Systems Engineer, Global Strategic Marketing, and Directing Front End Innovation Japan.
Target Audience
Technical background with some knowledge of AI, but not necessarily in-depth knowledge of Hardware or Robotics.
Organizers - alphabetic order
Russ Islam: Researcher on condensed and soft matter physics and reinforcement learning at the University of Tokyo, former robotics engineer and IoT entrepreneur. BS/MS in electrical engineering from Stanford.
Joseph Isosaki: Global MedTech Entrepreneur with over a decade of JNJ experience advancing Surgical Robotics, AR, VR, and Digital Ecosystems. Interdisciplinary experience spanning Design Engineering, Robotics Controls Engineering, Systems Engineer, Global Strategic Marketing, and Directing Front End Innovation Japan.
Apurv Saha: Researcher at Tokyo Institute of Information Technology, Working on fusing SLAM with vision language models for autonomous navigation of robots.
Stefano Zangiacomi: ISP and camera tuning engineer at Forvia working on designing cameras and image quality tuning for autonomous driving applications. Previously Camera NPI and Optical engineer at Valeo. MSc in Optical Engineering at Institut d’Optique graduate school and MSc double degree in Quantum Physics at Paris-Saclay University.