{"id":609770,"date":"2023-02-19T07:49:06","date_gmt":"2023-02-19T13:49:06","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/02\/19\/toyota-research-institute-svp-on-the-difficulty-of-building-the-perfect-home-robot\/"},"modified":"2023-02-19T07:49:06","modified_gmt":"2023-02-19T13:49:06","slug":"toyota-research-institute-svp-on-the-difficulty-of-building-the-perfect-home-robot","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/02\/19\/toyota-research-institute-svp-on-the-difficulty-of-building-the-perfect-home-robot\/","title":{"rendered":"Toyota Research Institute SVP on the difficulty of building the perfect home robot"},"content":{"rendered":"
\n

Earlier this week<\/span>, the Toyota Research Institute opened the doors of its Bay Area offices to members of the media for the first time. It was a day full of demos, ranging from driving simulators and drifting instructors to conversations around machine learning and sustainability.<\/p>\n

Robotics, a longtime focus of Toyota\u2019s research division, were on display, as well. SVP Max Bajracharya showcased a pair of projects. First was something more along the lines of what one would expect from Toyota: an industrial arm with a modified gripper designed for the surprisingly complex task of moving boxes from the back of a truck to nearby conveyor belts \u2014 something most factories are hoping to automate in the future.<\/p>\n

The other is a bit more surprising \u2014 at least for those who haven\u2019t followed the division\u2019s work that closely. A shopping robot retrieves different products on the shelf based on bar codes and general location. The system is able to extend to the top shelf to find items, before determining the best method for grasping the broad range of different objects and dropping them into its basket.<\/p>\n

The system is a direct outgrowth of the 50-person robotics team\u2019s focus on eldercare, aimed at addressing Japan\u2019s aging population. It does, however, represent a pivot away from their original work of building robots designed to execute household tasks like dishwashing and food prep.<\/p>\n

You can read a lengthier writeup of that pivot in an article published on TechCrunch earlier this week<\/a>. That was drawn from a conversation with Bajracharya, which we\u2019re printing in a more complete state below. Note that the text has been edited for clarity and length.<\/p>\n

\n

<\/p>\n

Image Credits:<\/strong> Brian Heater<\/p>\n<\/div>\n

TechCrunch: I was hoping to get a demo of the home robot.<\/strong><\/p>\n

Max Bajracharya: We are still doing some home robot stuff[\u2026] What we\u2019ve done has shifted. Home was one of our original challenge tasks.<\/p>\n

Eldercare was the first pillar.<\/strong><\/p>\n

Absolutely. One of the things that we learned in that process is that we weren\u2019t able to measure our progress very well. The home is so hard. We pick challenge tasks because they are hard. The problem with the home is not that it was too hard. It was that it was too hard to measure the progress we were making. We tried a lot of things. We tried procedurally making a mess. We would put flour and rice on the tables and we would try to wipe them up. We would put things throughout the house to make the robot tidy. We were deploying into Airbnbs to see how well we were doing, but the problem is we couldn\u2019t get the same home every time. But if we did, we would overfit to that home.<\/p>\n

Isn\u2019t that ideal that you don\u2019t get the same home every time?<\/strong><\/p>\n

Exactly, but the problem is we couldn\u2019t measure how well we were doing. Let\u2019s say we were a little better at tidying this one house, we don\u2019t know if that\u2019s because our capabilities got better or if that house was a little easier. We were doing the standard, \u201cshow a demo, show a cool video. We\u2019re not good enough yet, here\u2019s a cool video.\u201d We didn\u2019t know whether we were making good progress or not. The grocery challenge task where we said, we need an environment where it\u2019s as hard as a home or has the same representative problems as a home, but where we can measure how much progress we\u2019re making.<\/p>\n

You\u2019re not talking about specific goals to either the home or supermarket, but solving for problems that can span both of those places.<\/strong><\/p>\n

Or even just measure if we\u2019re pushing the state of the art in robotics. Are we able to do the perception, the motion planning, the behaviors that are, in fact, general purpose. To be totally honest, the challenge problem kind of doesn\u2019t matter. The DARPA Robotics Challenges, those were just made-up tasks that were hard. That\u2019s true of our challenge tasks, too. We like the home because it is representative of where we eventually want to be helping people in the home. But it doesn\u2019t have to be the home. The grocery market is a very good representation because it has that huge diversity.<\/p>\n

\n

<\/p>\n

Image Credits:<\/strong> Brian Heater<\/p>\n<\/div>\n

There\u2019s a frustration, though. We know how difficult these challenges are and how far off things are, but some random person sees your video, and suddenly it\u2019s something that\u2019s just over the horizon, even though you can\u2019t deliver that.<\/strong><\/p>\n

Absolutely. That\u2019s why Gill [Pratt] says every time, \u2018reemphasize why this is a challenge task.\u2019<\/p>\n

How do you translate that to normal people? Normal people aren\u2019t hung up on challenge tasks.<\/strong><\/p>\n

Exactly, but that\u2019s why in the demonstration you saw today, we tried to show the challenge tasks, but also one example of how you take capabilities that come out of that challenge and apply it to a real application like unloading a container. That is a real problem. We went to factories and they said, \u2018yes, this is a problem. Can you help us?\u2019 And we said, yeah, we have technologies that apply to that. So now we\u2019re trying to show coming out of these challenges are these couple of few breakthroughs that we think are important, and then apply those to real applications. And I think that that\u2019s been helping people understand that, because they see that second step.<\/p>\n

How large is the robotics team?<\/strong><\/p>\n

The division is about 50 people evenly split between here and Cambridge, Massachusetts.<\/p>\n

You have examples like Tesla and Figure, which are trying to make all-purpose humanoid robots. You seem to be heading in a different direction.<\/strong><\/p>\n

A little bit. Something we\u2019ve observed is that the world is built for humans. If you\u2019ve just got a blank slate, you\u2019re saying I want to build a robot to work in human spaces. You tend to end in human proportions and human-level capabilities. You end with human legs and arms, not because that\u2019s the optimal solution, necessarily. It\u2019s because the world has been designed around people.<\/p>\n

\n

<\/p>\n

Image Credits:<\/strong> Toyota Research Institute<\/p>\n<\/div>\n

How do you measure milestones? What does success look like for your team?<\/strong><\/p>\n

Moving from the home to the grocery store is a great example of that. We were making progress on the home but not as fast and not as clearly as when we move to the grocery store. When we move to the grocery store, it really becomes very evident how well you\u2019re doing and what the real problems are in your system. And then you can really focus on solving those problems. When we toured both logistics and manufacturing facilities of Toyota, we saw all of these opportunities where they\u2019re basically the grocery shopping challenge, except a little bit different. Now, the part instead of the parts being grocery items, the parts are all the parts in a distribution center.<\/p>\n

You hear from 1,000 people that you know, home robots are really hard, but then you feel like you have to try for yourself and then you like, really, you make all the same mistakes that they did.<\/strong><\/p>\n

I think I\u2019m probably just as guilty as everybody else. It\u2019s like, now our GPUs are better. Oh, we got machine learning and now you know we can do this. Oh, okay, maybe that was harder than we thought.<\/p>\n

Something has to tip it at some point.<\/strong><\/p>\n

Maybe. I think it\u2019s going to take a long time. Just like automated driving, I don\u2019t think there\u2019s a silver bullet. There\u2019s not just like this magical thing, that\u2019s going to be \u2018okay, now we solved it.\u2019 It\u2019s going to be chipping away, chipping away, incrementally. That\u2019s why it\u2019s important to have that kind of roadmap with the shorter timelines, you know, shorter or shorter milestones that give you the little wins, so you can keep working at it to really achieve that long-term vision.<\/p>\n

What\u2019s the process for actually productizing any of these technologies?<\/strong><\/p>\n

That\u2019s a very good question that we are ourselves trying to answer. I believe we kind of understand the landscape now. Maybe I was na\u00efve in the beginning thinking that, okay, we just need to find this this person that we\u2019re going to throw the technology over to a third party or somebody inside of Toyota. But I think we\u2019ve learned that, whatever it is \u2014 whether it\u2019s a business unit, or a company, or like a startup or a unit inside of Toyota \u2014 they don\u2019t seem to exist. So, we are trying to find a way of creating and I think that\u2019s the story of TRI-AD, a little bit as well. It was created to take the automated driving research that we were doing and translate into something that was more real. We have the same problem in robotics, and in many of the advanced technologies that we that we work on.<\/p>\n

\n

<\/p>\n

Image Credits:<\/strong> Brian Heater<\/p>\n<\/div>\n

You\u2019re thinking about potentially getting to a place where you can have spinoffs.<\/strong><\/p>\n

Potentially. But it\u2019s not the main mechanism by which we would commercialize the technology.<\/p>\n

What is the main mechanism?<\/strong><\/p>\n

We don\u2019t know. The answer is the diversity of things that we\u2019re doing is very likely going to be different for different groups.<\/p>\n

How has TRI changed since its foundation?<\/strong><\/p>\n

When I first started, I feel like we were very clearly just doing research in robotics. Part of that is because we were just so very far away from the technology being applicable to almost any real-world challenging application in a human environment. Over the last five years, I feel like we\u2019ve made enough progress in that very challenging problem that we are now starting to see it turn into these real-world applications. We have consciously shifted. We\u2019re still 80% pushing the state of the art with research, but we\u2019ve now allocated maybe 20% of our resources to figuring out if that research is maybe as good as we think it is and if it can be applied to real-world applications. We might fail. We might realize we thought we made some interesting breakthroughs, but it\u2019s not anywhere near reliable or fast enough. But we\u2019re putting 20% of our effort toward trying.<\/p>\n

How does eldercare fit into this?<\/strong><\/p>\n

I would say, in some ways, it\u2019s still our north star. The projects are still looking at how we ultimately amplify people in their homes. But over time, as we pick these challenge tasks, if things trickle out that are applicable to these other areas, that\u2019s where we\u2019re using these short-term milestones to show the progress in the research that we\u2019re making.<\/p>\n

How realistic is the possibility of a fully lights-out factor?<\/strong><\/p>\n

I think if you were able to start from scratch in maybe in the future, that might be a possibility. If I look at manufacturing today, specifically for Toyota, it seems very unlikely that you could get anywhere close to that. We [told factory workers], we\u2019re building robotic technology, where do you think it could apply? They showed us many, many processes where it was things like, you take this wire harness, you feed it through here, then you pull it out here, then you clip it here, and you clip it here, and you take it here, and you take it here, and then you run it like this. And this takes a person five days to learn the skill. We were like, \u2018yeah, that\u2019s way too hard for the robotic technology.\u2019<\/p>\n

But the things that are the most difficult for people are the ones you would want to automate.<\/strong><\/p>\n

Yes, difficult or potentially injury prone. For sure, we would like to make stepping stones to get to that eventually, but where I see robotic technology today, we\u2019re quite far away from that.<\/p>\n<\/p><\/div>\n

Read More<\/a>
\n Brian Heater<\/p>\n","protected":false},"excerpt":{"rendered":"

Earlier this week, the Toyota Research Institute opened the doors of its Bay Area offices to members of the media for the first time. It was a day full of demos, ranging from driving simulators and drifting instructors to conversations around machine learning and sustainability. Robotics, a longtime focus of Toyota\u2019s research division, were on<\/p>\n","protected":false},"author":1,"featured_media":609771,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3801,46,23030],"tags":[],"class_list":{"0":"post-609770","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-research","8":"category-technology","9":"category-toyota"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/609770","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=609770"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/609770\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/609771"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=609770"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=609770"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=609770"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}