The agent is based on research by Sony\u2019s AI researchers and Polyphony Digital\u2019s developers and it fits Gran Turismo\u2019s mission of being the most realistic racing simulation game.<\/p>\n

The PlayStation 5 agent was trained on a neural network and moved from a research project to its commercial release after two years of work. It learns the best way to drive through reinforcement training, and then it\u2019s ready to take on humans. The aim isn\u2019t just to put on a good show, as with many racing games. The mission is to create AI that will challenge and even beat the best human racers.<\/p>\n

\u201cFor the first time, actually, this is a really competitive AI. The built-in AI has been part of Gran Turismo since the start of the franchise,\u201d said Michael Spranger, chief operating officer of Sony AI, in an interview with GamesBeat. \u201cBut that AI is a very narrow band. It is an intermediate AI that is too weak to train against humans. It takes some time actually to build an AI that is able to compete at the highest level. And that\u2019s what we did. And that\u2019s based on a technique called reinforcement learning.\u201d<\/p>\n

<\/p>\n

Event<\/h3>\n
\n
GamesBeat Summit 2023<\/p>\n
Join the GamesBeat community in Los Angeles this May 22-23. You\u2019ll hear from the brightest minds within the gaming industry to share their updates on the latest developments.<\/p>\n<\/div>\n

\n Register Here <\/a>\n <\/p>\n<\/div>\n
<\/body><\/p>\n
Gran Turismo Sophy Race Together is a new mode gives Gran Turismo players of all levels and abilities the opportunity to go head-to-head against GT Sophy in GT7. The special mode, available as a time-limited in-game event, is a first look at GT Sophy in GT7 and is designed to maximize the fun and excitement of racing against GT Sophy for everyone.<\/p>\n
A history of so-so AI<\/h2>\n
GT Sophy is on the track to beat human drivers.<\/figcaption><\/figure>\n
AI is nothing new to racing, as it\u2019s been around for the whole 25-plus year history of the Gran Turismo racing franchise, as players race against AI-driven cars. But this kind of AI is different and more adaptive to the racing situation.<\/p>\n
\u201cPrior AI, which has been mostly the same for the last 20 years, tries to follow a line and a particular trajectory. So it\u2019s trying to hit certain speeds at certain points,\u201d said Peter Wurman, director of Sony AI America and project lead on GT Sophy, in an interview with GamesBeat. \u201cAnd it\u2019s very predictable. And it\u2019s not nearly fast enough for really good (human) drivers.\u201d<\/p>\n
A modern AI approach<\/h2>\n
Gran Turismo Sophy works with multiple tracks.<\/figcaption><\/figure>\n
This mission was a lot more ambitious. Sophy is named after Sophia, the Greek word for wisdom. And it is a combo of Sony and Polyphony Digital.<\/p>\n
\u201cThe overall challenge was to train an AI agent that could race against the best players in the world and beat them,\u201d Wurman said. \u201cIt involves technical challenges on driving of course but also dealing with the balance between being assertive and aggressive in the sense of trying to pass but also adhering to the rules of sportsmanship.\u201d <\/p>\n
Spranger said that traditional AI in games probably had cheats that the developers used to make the racing more exciting for players. But in Gran Turismo, the AI has access to the same physics of the game as a human. <\/p>\n
Kazunori Yamauchi, creator of the franchise and CEO of Polyphony Digital, is basically a racing fanatic who wants the game to be real. This is not to say that the game\u2019s past AI was bad. Yamauchi has focused the game on realism for its entire history and he is still working on it today. Yamauchi worked with Sony AI on this project, which is more ambitious in its goals.<\/p>\n
For aficionados of racing games, the use of cheats to fake the intelligence of AI is easily detected.<\/p>\n
\u201cPeople are not stupid, right? So if you cheat, people will notice. Suddenly, this car, which was very slow before, comes up behind me within a matter of a few seconds,\u201d Spranger said. \u201cIn order to create a real racing experience, it\u2019s very important that the AI really has the same access to the physics and it\u2019s not like some privileged access, where you can sort of go around the corner faster than you might ever do.\u201d<\/p>\n
The tough part is when cars are evenly matched, you might try to hold a driving line and beat the other car by blocking the path forward while going around a curve. A good driver might draft in a slipstream behind a racer, gaining additional speed, and wait for the chance to pass, either on the inside or outside.<\/p>\n
\u201cIf you do it really well and they go wide, you can cut on the inside and then pass,\u201d he said.<\/p>\n
AI reinforcement training<\/h2>\n
Sony AI and Polyphony Digital went from a Nature paper to a commercial release in a year.<\/figcaption><\/figure>\n
Neural networks started working well about a decade ago, incorporating graphics processing unit (GPU) technology to handle AI processing. That general trend has unlocked many potential applications for deep learning neural network AI that wasn\u2019t previously possible for apps such as computer vision.<\/p>\n
With today\u2019s computing power, these networks can be trained to learn tasks and improve over time. <\/p>\n
\u201cReinforcement learning has unlocked the potential for this application. There may be other ways of approaching this,\u201d Wurman said. \u201cThere is also an academic research community working on autonomous racing and so on. And this is really the first time I think that we were able to show the superhuman simulations in the real world, as it is a very real physical simulation.\u201d<\/p>\n
Reinforcement training is a trial-and-error process. Designing the training took a couple of years, but the actual training took about two weeks or so with 20 PlayStation 5 consoles, Wurman said.<\/p>\n
The company used a cloud infrastructure for training the agents to scale the experience that agents have. It collaborated with Sony Interactive Entertainment\u2019s infrastructure teams on that. Sony AI has about 120 employees working on AI projects in Japan, Switzerland and North America.<\/p>\n
\u201cExactly one year ago, we had a very big scientific breakthrough,\u201d Spranger said. \u201cAnd that breakthrough is actually training, or reinforcement, for any agent to drive competitively against the best human drivers in Gran Turismo.\u201d<\/p>\n
The challenge of making it real<\/h2>\n
Can you beat an AI driver trained to have the best skills?<\/figcaption><\/figure>\n
\u201cThe agent Gran Turismo Sophy has to master different skills. These skills make it different from other AI breakthroughs in this space. And the key thing that is different, for instance, from other kinds of game AI breakthroughs in the past, is the physical realism of the game. Gran Turismo is an extremely realistic physical simulation of racing. <\/p>\n
In fact, there are people who are race drivers who started learning about racing by driving in Gran Turismo first. That\u2019s what Sony is making a movie about based on the Gran Turismo franchise. <\/p>\n
Pro racers actually use \u201cracing sleds\u201d with steering wheels and pedals, with a big screen in front of them. Some players have gone on to become real racecar drivers. Of course, learning this way is easier as there are no g-forces in a car simulation in comparison to real racing.<\/p>\n
\u201cIt still requires this intense amount of concentration for long periods of time,\u201d Wurman said.<\/p>\n
The results could vary, based on the drivers themselves as well as tracks and road conditions.<\/p>\n
Early in the process, advisers at Polyphony Digital gave the AI team pointers on really good driving. The devs also offered feedback over time, Wurman said.<\/p>\n
The agent has to master driving a car at the edge of control. Racing is basically pushing the car almost over the edge of losing control. And the agent was able to master that. <\/p>\n
So the second thing to master is the intricate physical change that happens when you have opponents on the track. <\/p>\n
If you\u2019re driving behind a car your top speed gets higher, but you might also take longer for braking and you have to deal with sudden changes between other objects on the track, especially your opponents. <\/p>\n
And if you want to overtake especially humans, it involves a kind of action and reaction back and forth. If the AI makes a move, a human isn\u2019t just going to let you pass. Also important is being collaborative. You can\u2019t just bump into other cars. On a racetrack in real life, such behavior makes the difference between life and death, Spranger said. Driving safely and aggressively requires an intelligent balance. <\/p>\n
\u201cIt\u2019s about avoiding hitting other cars,\u201d he said. You need to drive aggressively, or others will just take advantage of you. We train progressively for the AI to make better and better decisions in the game. Relatively quickly the agent becomes a good driver. And it takes more time for the agent to become a top driver.\u201d<\/p>\n
The cars also have slightly different performance characteristics. And there are different levels of performance for neophytes to experts. GT Sophy operates at a disadvantage at the beginner level, and it levels out as you get closer to the expert.<\/p>\n
\u201cIn the last mode, you actually have exactly the same car as another GT Sophy driver so you can really try yourself against a superhuman agent,\u201d he said. <\/p>\n
How it works in Gran Turismo 7<\/h2>\n
$\"Wet.\"$
Wet.<\/figcaption><\/figure>\n
In GT Sophy Race Together mode, players can race against GT Sophy in a series of four circuits of increasing difficulty, as a Beginner \/ Intermediate \/ Expert driver. In each of the four races, the player races against four GT Sophy cars of different performance levels. <\/p>\n
Players can also challenge GT Sophy in 1VS1 mode, where GT Sophy and the player race one-on-one with identical car configurations and settings, which showcases the superhuman racing skills of GT Sophy. The excitement of GT Sophy Race Together Mode is enhanced with GT7\u2019s new emoticon feature, which displays emoticons on the GT Sophy cars throughout the race to react to the in-game action.<\/p>\n
The GT Sophy Race Together mode, part of the 1.29 update for GT7, arrives on February 20 at 10 p.m. Pacific time and is available until the end of March. The mode can be accessed directly from the top right panel on the GT7 World Map, and the player can start a race against GT Sophy once the player has reached Collector Level 6. <\/p>\n
This is the first of an ongoing series of GT Sophy features that will appear in GT7. Over the past couple of years, Sony AI, in partnership with PDI, has continued to evolve GT Sophy\u2019s capabilities and work toward the goal of making it accessible to the greater Gran Turismo community. <\/p>\n
Player feedback on this initial special feature will be used to continually improve the GT Sophy Race Together mode feature for future releases. Wurman is excited to hear the feedback once millions of game fans have used GT Sophy. <\/p>\n
Sony AI talked about the agent research in a February 2022 issue of the journal Nature. Sony AI Inc. was founded on April 1, 2020, with the mission to \u201cunleash human imagination and creativity with AI.\u201d <\/p>\n
Where AI is going<\/h2>\n
Sony AI hopes to take reinforcement training to new levels across Sony. <\/figcaption><\/figure>\n
Sony is working on a variety of AI technologies beyond racing simulations.<\/p>\n
Sony AI aims to combine research and development of artificial intelligence with Sony Group\u2019s imaging and sensing technology, robotics technology, and entertainment assets such as movies, music, and
games to accelerate Sony\u2019s transformation into an AI-powered company and to create new business opportunities. <\/p>\n
To achieve this, Sony AI has launched four flagship projects to date aimed at the evolution and application of AI technology in the areas of gaming, imaging and sensing, gastronomy, and AI ethics.<\/p>\n
The company eventually hopes to make use of the tech in the Gran Turismo version for the virtual reality experience of the PlayStation VR<\/a> 2 headset, which debuts on February 22.<\/p>\n
Can they put the GT Sophy racing agent into a real car and make it into a self-racing vehicle? Not yet. <\/p>\n
So where does the AI go from here? Spranger said the teams will keep working on the technology for the future and perhaps bring it to other games. Sony is also doing autonomous driving research for real-world cars, and it\u2019s also launching its own Afeela car<\/a> in partnership with Honda in 2026.<\/p>\n
\u201cFor general reinforcement learning, I do think it\u2019s going to unlock next-generation gaming experiences in the future,\u201d Spranger said. \u201cFor Sony, in general, I think AI is a key technology in those areas from sensing to the virtual world and back. And I think we can be a great contributor to technology advances in this space. That\u2019s the mission the CTO of Sony (Toru Katsumoto) gave us.\u201d<\/p>\n
GamesBeat’s creed<\/strong> when covering the game industry is “where passion meets business.” What does this mean? We want to tell you how the news matters to you — not just as a decision-maker at a game studio, but also as a fan of games. Whether you read our articles, listen to our podcasts, or watch our videos, GamesBeat will help you learn about the industry and enjoy engaging with it. Discover our Briefings.<\/a><\/p>\n<\/p><\/div>\n
Read More<\/a>
\n Dean Takahashi<\/p>\n","protected":false},"excerpt":{"rendered":"
The agent is based on research by Sony\u2019s AI researchers and Polyphony Digital\u2019s developers and it fits Gran Turismo\u2019s mission of being the most realistic racing simulation game.The PlayStation 5 agent was trained on a neural network and moved from a research project to its commercial release after two years of work. It learns the<\/p>\n","protected":false},"author":1,"featured_media":610397,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22301,22951,46],"tags":[],"class_list":{"0":"post-610396","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-breakthrough","8":"category-racing","9":"category-technology"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/610396","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=610396"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/610396\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/610397"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=610396"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=610396"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=610396"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}