'

Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology for PlayStation 5

This feature could push the PlayStation 5's performance to new heights

Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology

Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology

Sony has patented a machine learning algorithm which could deliver the console manufacturer higher fidelity visuals at a lower performance cost, using image reconstruction to provide similar results to Nvidia's DLSS tech. 

The future of gaming will not be focused on pure resolution numbers. With techniques like Temporal upsampling, checkerboard rendering and DLSS 2.0, we already know that high-quality images can be produced with non-native pixel counts, and as reconstruction technologies continue to improve, native rendering will quickly become irrelevant. 

With DLSS 2.0, Nvidia has already shown us the potential of Machine Learning enhanced image reconstruction techniques, enabling higher performance levels with image quality levels that can sometimes exceed native resolution rendering. With this in mind, it is easy to see why game developers, console manufacturers and publishers are investing in similar techniques. 

Unfortunately, the full patent is only available in Japanese, but here is an English abstract from the document. This patent was uncovered by zerobfchallange on Reddit. 
 
An information processing device for acquiring a plurality of reference images obtained by imaging an object that is to be reproduced, acquiring a plurality of converted images obtained by enlarging or shrinking each of the plurality of reference images, executing machine learning using a plurality of images to be learned, as teaching data, that include the plurality of converted images, and generating pre-learned data that is used for generating a reproduction image that represents the appearance of the object.

  
Reconstruction techniques allow game developers to increase the graphical quality of their games when upscaling their titles from lower than native resolutions. If reconstruction techniques become effective enough, gamers will find it difficult to tell the difference between reconstructed images and native images. Reconstruction will allow developers to focus the performance of gaming hardware in new directions, making games run faster and look better. 

If Sony can create an effective image reconstruction solution, it will effectively give their PlayStation 5 hardware a significant performance upgrade, allowing more games to target 4K, higher framerates or both. 

Sony Patents a DLSS-like Machine Learning Image Reconstruction Technology  

You can join the discussion on Sony's patented DLSS-like image reconstruction technique on the OC3D Forums

«Prev 1 Next»

Most Recent Comments

29-07-2020, 11:54:23

Avet
This is a dream technology for consoles.Quote

29-07-2020, 19:37:38

Kleptobot
Odd, seeing as this would have to run on AMD's RDNA2 and AMD have made no noise about their own implementation of a DLSS like feature. They have RIS, but from what i could find RIS works in a very different way to DLSS.Quote

30-07-2020, 02:49:17

Avet
This may be a Sony specific feature and it will be implemented in most demanding games. I don't see this being used on FIFA.Quote

30-07-2020, 04:44:17

WYP
Quote:
Originally Posted by Kleptobot View Post
Odd, seeing as this would have to run on AMD's RDNA2 and AMD have made no noise about their own implementation of a DLSS like feature. They have RIS, but from what i could find RIS works in a very different way to DLSS.
Why would AMD make noise about it before they have new graphics cards on the market? Also, if this is machine learning based, Sony may have just created their own solution with a custom data set. This need not be an AMD solution.Quote

30-07-2020, 07:32:15

Kleptobot
Quote:
Originally Posted by WYP View Post
Why would AMD make noise about it before they have new graphics cards on the market? Also, if this is machine learning based, Sony may have just created their own solution with a custom data set. This need not be an AMD solution.
You are correct on both points, I just find it a little odd. But cmon AMD have a track record of aggressive marketing I would be surprised if they did t shout a DLSS feature from the rooftops.Quote
Reply
x

Register for the OC3D Newsletter

Subscribing to the OC3D newsletter will keep you up-to-date on the latest technology reviews, competitions and goings-on at Overclock3D. We won't share your email address with ANYONE, and we will only email you with updates on site news, reviews, and competitions and you can unsubscribe easily at any time.

Simply enter your name and email address into the box below and be sure to click on the links in the confirmation emails that will arrive in your e-mail shortly after to complete the registration.

If you run into any problems, just drop us a message on the forums.