NVIDIA updating Wii games for the Shield TV using Deep Learning

Astrogamer

Member
Oct 25, 2017
543
Looks pretty nice. Did they ever release more besides the 4 or so they basically launched with?
 

wwm0nkey

Member
Oct 25, 2017
10,402
AI texture updating is still really cool and going to be interesting seeing companies come up with automatic solutions.
 

kirbyfan407

Member
Oct 25, 2017
1,860
For developers, I would imagine that perhaps this technology offers a good starting point for artists? Or maybe artists would prefer to be given a blank slate and just the original art?

I'm curious if Nintendo would ever use this and if we'll see these outside of China. I also wonder if these releases are in any way connected to the Switch contract.
 

Joqu

Member
Oct 25, 2017
2,777
The Waffle Kingdom
Pretty cool stuff, but it's kind of funny they had to go through the trouble instead of gaining access to the work that was done for the Wii U release.

Would love to see the results on the Wii games that don't have such an option tho.

edit: though looking at Link's clothes it looks like they used a mix of both? Weird...
 

ASaiyan

Member
Oct 25, 2017
7,228
That looks great. Amazing that those incredible AI texture techniques are already being implemented.

Is it even port-begging to ask when these games are coming to Switch? Lol.
 

CommodoreKong

Member
Oct 25, 2017
4,540
Hopefully Nintendo does this as well when they add Wii and GameCube games to their online subscription service in 5 years.
 

MondoMega

One Winged Slayer
Member
Jan 10, 2018
40,481
Australia
Huh; I didn't expect this stuff to be used for a Nintendo game so soon. Hopefully they use this for whenever they re-release N64/GC/Wii games on the Switch.

Speaking of which, can they PLEASE bring these Shield Wii ports to the Switch sometime soon?
 
OP
OP
Cartridge Games
Oct 25, 2017
8,615
I'm thinking Nintendo gave them a year exclusivity while they work on the emulator.
Hopefully that means we'll start getting this soon on switch.

Thought it was a bit nuts that the weren't remastering wii/gamecube games, just sticking with Wii U, but this might be why?
 

RowdyReverb

Member
Oct 25, 2017
3,587
Texas
Huh; I didn't expect this stuff to be used for a Nintendo game so soon. Hopefully they use this for whenever they re-release N64/GC/Wii games on the Switch,

Speaking of which, can they PLEASE bring these Shield Wii ports to the Switch sometime soon?
That would be great if that was the reason Nintendo has been holding out on 3D virtual console titles. If they combined this tech with some resolution boosts, they’d create a pretty quick and cheap value proposition
 
OP
OP
Cartridge Games
Oct 25, 2017
8,615
Yup, it works wonders for the most part.

If you're interested in this kind of thing, check out this massive thread here.
https://www.resetera.com/threads/ai...for-older-games-you-can-do-it-yourself.88272/





The SM64 stuff in particular is nothing short of amazing. I've found that the an interpolation between Manga109-ESRGAN produces the best results.
http://screenshotcomparison.com/comparison/127379
I'm not sure if it'll be great to use on N64. The second pic is great as it's a sky box, but the high quality textures likely don't mesh well with low poly models. Though maybe it's the render used in that OOT comparison
 

MondoMega

One Winged Slayer
Member
Jan 10, 2018
40,481
Australia
I'm thinking Nintendo gave them a year exclusivity while they work on the emulator.
Hopefully that means we'll start getting this soon on switch.

Thought it was a bit nuts that the weren't remastering wii/gamecube games, just sticking with Wii U, but this might be why?
Since those Shield ports released in December 2017 (besides Mario Galaxy; that was March 2018), do you think we could hear about a Switch release fairly soon? Maybe not in the expected January Direct, but maybe in a Spring Direct?
 

Baircade

Member
Aug 21, 2018
221
Europe
I don't get how the supposed machine learning thingy screenshot uses elements from the HD Wii U version? Look at those holes in the green fabric on his shoulders. Seems weird it did that itself.

edit: unless it "learned" by looking at ripped TP HD assets online.
 

wwm0nkey

Member
Oct 25, 2017
10,402
I don't get how the supposed machine learning thingy screenshot uses elements from the HD Wii U version? Look at those holes in the green fabric on his shoulders. Seems weird it did that itself.

edit: unless it "learned" by looking at ripped TP HD assets online.
The HD version might have just used upresed assets, which the AI could closely mimic when it does it's upscaling
 

will0wis

Member
Nov 1, 2017
328
Brazil
I don't get how the supposed machine learning thingy screenshot uses elements from the HD Wii U version? Look at those holes in the green fabric on his shoulders. Seems weird it did that itself.

edit: unless it "learned" by looking at ripped TP HD assets online.
Yeah, that's a bit weird. Maybe this detail was always in the original texture file, just not really visible when rendered in low resolution on the Wii/GC.

The NN may be capable of recovering some detail by itself (as seen in the thread that was already linked by someone above) but that specific texture really looks exactly the same as the HD remaster one, not something totally redone by the NN.
 

BlueManifest

One Winged Slayer
Member
Oct 25, 2017
10,794
Nintendo needs to use this for GameCube and Wii remasters on switch

Would be great for metroid prime trilogy
 

Foffy

Member
Oct 25, 2017
10,080
Is this perhaps the first time we've seen a filter that has more of a "universal" praise than what we've seen various emulators try to do with filtering? Like, I know some people even argue about bilinear filtering on images, and there seems to be radical hate against HQx and XBRx filtering, but this kinda stuff looks so good you can re-release games just touched up by this and cleaned up after by hand and get much more interesting results than having it fully redone by hand.

Says a lot about how "automation can't impact art" too. ;)
 
OP
OP
Cartridge Games
Oct 25, 2017
8,615
I’m not sure how much impact the texture have on running the game, but the original ran better than the Wii U remaster.
Presumably, NVIDIA’s emulator is for both Wii and GCN games as it seems like TP is from the GameCube release but there are also Wii games.
This opens the door for a lot of games to come over:
Luigi’s Mansion didn’t get a switch port. Cleaned up texture and 1080p output would be really nice for that.
Mario Sunshine hasn’t been made available in awhile, not sure if that game has issues with textures but it could still clean up.


Issue would be with the Zeldas. TPHD can take it or leave it, doesn’t change too much and this could look nicer.
WWHD should probably get a port, tho.
Biggest issue would be Skyward Sword. It needs some major updates, I think. Not sure messing with an emulated version would be the best way of handling that.
The N64 games are a curious case, they upped the polygon count, look and play better too.
Guess Grezzo Can port them? Cleaning the textures up would help quite a bit too.

But, depending on what Nintendo could do they could branch out to 3DS games as well.
Kid Icarus with deep learning AI textures would likely look quite nice.
 

JuicyPlayer

Member
Feb 8, 2018
3,436
They can’t be putting in all this work just for Shield stuff right? These have to come to the Switch at some point.
 

Rendering...

Member
Oct 30, 2017
15,362
I want this kind of thing to be standard in the next gen, the same way you can play some 360 games in sweet 4K if you've got a 1X and the original disk. (Which I realize isn't a magical automatic process, but still.)

Surely this is possible?
 

wwm0nkey

Member
Oct 25, 2017
10,402
I want this kind of thing to be standard in the next gen, the same way you can play some 360 games in sweet 4K if you've got a 1X and the original disk. (Which I realize isn't a magical automatic process, but still.)

Surely this is possible?
You'd need an AI that understands transparency, but no reason we couldn't see this as an auto process in the near future
 

JahIthBer

Member
Jan 27, 2018
7,143
Man i bet this will stay exclusive to China instead of coming to the Switch Virtual Console or something.
Thanks Nvidia & Nintendo for the tease.
 

JahIthBer

Member
Jan 27, 2018
7,143
I want this kind of thing to be standard in the next gen, the same way you can play some 360 games in sweet 4K if you've got a 1X and the original disk. (Which I realize isn't a magical automatic process, but still.)

Surely this is possible?
Kinda pointless, textures are made at resolutions beyond 4K, the trick is not deleting them & offering compressed 4K textures as an option.
Really if devs kept all their data for say PS4 games, you could port Bloodborne to PS5 with 4K textures without too much effort, but i wouldn't be surprised if even in 2015 BB's source textures got deleted.
 

Rendering...

Member
Oct 30, 2017
15,362
Kinda pointless, textures are made at resolutions beyond 4K, the trick is not deleting them & offering compressed 4K textures as an option.
Really if devs kept all their data for say PS4 games, you could port Bloodborne to PS5 with 4K textures without too much effort, but i wouldn't be surprised if even in 2015 BB's source textures got deleted.
They should use the power of the cloud or whatever to store all their datas. I know all about technology and I'm sure this must be a thing. Keep all the textures in the clouds so we can have them.

Really though, you'd think devs would want to preserve their hard work in its best possible form.
 

ShadowFox08

Banned
Nov 25, 2017
3,524
If deep learning can be implemented on the Switch, that would be amazing.

Also, if TP HD ever gets to the Switch, they need to upgrade textures in everything. It's very inconsistent with furniture and some enemies.. besides thst, upgrading some polygons for some items, especially character faces and hair should be implemented. Link's hair in TP HD on Wii u with GameCube quality looks awfu.l
 

JahIthBer

Member
Jan 27, 2018
7,143
They should use the power of the cloud or whatever to store all their datas. I know all about technology and I'm sure this must be a thing. Keep all the textures in the clouds so we can have them.
For Microsoft it would actually be easy to get their devs to store source code/data in their absolute massive cloud servers, maybe not quite for Sony though, to cut down costs devs likely just delete it all.
 

will0wis

Member
Nov 1, 2017
328
Brazil
If deep learning can be implemented on the Switch, that would be amazing.

Also, if TP HD ever gets to the Switch, they need to upgrade textures in everything. It's very inconsistent with furniture and some enemies.. besides thst, upgrading some polygons for some items, especially character faces and hair should be implemented. Link's hair in TP HD on Wii u with GameCube quality looks awfu.l
I do agree that there are many rough edges as this is a pretty old game at this point, but they will more than likely not remaster the game again just for the Switch/Shield. It will always be the same game with the same models (polygons) as the original, no matter what is being used to make the textures look better. Some remasters got updated models, but if they didn't really touch that the first time around, they won't be doing it now.

Also, the deep learning itself does not need to be implemented on the Switch or any machine that's supposed to just run these games. This process is automatically done for every single texture file in the game in a "normal" pc beforehand. It's basically just a texture replacement, but a pretty competent one at that, considering it's all done by the AI and the results are comparable to the actual HD remaster.
 

z0m3le

Member
Oct 25, 2017
5,302
Saw this morning that the modding community behind FF7 is doing the same thing. It's amazing what we can get these deep learning processors to do.
 

S_Dev

Member
Oct 26, 2017
104
Is any of this available to the general public? I can think of a few Gamecube/Wii games that could use some HD texture packs on Dolphin, and this looks to be a low man-hour solution.
 

elektrixx

Banned
Oct 26, 2017
1,923
Are there any instances where it doesn’t look so great? Diminishing returns for newer games is one thing, but what about old games that don’t cooperate with this technique?