I've been trying some other images in CPU mode (I have a cuda card but wanted to try a the non cuda process) and it can take forever (literally minutes) on a 3.7 Ghz i7... depending on the image of course.
-
Ever wanted an RSS feed of all your favorite gaming news sites? Go check out our new Gaming Headlines feed! Read more about it here.
AI Neural Networks being used to generate HQ textures for older games (You can do it yourself!)
- Thread starter vestan
- Start date
I've been trying some other images in CPU mode (I have a cuda card but wanted to try a the non cuda process) and it can take forever (literally minutes) on a 3.7 Ghz i7... depending on the image of course.
Seeing these Grim Fandango pictures make me wonder how Day of the Tentacle would look. Who knows, it might even look better than the official remaster :P
Hey guys, not super related but has someone found a model trained to actually upres images that are LR from the internet? Like, real life photos you would get from google that would be like 400x400.
I have some photos from my dad's band (that we don't have the source at all) and I'm trying to use ESRGAN but it really doesnt work that well.
I have some photos from my dad's band (that we don't have the source at all) and I'm trying to use ESRGAN but it really doesnt work that well.
I'm trying to follow the instructions in the blog, but am stuck on the PyTorch step.
I have the latest Python (3.7.2) and CUDA (10.0.130). Following the QuickStart instructions on pytorch.org, I'm trying to execute this from command line:
The first pip3 install fails with "torch-1.0.0-cp37-cp37m-win_amd64.whl is not a supported wheel on this platform." message.
Advice from the blog:
Any ideas?
EDIT: Nevermind, I think I see the problem - I needed 64-bit Python installer.
I have the latest Python (3.7.2) and CUDA (10.0.130). Following the QuickStart instructions on pytorch.org, I'm trying to execute this from command line:
Code:
pip3 install https://download.pytorch.org/whl/cu100/torch-1.0.0-cp37-cp37m-win_amd64.whl
pip3 install torchvisionThe first pip3 install fails with "torch-1.0.0-cp37-cp37m-win_amd64.whl is not a supported wheel on this platform." message.
Advice from the blog:
is not helpful - my versions match, and choosing different versions gives same error.
Any ideas?
EDIT: Nevermind, I think I see the problem - I needed 64-bit Python installer.
Last edited:
I'm hoping to get it from the game image. As far as I researched it should be pretty easy.
If not, I'll probably get it from a sprite resource. That should be a good alternative I hadn't thought about. :)
I can see this working...Only tried with manga109 :
But from what I gathered, replacing the game original files would be nearly impossible. So I guess I'll dream.
Used the upscaler as a baseline on the Skyrim mountain texture and added some more manual touchups on top. This texture was already upscaled from 1K to 4K in Skyrim SE but it was done so badly that you can hardly even tell the difference. This is with only the diffuse as I haven't even gotten around to editing the normal and specular materials yet.
http://screenshotcomparison.com/comparison/126992
http://screenshotcomparison.com/comparison/126992
I need an open source Jpeg artefact removal algo (there was a link to a project earlier in the thread but that wasn't actual code I believe)... ESRGAN works really good with non compressed images, or high quality low res images. As soon as Jpeg artefacting comes into play it has problems. Photoshop can help a little the Jpeg removal in the filters is very brutal on details when used on low res and highly compressed images. You can smudge and stamp and paint and use noise and blur and and and ... but at some point it is too much work for average results.
I've seen other images online (there is a low res bear image) which can get very detailed by using other ai upscalers... I wasn't able to reproduce the same results they have online with ESRGAN, maybe I didn't use the original image they've been using, I'm not sure.
I've seen other images online (there is a low res bear image) which can get very detailed by using other ai upscalers... I wasn't able to reproduce the same results they have online with ESRGAN, maybe I didn't use the original image they've been using, I'm not sure.
waifu2x-caffe has a decent denoiser that can be used without the upscaling. Mind you it won't add things like additional texture detail like ESRGAN but for cleaning sources I use it from time to time.
Here's a photo saved at a very low JPEG quality, and here's the waifu2x-caffe denoise. Comparison crops below, scaled 200% nearest neighbor in PS afterward to better see:
For the above used the Photo model preset, TTA mode and Level 2 denoise.
I can see this working...
But from what I gathered, replacing the game original files would be nearly impossible. So I guess I'll dream.
Is there an easy way for you to do this? That particular sprite sheet doesn't have proper spacing.
OP
OP
Yes please do more Metroid! The applications of this for video encoding will be spectacular I guess. An AI specifically trained for a certain movie should allow for drastically smaller file sizes. Or are these AI containers large in size? How large are these tools?
Edit: They could even switch AI training sets/models on a scene by scene basis. The possibilities are grand...
Edit: They could even switch AI training sets/models on a scene by scene basis. The possibilities are grand...
Last edited:
OP
OP
Mines around 700MB. That's with 12 models though. Can easily get it smaller.
Soul Calibur 2. Per texture, not post-process.
http://screenshotcomparison.com/comparison/127037
Before:
After:
I couldn't get mipmaps working properly with the modded textures, so I had to disable texture filtering. Looks great regardless though. Does anyone know if you can force anisotropic filtering in Dolphin through the Nvidia control panel?
http://screenshotcomparison.com/comparison/127037
Before:
After:
I couldn't get mipmaps working properly with the modded textures, so I had to disable texture filtering. Looks great regardless though. Does anyone know if you can force anisotropic filtering in Dolphin through the Nvidia control panel?
Last edited:
This is the dataset it's trained on. You can download it yourself and take a look if you contact them.
http://www.manga109.org/en/
Melee. ESRGAN can't handle transparencies, but the environment textures are a nice little upgrade. It's pretty much impossible to see a difference in gameplay though.
http://screenshotcomparison.com/comparison/127039
http://screenshotcomparison.com/comparison/127039
waifu2x-caffe has a decent denoiser that can be used without the upscaling. Mind you it won't add things like additional texture detail like ESRGAN but for cleaning sources I use it from time to time.
Here's a photo saved at a very low JPEG quality, and here's the waifu2x-caffe denoise. Comparison crops below, scaled 200% nearest neighbor in PS afterward to better see:
For the above used the Photo model preset, TTA mode and Level 2 denoise.
Interesting, thanks! (seems to be Windows only tho?)
Where did you get those other models from? I'm looking for some more to try!
I noticed someone ran this on all Max Payne textures. Looks great most of the time: https://www.reddit.com/r/GameUpscale/comments/ab54zc/max_payne_remastered/
old
new
Can't wait to see mods like these for other old games.
old
new
Can't wait to see mods like these for other old games.
goddamn the closet doorI noticed someone ran this on all Max Payne textures. Looks great most of the time: https://www.reddit.com/r/GameUpscale/comments/ab54zc/max_payne_remastered/
old
new
Can't wait to see mods like these for other old games.
I was ready to call those Max Payne textures impossible until I saw the text on Reddit itself:
Which I think will be the method going forward, really. Filter them but then clean up the stuff the filter can't quite understand.
Which I think will be the method going forward, really. Filter them but then clean up the stuff the filter can't quite understand.
Metroid you say????? I gotchu covered.
http://screenshotcomparison.com/comparison/127113/picture:0
http://screenshotcomparison.com/comparison/127113/picture:1
http://screenshotcomparison.com/comparison/127113/picture:2
http://screenshotcomparison.com/comparison/127113/picture:3
http://screenshotcomparison.com/comparison/127113/picture:4
I try this tool with some favorites Final Fantasy IX Background
Just...crazy
Comparison Below with source :
http://screenshotcomparison.com/comparison/127119/picture:0
Just...crazy
Comparison Below with source :
http://screenshotcomparison.com/comparison/127119/picture:0
Wow, is this one actually real?
I've a pretty good idea how this stuff works but that's still striking. You really have to marvel at just how few pixels the network needs to find some really fitting higher-res shapes and textures in a lot of cases.
Does it work on Donkey Kong Country or is it too low res
Yeah it really is surprising how well it knows there have been sharp lines hidden in those pixels, if you look at the ridges between the woodpanels in the table for example. It just looks "right" most of the time. Just stunning!
Yeah it really is surprising how well it knows there have been sharp lines hidden in those pixels, if you look at the ridges between the woodpanels in the table for example. It just looks "right" most of the time. Just stunning!
There will be a time where AI can make 3D games visually cohesive in real time, and perhaps even radically changing the visual style.
I'm even wondering if the semi-distant future of game graphics are crude visuals that you tell an AI "futuristic city of style XYZ" and the AI will construct the entire scene (with comparitively little work being done on the rasterization / raytracing side).
I'm even wondering if the semi-distant future of game graphics are crude visuals that you tell an AI "futuristic city of style XYZ" and the AI will construct the entire scene (with comparitively little work being done on the rasterization / raytracing side).
DAMN.
Did someone try with Doom and CS1.6?
Ohh, I'm curious if Warcraft 3 can look better than the Remaster...
Does anyone know an easy way to extract textures from Goldeneye? I was thinking about trying to make a texture pack with this.
I was gonna run some Dark Souls textures through this but it takes too damn long for larger images to be processed by CPU. No chance of AMD GPU support?
Yes, all original image (240p) but 400% resize without filter for comparaison below.
other comparison : http://screenshotcomparison.com/comparison/127161/picture:0
Indeed it's impressive, the operation to find the most identical render. Even if it's "fake", in some cases, it works very well. (Especially the slightly dark images)
In other cases, the rendering is too "sharp" and "crisp"
The fact that 8/16 bit (dithering) colors can also break the result.
Like this :
Here, I downscale /4, otherwise, full pixelated
More calculation, very long and especially very greedy. I try 720p picture and it's too long and my PC freezing.
I have a 3770k i7, 16 GB RAM and a SSD.
I have a GTX 770 but not supported even if could run CUDA, so it use RAM + SSD
Edges continue to improve somewhat, but fine details don't gain much relative to the amount of artefacts created.
Shadowrun Returns (crop from 8xSGSSAA screenshot)
Original, 1600% Nearest
Manga109, 400% Nearest
Manga109, Manga109
Interp_08, 400% Nearest
Interp_08, Interp_08
(interp_08 from ESRGAN_x4 and PSNR_x4 models)
It might look better with some extra processing between steps (reducing halos in particular).
Yeah, I think it would be interesting to train a model specifically for dithered pictures (e.g. by downsampling and dithering images in the training set).
https://www.nexusmods.com/darksoulsremastered/mods/114/
It unfortunately only works with the remaster because they already use 2k texture files, while DS original messes up when you upscale the UI textures.
Last edited: