Does this allow for taking a low res, compressed photo and enlarging it?
That's exactly what this method was created for, yes. You want a network trained on natural images, not illustrations, though (so, skip the manga109 one).
Does this allow for taking a low res, compressed photo and enlarging it?
Cool I'll look into this when i get home from visiting the family. I have some really old pics from a 20 year old digital camera that I would like to see if I can improveThat's exactly what this method was created for, yes. You want a network trained on natural images, not illustrations, though (so, skip the manga109 one).
Chrono Cross
It's like automatization of creativity. It's equally scary and impressive/amazing. It will be interesting to see where this is headed - AI generated entertainment sounds both exciting and potentially devastating for entire industries.Next thing you know they'll be able to detect where a light source is coming from and improve the lighting to modern levels in a retro game.
Some time after they'll be able to auto generate levels that are intelligently and intricately designed from being fed examples of levels in games.
Think of this applied to everything. First improved, then ability to create from scratch. Animations, levels, and then entire fucking games. Just like they're already able to do now with fake celebs and fake photos of any scenario after being trained on sets of those images. But it's not gonna stop there.
Does this allow for taking a low res, compressed photo and enlarging it? I know photoshop will do this with a bicubic sharpener already but that doesn't create a great image
A guy on Twitter did it for every FFIX backgrounds (and says it plans to improve/fix them) :
Link to: imgur gallery
Some of them has issue but some are really impressive:
My understanding of this is it compares images to downsampled versions of the same images, and from it tries to learn the methods to best reconstruct the large images from the small images. Once it's been trained to do this, the same techniques can be applied to other images.
Yeah what a time we live in. The images in the OP shows a glimpse of what machine imagination looks like, filling in the blanks, the void with precise detail. And what a fool I was to think automation would never displace creative people in creative industries. It is exciting indeed because this can speed things up and create things that weren't possible due to time or manpower constraints when used to supplement traditional methods, but also at some point it could be doing the majority of the workload and yes, that could be devastating.It's like automatization of creativity. It's equally scary and impressive/amazing. It will be interesting to see where this is headed - AI generated entertainment sounds both exciting and potentially devastating for entire industries.
My understanding of this is it compares images to downsampled versions of the same images, and from it tries to learn the methods to best reconstruct the large images from the small images. Once it's been trained to do this, the same techniques can be applied to other images.
However, old sprite stuff with things like harsh edges and color dithering isn't going to be helped much because a high res image isn't going to look like that when scaled down, so it's not the sort of thing it's trained to know what to do with.
It's harder to imagine when machines will be doing stuff we consider REALLY creative, but enough work is "creative", that a machine can be taught a format and come up with a million competent results by the time a regular person has made one. Data in Star Trek TNG had an awful time with humor--and while maybe he should've had trouble understanding why something is funny, he'd be able to think of a billion different shiny things to compare Picard's head to that would entertain his crewmates.Yeah what a time we live in. The images in the OP shows a glimpse of what machine imagination looks like, filling in the blanks, the void with precise detail. And what a fool I was to think automation would never displace creative people in creative industries.
Yep, they might never come up with truly original ideas or the best jokes, but then again neither do a lot of creatives. Much of our of entertainment is mediocre and derivative, after all. With enough statistical and situational information to draw from, machines will begin to understand what gets a human to react.It's harder to imagine when machines will be doing stuff we consider REALLY creative, but enough work is "creative", that a machine can be taught a format and come up with a million competent results by the time a regular person has made one. Data in Star Trek TNG had an awful time with humor--and while maybe he should've had trouble understanding why something is funny, he'd be able to think of a billion different shiny things to compare Picard's head to that would entertain his crewmates.
Thanks, it's encouraging to see progress in video upscaling. There's a LOT of PS1-era FMV that could hopefully someday benefit from this sort of thing!Since someone asked about upscaling video (and someone else tried it with ESRGAN) there's this one called TecoGAN.
Not seeing a source code around yet but the paper's here:
https://arxiv.org/pdf/1811.09393.pdf
Ended up running the majority of Sonic Colors through Gigapixel:
The guy has confirmed on Twitter that he is looking on how to mod the game with the results:
Can't wait...
Is he likely to succeed, how hard is it to mod FFIX? It's on sale right now and this would be the deciding factor on me buying it.
I also want someone to do a texture mod of Final Fantasy XII: The Zodiac Age with this, as all the devs of that did was make a photoshop action of resizing the images and applying a couple filters to a folder containing the games textures. I really don't like the vaseline look they have.
I nver took the time to try, but before that fan patch, imho the best visual was to play with a CRT shader ( cf : https://steamcommunity.com/sharedfiles/filedetails/?id=668831565 ) :I can't guarantee for him that he will be able to do it...but this seems to be feasible since someone already did it (updating the background with Waifu...which results are.."meh"):
https://steamcommunity.com/sharedfiles/filedetails/?id=927391278
Interesting. The modder even knows about it in the comments of that too. Guess I'll buy it.I can't guarantee for him that he will be able to do it...but this seems to be feasible since someone already did it (updating the background with Waifu...which results are.."meh"):
https://steamcommunity.com/sharedfiles/filedetails/?id=927391278
Extracted all backgrounds from Monkey Island 4 (EfMI) and fed them to AI. They go beautifully from 640x480 to... 2560x1920! That`s more than full HD, insane insanity.
Take a look:
I mean, second screen looks like original rendered background (take a look at those details) and the first one like its downgraded version.
Manga model ran through 1080 (CUDA). Really low res pictures (VGA - like DOS SCUMM games) takes less then 1 second, it`s almost instant - that`s way I was thinking of implementing this in ScummVM "on the fly". This ones took a little longer (2~3 seconds). Card is going at full blast when processing.You were using the Manga model, right? (did you run on CPU or GPU and how long did one image take?)
Damn, that does look nice! I wish Curse looked this nice when fed through. I recently bought Curse and can't wait to sit down and finally play it, but the aliasing is quite high even with the smoothing on.Extracted all backgrounds from Monkey Island 4 (EfMI) and fed them to AI. They go beautifully from 640x480 to... 2560x1920! That`s more than full HD, insane insanity.
Take a look:
I mean, second screen looks like original rendered background (take a look at those details) and the first one like its downgraded version.
Problem is that the manga models changes the contrast of the picture. I noticed the same when I trained NeuralEnhancer (based on the og SRGAN) back in the days. I wonder why.Extracted all backgrounds from Monkey Island 4 (EfMI) and fed them to AI. They go beautifully from 640x480 to... 2560x1920! That`s more than full HD, insane insanity.
Take a look:
I mean, second screen looks like original rendered background (take a look at those details) and the first one like its downgraded version.
This is incredibleExtracted all backgrounds from Monkey Island 4 (EfMI) and fed them to AI. They go beautifully from 640x480 to... 2560x1920! That`s more than full HD, insane insanity.
Take a look:
I mean, second screen looks like original rendered background (take a look at those details) and the first one like its downgraded version.
Problem is that the manga models changes the contrast of the picture. I noticed the same when I trained NeuralEnhancer (based on the og SRGAN) back in the days. I wonder why.
So wait, this Manga AI was trained specifically on just manga? Then yeah, it has no business be used on non-black and white 2D drawings.
After:
Well, that is pretty much what it is already. It tries to learn how to reconstruct the original version of an image from a smaller one that's lost a lot of the information. It's just that the same learned techniques can then be applied to generic input.Just a thought, probably idiotic, but could we use the tech for destructive, highly-compression schemes of image/sounds ?
Should I play the remastered version or wait for someone to mod the game with this INSANITY!Man, I finally remembered the game I was thinking of that had 2D backgrounds that could really use a high res version. It's Grim Fandango. Got the remaster on PC, extracted some backgrounds and ran them through with the Manga model and man these results are insane. They can just stick these in with an update and you get a good presentation even on a 4K display.
I was hoping for it to be easy to do myself but it seems like the backgrounds are in a weird format and I only found a tool to extract them to PNG, not modify them.Should I play the remastered version or wait for someone to mod the game with this INSANITY!
Incredible.
Man, I finally remembered the game I was thinking of that had 2D backgrounds that could really use a high res version. It's Grim Fandango. Got the remaster on PC, extracted some backgrounds and ran them through with the Manga model and man these results are insane. They can just stick these in with an update and you get a good presentation even on a 4K display.
A guy on Twitter did it for every FFIX backgrounds (and says it plans to improve/fix them) :
Link to: imgur gallery
Some of them has issue but some are really impressive:
Here's some more from Chrono Cross. They certainly aren't perfect (just look at the sky) but still very impressive..
Man, I finally remembered the game I was thinking of that had 2D backgrounds that could really use a high res version. It's Grim Fandango. Got the remaster on PC, extracted some backgrounds and ran them through with the Manga model and man these results are insane. They can just stick these in with an update and you get a good presentation even on a 4K display.
Here are some comparison gifs:
Album with the full-res before and after pics:
https://imgur.com/a/uZJPXvq