The Wii and PS3 don't deserve to outrank the N64, nor does the Xbox Series X deserve to hang with any of these. I almost want to push the original Xbox lower too, but modded versions of those were unbelievable as you could run XBMC and emulators, and so I give it a pass.
The PS3 hardware was an expensive bloated mess that stumbled into the HD generation half-baked compared to the Xbox 360. The Wii's software lineup was pretty weak overall with a lot of minigame collections and shovelware, and the novelty of the motion controllers wore off rapidly.
The N64 was a huge leap forward thanks to actually good 3d graphics and the addition of four controller ports. The library was limited in number but the hits were incredible. It paved the way for many forms of 3D video games and was (and probably remains) the best console for local multiplayer. The Wii gets too much credit for being innovative, and the N64 doesn't get enough - one of these consoles was a flash in the pan while the other had a lasting impact on the design of 3d videogames.
The Series X is not a disaster, but it also has to be one of the most forgettable consoles of all time.