Zelda Breath of the Wild 3D Vision Fix (Depth map based)
  1 / 12    
*UPDATE* The fix is done download it at: [url]http://helixmod.blogspot.com/2017/07/zelda-breath-of-wild-3d-vision-fix.html[/url] In a previous thread I said that it was highly unlikely that we would see Breath of the Wild running in 3D anytime soon. Well it looks like I put my foot in my mouth because I've managed to create a fix. Here are some screenshots of my current work in progress: [url=http://www.iforce.co.nz/View.aspx?i=rmd4jdlo.h50.jpg][img]http://iforce.co.nz/i/rmd4jdlo.h50.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=muwhiwyv.cat.jpg][img]http://iforce.co.nz/i/muwhiwyv.cat.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=hbtfjsgq.pyu.jpg][img]http://iforce.co.nz/i/hbtfjsgq.pyu.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=qkvr2fqf.ik5.jpg][img]http://iforce.co.nz/i/qkvr2fqf.ik5.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=mff5ccla.dcm.jpg][img]http://iforce.co.nz/i/mff5ccla.dcm.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=om0uhysf.txe.jpg][img]http://iforce.co.nz/i/om0uhysf.txe.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=kyvd43la.tkl.jpg][img]http://iforce.co.nz/i/kyvd43la.tkl.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=igcdrbxn.st3.jpg][img]http://iforce.co.nz/i/igcdrbxn.st3.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=py20w0co.3ua.jpg][img]http://iforce.co.nz/i/py20w0co.3ua.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=yn5whyhd.4sn.jpg][img]http://iforce.co.nz/i/yn5whyhd.4sn.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=lo5q2wcr.uzn.jpg][img]http://iforce.co.nz/i/lo5q2wcr.uzn.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=jeely5rv.dqw.jpg][img]http://iforce.co.nz/i/jeely5rv.dqw.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=1m5yk33k.bnj.jpg][img]http://iforce.co.nz/i/1m5yk33k.bnj.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=o2y4hjeq.psr.jpg][img]http://iforce.co.nz/i/o2y4hjeq.psr.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=qo02g2ci.hih.jpg][img]http://iforce.co.nz/i/qo02g2ci.hih.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=5bunlvmx.zwp.jpg][img]http://iforce.co.nz/i/5bunlvmx.zwp.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=jyhhvt1k.yx2.jpg][img]http://iforce.co.nz/i/jyhhvt1k.yx2.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=ysgk0bgx.hzm.jpg][img]http://iforce.co.nz/i/ysgk0bgx.hzm.jpg[/img][/url] [url=http://www.iforce.co.nz/View.aspx?i=q12exv2i.brl.jpg][img]http://iforce.co.nz/i/q12exv2i.brl.jpg[/img][/url] You can rename the files to .jps to view them in the 3D Vision photo viewer. I'm displaying the game through my projector so the depth might not be high enough for smaller displays but it can be adjusted. Now before you get to excited this is not using real 3D geometry like most of the fixes on helixmod. It's using a depthmap based solution similar to Nvidia's 3d compatibility mode. That being said, I think it looks incredible, the screenshots should speak for themselves. The game is running on the Cemu Wii U emulator. The shader is based off of Crytek's Stereo 3d Shader, the same one that BlueSkyDefender also used in his SuperDepth3D shader he made for Reshade. 3DVision injection is done using Helifax's OpenGL wrapper + Reshade. The depth map had to be properly linearized so that the Stereo 3d shader would work properly. Normally linearizing the depth map would be done using a standard linearization equation for OpenGL. Unfortunately though things were not that simple since I don't have access to the near and far clip plane values. I could use static values but BOTW uses dynamic clipping planes in order to maximize the precision of it's depth map and avoid artifacts like z-fighting. The near and far camera clipping planes shift depending on things like camera angles and the objects that are inside it's view frustrum. This causes the depth map to shift it's values which in turn causes the final stereoscopic image to sporadically alter it's depth. So using static values makes the stereo images jump around like a squirrel on meth. A leaf suddenly blowing across the screen or grass billowing in the wind is enough to induce a seizure. If i had access to the projection matrix i could calculate the clipping plane values fairly easily but all I have to work with are the contents of the depth buffer. So instead i resorted to calculating the clip plane values by taking samples of the current depth buffer, samples from the previous buffer, filtering results and making a few educated guesses. Overall the method works very well. I still have a few things that need to be tweaked but i should be posting a fix within the next few days. I would also like to remove the need to use Reshade and only use Helifax's wrapper since Reshade breaks a few minor things and has a bit of performance overhead. The screenshot's were taken at 1440p since that's as high as my projector can go using DSR, but with a bit more work i should be able to get 4k+ down sampling to work. Also keep in mind that Cemu is still being developed and is very CPU bound in it's current version. Unless your CPU runs at 4.5Ghz or higher the game isn't going to run very well.
*UPDATE* The fix is done download it at:
http://helixmod.blogspot.com/2017/07/zelda-breath-of-wild-3d-vision-fix.html

In a previous thread I said that it was highly unlikely that we would see Breath of the Wild running in 3D anytime soon. Well it looks like I put my foot in my mouth because I've managed to create a fix. Here are some screenshots of my current work in progress:

Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
You can rename the files to .jps to view them in the 3D Vision photo viewer. I'm displaying the game through my projector so the depth might not be high enough for smaller displays but it can be adjusted.

Now before you get to excited this is not using real 3D geometry like most of the fixes on helixmod. It's using a depthmap based solution similar to Nvidia's 3d compatibility mode. That being said, I think it looks incredible, the screenshots should speak for themselves.

The game is running on the Cemu Wii U emulator. The shader is based off of Crytek's Stereo 3d Shader, the same one that BlueSkyDefender also used in his SuperDepth3D shader he made for Reshade. 3DVision injection is done using Helifax's OpenGL wrapper + Reshade.

The depth map had to be properly linearized so that the Stereo 3d shader would work properly. Normally linearizing the depth map would be done using a standard linearization equation for OpenGL. Unfortunately though things were not that simple since I don't have access to the near and far clip plane values. I could use static values but BOTW uses dynamic clipping planes in order to maximize the precision of it's depth map and avoid artifacts like z-fighting. The near and far camera clipping planes shift depending on things like camera angles and the objects that are inside it's view frustrum. This causes the depth map to shift it's values which in turn causes the final stereoscopic image to sporadically alter it's depth. So using static values makes the stereo images jump around like a squirrel on meth. A leaf suddenly blowing across the screen or grass billowing in the wind is enough to induce a seizure. If i had access to the projection matrix i could calculate the clipping plane values fairly easily but all I have to work with are the contents of the depth buffer. So instead i resorted to calculating the clip plane values by taking samples of the current depth buffer, samples from the previous buffer, filtering results and making a few educated guesses. Overall the method works very well. I still have a few things that need to be tweaked but i should be posting a fix within the next few days. I would also like to remove the need to use Reshade and only use Helifax's wrapper since Reshade breaks a few minor things and has a bit of performance overhead. The screenshot's were taken at 1440p since that's as high as my projector can go using DSR, but with a bit more work i should be able to get 4k+ down sampling to work. Also keep in mind that Cemu is still being developed and is very CPU bound in it's current version. Unless your CPU runs at 4.5Ghz or higher the game isn't going to run very well.

Like my work? You can send a donation via Paypal to sgs.rules@gmail.com

Windows 7 Pro 64x - Nvidia Driver 373.03 - EVGA 980Ti SC - Optoma HD26 with Edid override - 3D Vision 2 - i7-2600K CPU at 4.2Ghz - ASUS Z97-A Motherboard - 32 GB RAM Corsair Vengeance - 512 GB Samsung SSD 850 Pro - Creative Sound Blaster Z

#1
Posted 04/18/2017 09:55 PM   
Sick man. I might actually go out and get a switch with the game if I can play this in 3d.
Sick man. I might actually go out and get a switch with the game if I can play this in 3d.

i7-4790K CPU
16 GB RAM Corsair domination series
EVGA 1080ti SLI
Samsung SSD 840 Pro
ASUS Z97-WS Motherboard
3D Surround ASUS Rog Swift PG278Q(R), 2x PG278Q (yes it works)
Obutto R3volution Cockpit
Windows 7 pro 64x (Windows 10 Dual boot)

#2
Posted 04/18/2017 11:22 PM   
[quote="necropants"]Sick man. I might actually go out and get a switch with the game if I can play this in 3d.[/quote] The game is running on emulator for the pc you would need the Wii U version of the game.
necropants said:Sick man. I might actually go out and get a switch with the game if I can play this in 3d.


The game is running on emulator for the pc you would need the Wii U version of the game.

Gigabyte Z270 Gaming 7 32GB Ram i7-7700K BPX MDNMVME80 240 GB M.2 NGFF NVME Solid state drive SSD 240GB (OS) GigaByte Aorus Extreme Gaming 1080TI (single) Game Blaster Recon 3D Windows 8.1 X64 Pro with UPDATE 3 and Windows 10 X64 (separate SSD's)Cooler Master Cosmos 2 Case Corsair H100i GTX 1 Toshiba 5TB (Steam), 2 Seagate 4TB SSHD Drives 2 SanDisk 480 Ultra 2 SSD (games) Samsung UN46c7000 HD TV Samsung UN55HU9000 UHD TVCurrently using ACER PASSIVE EDID override on 3D TVs LG 55HU8500 backup

#3
Posted 04/18/2017 11:36 PM   
[quote="zig11727"][quote="necropants"]Sick man. I might actually go out and get a switch with the game if I can play this in 3d.[/quote] The game is running on emulator for the pc you would the Wii U version of the game. [/quote] Correct, unless he is talking about buying the game and a switch, also, to not feel like he is pirating it. Either way, this is awesome news. I can't wait to play this.. Is the game fully playable with the current version of Cemu? Not sure if is also WIP.
zig11727 said:
necropants said:Sick man. I might actually go out and get a switch with the game if I can play this in 3d.


The game is running on emulator for the pc you would the Wii U version of the game.


Correct, unless he is talking about buying the game and a switch, also, to not feel like he is pirating it.

Either way, this is awesome news. I can't wait to play this.. Is the game fully playable with the current version of Cemu? Not sure if is also WIP.

#4
Posted 04/19/2017 12:06 AM   
Uh yeah, I am sure this is the last place we need to be seen as condoning piracy..... that was the point. Even though technically I am sure nintendo being the dicks they are even when it comes to tournaments streaming their games wouldn't approve regardless. But if it gets working to a decent degree with 3d even if it is CM like I will purchase the game.
Uh yeah, I am sure this is the last place we need to be seen as condoning piracy..... that was the point. Even though technically I am sure nintendo being the dicks they are even when it comes to tournaments streaming their games wouldn't approve regardless.

But if it gets working to a decent degree with 3d even if it is CM like I will purchase the game.

i7-4790K CPU
16 GB RAM Corsair domination series
EVGA 1080ti SLI
Samsung SSD 840 Pro
ASUS Z97-WS Motherboard
3D Surround ASUS Rog Swift PG278Q(R), 2x PG278Q (yes it works)
Obutto R3volution Cockpit
Windows 7 pro 64x (Windows 10 Dual boot)

#5
Posted 04/19/2017 04:44 AM   
Awesome stuff right there sgsrules!
Awesome stuff right there sgsrules!


Life is as empty without Terror, as is without Love...
But thou Chaos can be beautiful...
It can not last...


-
2x Asus GTX 980Ti Strix (OC edition), Custom Water-cooling to kick the Temperature & Noise arse ^_^
-3x Asus VG278HE 3D Vision 2 monitors (3D Surround)
i7 4790K @ 5.0Ghz ontop of Asus Maximus VII Ranger
DDR3 Corsair Vengeance 16GB 2133
RAID0 256GB SSDs
RAID0 2TB Mechanical HDD (WD Black)
-
Alienware M17x R5
GT880M (8GB VRAM)
120hz 3D Samsung LCD Panel

16gb 1600Mhz DDR3
256GB SSD + 1TB mechanical HDD
-
Alienware M14x R1
GT555M (1.5GB VRAM) - Regular LG LCD
8GB 1600Mhz DDR3
256 SSD + 512GB mechanical HDD
-
Paypal for donations: tavyhome@gmail.com

#6
Posted 04/19/2017 10:16 AM   
Great job on coming up with a workaround for those depth issues. [quote="sgsrules"]jump around like a squirrel on meth[/quote] lol, this made me check youtube for squirrels on speed
Great job on coming up with a workaround for those depth issues.

sgsrules said:jump around like a squirrel on meth


lol, this made me check youtube for squirrels on speed

#7
Posted 04/19/2017 10:40 AM   
[quote="sebastatu"][quote="zig11727"][quote="necropants"]Sick man. I might actually go out and get a switch with the game if I can play this in 3d.[/quote] The game is running on emulator for the pc you would the Wii U version of the game. [/quote] Correct, unless he is talking about buying the game and a switch, also, to not feel like he is pirating it. Either way, this is awesome news. I can't wait to play this.. Is the game fully playable with the current version of Cemu? Not sure if is also WIP.[/quote] Although, philosophically, buying a Switch and the game would make most of us feel like we are respecting Nintendo's work (and I fully agree with this idea), the current copyright law in most of the world does not work this way. If you want to stay legal, you need to buy the WiiU console, the WiiU version of the game, rip the game data to an SD card yourself using the WiiU console and homebrew software, and decrypt the data using your own WiiU console's decryption key (you are not allowed to obtain it from someone else or download it from the internet). And only then you can legally run the game on the CEMU emulator. (An of course, you are not allowed to resell the game nor the console on the used market for as long as you keep the copy game's data) I know it's absurd. I also wish there were an easy way to just give Nintendo 60€ (+20€ DLC) for the game and be done with it... but I don't believe we'll see that happen any time soon.
sebastatu said:
zig11727 said:
necropants said:Sick man. I might actually go out and get a switch with the game if I can play this in 3d.


The game is running on emulator for the pc you would the Wii U version of the game.


Correct, unless he is talking about buying the game and a switch, also, to not feel like he is pirating it.

Either way, this is awesome news. I can't wait to play this.. Is the game fully playable with the current version of Cemu? Not sure if is also WIP.

Although, philosophically, buying a Switch and the game would make most of us feel like we are respecting Nintendo's work (and I fully agree with this idea), the current copyright law in most of the world does not work this way.

If you want to stay legal, you need to buy the WiiU console, the WiiU version of the game, rip the game data to an SD card yourself using the WiiU console and homebrew software, and decrypt the data using your own WiiU console's decryption key (you are not allowed to obtain it from someone else or download it from the internet).
And only then you can legally run the game on the CEMU emulator.
(An of course, you are not allowed to resell the game nor the console on the used market for as long as you keep the copy game's data)

I know it's absurd. I also wish there were an easy way to just give Nintendo 60€ (+20€ DLC) for the game and be done with it... but I don't believe we'll see that happen any time soon.

Passive 3D forever
110" DIY dual-projection system
2x Epson EH-TW3500 (1080p) + Linear Polarizers (SPAR)
XtremScreen Daylight 2.0
VNS Geobox501 signal converter

#8
Posted 04/19/2017 11:42 AM   
Totally awesome sgsrules - Respect !!!
Totally awesome sgsrules - Respect !!!

#9
Posted 04/19/2017 01:36 PM   
This is awesome. I have a Switch and the Game. I also have a WiiU. I would not feel like a cheater at all. But my CPU is old so I will not get this to run anyways I guess. And the Setup sounds a bit difficult. But your pictures are amazing. This is how the old Zelda games look on my New N3DS XL - which I can highly recommend if you want to play Ocarina of Time in gloriaus 3D. Keep on the work. This is great. Unfortunately, Nintendo missed the opportunity to give the Switch alike the 3DS a proper 3D function. On this point they definitely went back in progress in comparison to the 3DS and new technology.
This is awesome. I have a Switch and the Game. I also have a WiiU. I would not feel like a cheater at all. But my CPU is old so I will not get this to run anyways I guess. And the Setup sounds a bit difficult. But your pictures are amazing. This is how the old Zelda games look on my New N3DS XL - which I can highly recommend if you want to play Ocarina of Time in gloriaus 3D. Keep on the work. This is great. Unfortunately, Nintendo missed the opportunity to give the Switch alike the 3DS a proper 3D function. On this point they definitely went back in progress in comparison to the 3DS and new technology.

Intel Core i7-3820, 4 X 3,60 GHz overclocked to 4,50 GHz ; EVGA Titan X 12VRAM ; 16 GB Corsair Vengeance DDR-1600 (4x 4 GB) ; Asus VG278H 27-inch incl. 3D vision 2 glasses, integrated transmitter ; Xbox One Elite wireless controller ; Windows 10
HTC VIVE 2,5 m2 roomscale
3D VISION GAMERS - VISIT ME ON STEAM and feel free to add me:
http://steamcommunity.com/profiles/76561198064106555/edit
Image

#10
Posted 04/19/2017 04:32 PM   
It looks better than I expected. I hope you will release it tomorrow or Friday :). A friend of mine is coming home and I want to show it to him. Having a proper geometry fix would have the drawback of dividing fps by two. Wich isn't a problem for fps unlocked games, but for a 30fps locked game it is. However, there's CheatEngine and the possibility of using a 0.5x speedhack, that in theory makes RTSS report 60fps while the game looks like 30fps: https://www.reddit.com/r/cemu/duplicates/63eezo/the_cheatengine_60_fps_trick_is_most_likely/ If CheatEngine is actually making Cemu repeat frames, then a geometry fix can be possible (I mean, with the same fps as the game in 2D). But helifax is the only one that knows how to do OpenGL fixes at the moment (I should learn someday).
It looks better than I expected. I hope you will release it tomorrow or Friday :). A friend of mine is coming home and I want to show it to him.

Having a proper geometry fix would have the drawback of dividing fps by two. Wich isn't a problem for fps unlocked games, but for a 30fps locked game it is. However, there's CheatEngine and the possibility of using a 0.5x speedhack, that in theory makes RTSS report 60fps while the game looks like 30fps: https://www.reddit.com/r/cemu/duplicates/63eezo/the_cheatengine_60_fps_trick_is_most_likely/

If CheatEngine is actually making Cemu repeat frames, then a geometry fix can be possible (I mean, with the same fps as the game in 2D). But helifax is the only one that knows how to do OpenGL fixes at the moment (I should learn someday).

Email for PayPal donations: masterotakusuko@gmail.com
CPU: Intel Core i7 7700K @ 5GHz, 1.395V
Motherboard: Gigabyte Aorus GA-Z270X-Gaming 5
RAM: GSKILL Ripjaws Z 16GB 3866MHz CL18
GPU: Gainward Phoenix 1080 GLH
Monitor: Asus PG278QR
Speakers: Logitech Z506

#11
Posted 04/19/2017 06:55 PM   
HAHA.... what are the odds when reading about CEMU or the Dolphin emu's that most if not ALL OWN the same game/s they are playing. DUH Now.. if you copied your game to the PC then cranked on the EMU and set up the joysticks that came with the WII U... cause.. very hard to run with out. Then AWESOME. So to download someone else's copy that they bought...well you know. And since you care so much about "piracy" Ask Nintendo about this.. if they are FINE with it and it's not like sharing STEAM account huh..no lhaha And dnot start with "digital copy" being the same or the like.. man I totally understand. Yet..its not what I think.. the one that made the game love to charge the same price for a copy.
HAHA.... what are the odds when reading about CEMU or the Dolphin emu's that most if not ALL OWN the same game/s they are playing. DUH

Now.. if you copied your game to the PC then cranked on the EMU and set up the joysticks that came with the WII U... cause.. very hard to run with out. Then AWESOME. So to download someone else's copy that they bought...well you know. And since you care so much about "piracy" Ask Nintendo about this.. if they are FINE with it and it's not like sharing STEAM account huh..no lhaha

And dnot start with "digital copy" being the same or the like.. man I totally understand. Yet..its not what I think.. the one that made the game love to charge the same price for a copy.

#12
Posted 04/19/2017 06:56 PM   
I am not sure I followed in the least what you where saying there Zeeblade... But on the whole emulator thing, didn't Nintendo get busted recently releasing a hacked version of one of their Roms for sale? Pretty ironic if you ask me. I'm sure everyone around here will purchase the game if they play it this way, piracy is rightly seriously frowned upon on this board, and our fixers only support legitimate copies in general.
I am not sure I followed in the least what you where saying there Zeeblade...

But on the whole emulator thing, didn't Nintendo get busted recently releasing a hacked version of one of their Roms for sale? Pretty ironic if you ask me.

I'm sure everyone around here will purchase the game if they play it this way, piracy is rightly seriously frowned upon on this board, and our fixers only support legitimate copies in general.

i7-4790K CPU
16 GB RAM Corsair domination series
EVGA 1080ti SLI
Samsung SSD 840 Pro
ASUS Z97-WS Motherboard
3D Surround ASUS Rog Swift PG278Q(R), 2x PG278Q (yes it works)
Obutto R3volution Cockpit
Windows 7 pro 64x (Windows 10 Dual boot)

#13
Posted 04/19/2017 11:50 PM   
Yes, Nintendo sold a version of Super Mario Bros on it's virtual console market which is identical to versions available online. However it is unknown whether they downloaded it online, or if they just used same tools from the internet hackers to extract the data from their own cartridge. (apply the same process to the same source material and you'll get the same result file) Nintendo's policy regarding emulation and piracy is very clear. They want people to buy their consoles and games. All they care about is preventing and attacking people making illegal copies. Anything in-between is invisible to their eyes. They don't care about legal emulation. They won't acknowledge the people who do emulation, mods and conversions and they won't help anyone doing it. And if they ever happen to harm legal emulation while busting a illegal copying site or product, they'll do it anyway because they don't care.
Yes, Nintendo sold a version of Super Mario Bros on it's virtual console market which is identical to versions available online.
However it is unknown whether they downloaded it online, or if they just used same tools from the internet hackers to extract the data from their own cartridge.
(apply the same process to the same source material and you'll get the same result file)

Nintendo's policy regarding emulation and piracy is very clear.
They want people to buy their consoles and games.
All they care about is preventing and attacking people making illegal copies.
Anything in-between is invisible to their eyes.

They don't care about legal emulation. They won't acknowledge the people who do emulation, mods and conversions and they won't help anyone doing it. And if they ever happen to harm legal emulation while busting a illegal copying site or product, they'll do it anyway because they don't care.

Passive 3D forever
110" DIY dual-projection system
2x Epson EH-TW3500 (1080p) + Linear Polarizers (SPAR)
XtremScreen Daylight 2.0
VNS Geobox501 signal converter

#14
Posted 04/20/2017 11:33 AM   
I mostly agree with you guys, piracy isn't doing anything good, no matter which company thats involved ! But this is close to hijacking sgsrules thread, give him the credit he surely deserves for his marvelous work, and make a seperate piracy thread if you wish to do so !
I mostly agree with you guys, piracy isn't doing anything good, no matter which company thats involved !

But this is close to hijacking sgsrules thread, give him the credit he surely deserves for his marvelous work, and make a seperate piracy thread if you wish to do so !

#15
Posted 04/20/2017 02:55 PM   
  1 / 12    
Scroll To Top