Deferred Shader

README.md

@@ -3,190 +3,140 @@ CIS565: Project 6: Deferred Shader
 -------------------------------------------------------------------------------
 Fall 2013
 -------------------------------------------------------------------------------
-Due Friday 11/15/2013
--------------------------------------------------------------------------------
 
 -------------------------------------------------------------------------------
 NOTE:
 -------------------------------------------------------------------------------
-This project requires any graphics card with support for a modern OpenGL 
-pipeline. Any AMD, NVIDIA, or Intel card from the past few years should work 
-fine, and every machine in the SIG Lab and Moore 100 is capable of running 
-this project.
+This project requires an NVIDIA graphics card with CUDA capability! 
+Any card with CUDA compute capability 1.1 or higher will work fine for this project.
 
 -------------------------------------------------------------------------------
 INTRODUCTION:
 -------------------------------------------------------------------------------
-In this project, you will get introduced to the basics of deferred shading. You will write GLSL and OpenGL code to perform various tasks in a deferred lighting pipeline such as creating and writing to a G-Buffer.
+This project uses deferred shading in OpenGL using G-Buffers.
+The key advantage of deferred shading is that it makes it much easier to manage 
+your shaders, especially when you have loads of materials and lights.
 
 -------------------------------------------------------------------------------
-CONTENTS:
+FEATURES:
 -------------------------------------------------------------------------------
-The Project6 root directory contains the following subdirectories:
-
-* base/
-  * PROJ_WIN/ contains the vs2010 project files
-  * PROJ_NIX/ contains makefile for building (tested on ubuntu 12.04 LTS)
-  * res/ contains resources including shader source and obj files
-  * src/ contains the c++ code for the project along with SOIL and tiny_obj_loader
-* shared32/ contains freeglut, glm, and glew.
 
----
-BASE CODE TOUR
----
+- Use of G Buffers - Depth, Normal, Color, Eye space position, Shininess
+- Blinn Phong lighting model
+- Post process effects like bloom and toon shading
+- Support for efficient rendering of multiple point lights using scissor testing in OpenGL
 
-Most of your edits will be confined to the various fragment shader programs and main.cpp.
+-------------------------------------------------------------------------------
+RESULTS:
+-------------------------------------------------------------------------------
+*BLINN PHONG* :
+![alt tag](https://raw.github.com/vimanyu/Project6-DeferredShader/master/renders/blinnPhong.png)
 
-Some methods worth exploring are:
+*TOON SHADING*:
+![alt tag](https://raw.github.com/vimanyu/Project6-DeferredShader/master/renders/toonShading.png)
 
-[initShader](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L223):
-This method initializes each shader program from specified source files. Note that the source name is declared inside a `#ifdef WIN32` guard block. This is done to reflect the relative directory structure between the linux and windows versions of the code.
+*BLOOM*:
+![alt tag](https://raw.github.com/vimanyu/Project6-DeferredShader/master/renders/bloom.png)
 
-[initFBO](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L360):
-This method initializes the framebuffer objects used as render targets for the first and second stage of the pipeline. When you go to add another slot to the G buffer you will need to modify to first FBO accordingly. Try finding all the places where `colorTexture` is used (ctrl+F in windows will be helpful) and look at how textures are created, freed, added to the FBO, and assigned to the appropriate shader programs before adding your own. Also keep in mind that textures can be reused as inputs in other pipeline stages, for instance you might want access to the normals both in the lighting stage and in the post process stage.
 
-[draw_mesh](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L574),
-[draw_quad](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L647),
-[draw_light](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L657):
-These methods render the scene geometry, viewing quad, and point light quad to the screen. The draw_light method in particular is interesting because it will set up the scissor window for efficient rendering of point lights.
+-------------------------------------------------------------------------------
+VIDEO
+-------------------------------------------------------------------------------
+The following is a video of the deferred shading in action
 
-[display](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L742):
-This is where the graphical work of your program is done. The method is separated into three stages with the majority of work being done in stage 2.
+[![ScreenShot](https://raw.github.com/vimanyu/Project6-DeferredShader/master/renders/deferredShader_video_screenshot.png)](http://www.youtube.com/watch?v=MMZ0mmsKyqM)
 
-Stage 1 renders the scene geometry to the G-Buffer
-* pass.vert
-* pass.frag
+-------------------------------------------------------------------------------
+BUILDING AND RUNNING CODE
+-------------------------------------------------------------------------------
+The code has been tested on Visual Studio 2012/2010 and cuda 5.5 on a laptop with compute capability 1.0 as well as 3.0.
 
-Stage 2 renders the lighting passes and accumulates to the P-Buffer
-* shade.vert
-* ambient.frag
-* point.frag
-* diagnostic.frag
+Keyboard bindings for interactivity:
 
-Stage 3 renders the post processing
-* post.vert
-* post.frag
-
-[keyboard](https://github.com/CIS565-Fall-2013/Project6-DeferredShader/blob/master/base/src/main.cpp#L870):
-This is a good reference for the key mappings in the program. 
-WASDQZ - Movement
-X - Toggle scissor test
-R - Reload shaders
-1 - View depth
-2 - View eye space normals
-3 - View Diffuse color
-4 - View eye space positions
-5 - View lighting debug mode
-0 - Standard view
+Key|Action
+---|---
+'1'| View depth
+'2'| View eye space normals
+'3'| View diffuse Color
+'4'| View eye space positions
+'5'| View lighting debug mode
+'6'| View shininess
+'7'| View toon shading
+'8'| View bloom effect
+'0'| Standard view
+'r'| Reset camera
+'x'| Toggle OpenGL Scissors
+
+Apart from this, WSADQZ and mouse can be used for movement.
 
 -------------------------------------------------------------------------------
-REQUIREMENTS:
+PERFORMANCE ANALYSIS 1: Packed G Buffer
 -------------------------------------------------------------------------------
+There is another branch on github named "PackedGBuffer" in which I have packed my G-Buffer in a different manner.
 
-In this project, you are given code for:
-* Loading .obj files
-* Rendering to a minimal G buffer:
-  * Depth
-  * Normal
-  * Color
-  * Eye space position
-* Rendering simple ambient and directional lighting to texture
-* Example post process shader to add a vignette
+The main difference lies in the way normals have been packed.
 
-You are required to implement:
-* Either of the following effects
-  * Bloom (feel free to use [GPU Gems](http://http.developer.nvidia.com/GPUGems/gpugems_ch21.html) as a rough guide)
-  * "Toon" Shading (with basic silhouetting)
-* Point light sources
-* An additional G buffer slot and some effect showing it off
+In the **original G-buffer**, there were separate G-Buffers for normals and shininess
 
-**NOTE**: Implementing separable convolution will require another link in your pipeline and will count as an extra feature if you do performance analysis with a standard one-pass 2D convolution. The overhead of rendering and reading from a texture _may_ offset the extra computations for smaller 2D kernels.
+Normals buffer:
 
-You must implement two of the following extras:
-* The effect you did not choose above
-* Screen space ambient occlusion
-* Compare performance to a normal forward renderer with
-  * No optimizations
-  * Coarse sort geometry front-to-back for early-z
-  * Z-prepass for early-z
-* Optimize g-buffer format, e.g., pack things together, quantize, reconstruct z from normal x and y (because it is normalized), etc.
-  * Must be accompanied with a performance analysis to count
-* Additional lighting and pre/post processing effects! (email first please, if they are good you may add multiple).
+Component|Data
+---|---
+Component 1| normal.x
+Component 2| normal.y
+Component 3| normal.z
 
--------------------------------------------------------------------------------
-README
--------------------------------------------------------------------------------
-All students must replace or augment the contents of this Readme.md in a clear 
-manner with the following:
+Shininess buffer:
+
+Component|Data
+---|---
+Component 1| shininess
+
+In the **packed G-Buffer**, the normals G-Buffer has
+
+Component|Data
+---|---
+Component 1| normal.x
+Component 2| normal.y
+Component 3| shininess
+
+For this, the third component of the normal was made on the fly using thie formula,
 
-* A brief description of the project and the specific features you implemented.
-* At least one screenshot of your project running.
-* A 30 second or longer video of your project running.  To create the video you
-  can use http://www.microsoft.com/expression/products/Encoder4_Overview.aspx 
-* A performance evaluation (described in detail below).
+```
+normal.z = sqrt(1- normal.x*normal.x - normal.y*normal.y);
+```
+
+Model|Lighting|Without packed G-Buffer(fps)|With packed G-Buffer(fps)
+---|---|---|---
+cornell_box.obj|Blinn-Phong|64.48|66.87
+cornell_box.obj|Bloom|7.29|7.28
+sponza.obj|Blinn-Phong|32.54|33.60
+sponza.obj|Bloom|6.52|6.54
 
 -------------------------------------------------------------------------------
-PERFORMANCE EVALUATION
+PERFORMANCE ANALYSIS 2: Effect of Bloom kernel
 -------------------------------------------------------------------------------
-The performance evaluation is where you will investigate how to make your 
-program more efficient using the skills you've learned in class. You must have
-performed at least one experiment on your code to investigate the positive or
-negative effects on performance. 
+Model: Cornell_box
 
-We encourage you to get creative with your tweaks. Consider places in your code
-that could be considered bottlenecks and try to improve them. 
+Blinn-Phong without bloom: 64.48 fps
 
-Each student should provide no more than a one page summary of their
-optimizations along with tables and or graphs to visually explain any
-performance differences.
-
--------------------------------------------------------------------------------
-THIRD PARTY CODE POLICY
--------------------------------------------------------------------------------
-* Use of any third-party code must be approved by asking on the Google groups.  
-  If it is approved, all students are welcome to use it.  Generally, we approve 
-  use of third-party code that is not a core part of the project.  For example, 
-  for the ray tracer, we would approve using a third-party library for loading 
-  models, but would not approve copying and pasting a CUDA function for doing 
-  refraction.
-* Third-party code must be credited in README.md.
-* Using third-party code without its approval, including using another 
-  student's code, is an academic integrity violation, and will result in you 
-  receiving an F for the semester.
-
--------------------------------------------------------------------------------
-SELF-GRADING
--------------------------------------------------------------------------------
-* On the submission date, email your grade, on a scale of 0 to 100, to Liam, 
-  liamboone@gmail.com, with a one paragraph explanation.  Be concise and 
-  realistic.  Recall that we reserve 30 points as a sanity check to adjust your 
-  grade.  Your actual grade will be (0.7 * your grade) + (0.3 * our grade).  We 
-  hope to only use this in extreme cases when your grade does not realistically 
-  reflect your work - it is either too high or too low.  In most cases, we plan 
-  to give you the exact grade you suggest.
-* Projects are not weighted evenly, e.g., Project 0 doesn't count as much as 
-  the path tracer.  We will determine the weighting at the end of the semester 
-  based on the size of each project.
+**With Bloom**
 
+Kernel Size| FPS
+---|---
+100 X 100| 7.29
+50 X 50| 13.10
+25 X 25| 22.42
+10 X 10| 35.93
+5 X 5| 47.29
 
----
-SUBMISSION
----
-As with the previous projects, you should fork this project and work inside of
-your fork. Upon completion, commit your finished project back to your fork, and
-make a pull request to the master repository.  You should include a README.md
-file in the root directory detailing the following
-
-* A brief description of the project and specific features you implemented
-* At least one screenshot of your project running.
-* A link to a video of your project running.
-* Instructions for building and running your project if they differ from the
-  base code.
-* A performance writeup as detailed above.
-* A list of all third-party code used.
-* This Readme file edited as described above in the README section.
 
 ---
 ACKNOWLEDGEMENTS
 ---
-This project makes use of [tinyobjloader](http://syoyo.github.io/tinyobjloader/) and [SOIL](http://lonesock.net/soil.html)
+Referred this paper for toon shading,
+http://www.cs.rutgers.edu/~decarlo/671/readings/decaudin_1996.pdf
+
+Referred this page for bloom(glow) effect. Implemented separable convolution technique
+http://http.developer.nvidia.com/GPUGems/gpugems_ch21.html
+

base/PROJ_WIN/P6/P6/P6.vcxproj

@@ -19,12 +19,14 @@
     <ConfigurationType>Application</ConfigurationType>
     <UseDebugLibraries>true</UseDebugLibraries>
     <CharacterSet>Unicode</CharacterSet>
+    <PlatformToolset>v110</PlatformToolset>
   </PropertyGroup>
   <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Release|Win32'" Label="Configuration">
     <ConfigurationType>Application</ConfigurationType>
     <UseDebugLibraries>false</UseDebugLibraries>
     <WholeProgramOptimization>true</WholeProgramOptimization>
     <CharacterSet>Unicode</CharacterSet>
+    <PlatformToolset>v110</PlatformToolset>
   </PropertyGroup>
   <Import Project="$(VCTargetsPath)\Microsoft.Cpp.props" />
   <ImportGroup Label="ExtensionSettings">
@@ -67,7 +69,7 @@
       <EnableCOMDATFolding>true</EnableCOMDATFolding>
       <OptimizeReferences>true</OptimizeReferences>
       <AdditionalLibraryDirectories>$(SolutionDir)$(Configuration);..\..\..\..\shared32\glew\lib;..\..\..\..\shared32\freeglut\lib;%(AdditionalLibraryDirectories)</AdditionalLibraryDirectories>
-      <AdditionalDependencies>freeglut.lib;glew32.lib;%(AdditionalDependencies)</AdditionalDependencies>
+      <AdditionalDependencies>freeglut.lib;glew32.lib;SOIL.lib;%(AdditionalDependencies)</AdditionalDependencies>
       <SubSystem>Console</SubSystem>
     </Link>
   </ItemDefinitionGroup>
@@ -83,6 +85,7 @@
   </ItemGroup>
   <ItemGroup>
     <None Include="..\..\..\res\shaders\ambient.frag" />
+    <None Include="..\..\..\res\shaders\bloom.frag" />
     <None Include="..\..\..\res\shaders\diagnostic.frag" />
     <None Include="..\..\..\res\shaders\directional.frag" />
     <None Include="..\..\..\res\shaders\pass.frag" />
@@ -91,6 +94,7 @@
     <None Include="..\..\..\res\shaders\post.frag" />
     <None Include="..\..\..\res\shaders\post.vert" />
     <None Include="..\..\..\res\shaders\shade.vert" />
+    <None Include="..\..\..\res\shaders\toon.frag" />
   </ItemGroup>
   <Import Project="$(VCTargetsPath)\Microsoft.Cpp.targets" />
   <ImportGroup Label="ExtensionTargets">

base/PROJ_WIN/P6/P6/P6.vcxproj.filters

@@ -67,5 +67,11 @@
     <None Include="..\..\..\res\shaders\shade.vert">
       <Filter>Resource Files</Filter>
     </None>
+    <None Include="..\..\..\res\shaders\toon.frag">
+      <Filter>Resource Files</Filter>
+    </None>
+    <None Include="..\..\..\res\shaders\bloom.frag">
+      <Filter>Resource Files</Filter>
+    </None>
   </ItemGroup>
 </Project>

base/PROJ_WIN/P6/SOIL/SOIL.vcxproj

@@ -20,10 +20,12 @@
     <ConfigurationType>StaticLibrary</ConfigurationType>
     <CharacterSet>Unicode</CharacterSet>
     <WholeProgramOptimization>true</WholeProgramOptimization>
+    <PlatformToolset>v110</PlatformToolset>
   </PropertyGroup>
   <PropertyGroup Condition="'$(Configuration)|$(Platform)'=='Debug|Win32'" Label="Configuration">
     <ConfigurationType>StaticLibrary</ConfigurationType>
     <CharacterSet>Unicode</CharacterSet>
+    <PlatformToolset>v110</PlatformToolset>
   </PropertyGroup>
   <Import Project="$(VCTargetsPath)\Microsoft.Cpp.props" />
   <ImportGroup Label="ExtensionSettings">

base/res/cornell/cornell_box.mtl

@@ -2,23 +2,42 @@ newmtl white
 Ka 0 0 0
 Kd 0.9 0.9 0.9
 Ks 0 0 0
+Ns 0.0
 
 newmtl red
 Ka 0 0 0
 Kd 1 0 0
 Ks 0 0 0
+Ns 2.0
 
 newmtl green
 Ka 0 0 0
 Kd 0 1 0
 Ks 0 0 0
+Ns 0.0
 
 newmtl blue
 Ka 0 0 0
 Kd 0 0 1
 Ks 0 0 0
+Ns 0.0
 
 newmtl light
 Ka 20 20 20
 Kd 1 1 1
 Ks 0 0 0
+Ns 0.0
+
+newmtl yellow
+Ka 0 0 0
+Kd 1 1 0
+Ks 0 0 0
+Ns 0.0
+
+newmtl purple
+Ka 0 0 0
+Kd 0.33 0.1 0.55
+Ks 0 0 0
+Ns 0.6
+
+