Sunday, 14 December 2014

Conclusion

Over the course of this module, I have learned a great amount about integrating a CG object into a live action plate. From capturing the initial plate, to good modelling practice, to HDRI capture/manipulation, to shading, to lighting, rendering and finally compositing using a linear workflow. Overall, I am happy with the 2 images I was able to produce and ready to learn more about CG integration.

Exterior Shot


After applying similar techniques to the interior shot,  I rendered out passes for the exterior shot and composited them together.

To create this shot, I copied the same render layers I used for the interior shot, then changed the lighting conditions from point lights, to a directional light. 

Adding the background:
To add the background into the maya scene, I needed to track the scene first to get points in 3D place. I used Camera Tracker for this, making sure to apply the measurements I took from the location to apply to scale constraints.

The error rate was 0.60 which was very useful to create an accurate 3D scene. I then used a merge geo and write geo to write out both the point cloud data, and the camera data as FBX files, for use in maya.

I then imported the background image as an image plane, and the camera and point cloud data. 

I then used the same render passes to create the scene. After testing the final gather settings (150) and unified sampling (1) numbers. I then rendered out the passes for compositing.

Here is a look at my node tree:
Following the same workflow as before was useful to get a good base. However I changed the shadow integration:

I shuffled the alpha from the shadow into the rgba channels, then used that as a mask in a colour correction node, attached the background. This meant that I could colour correct the shadow using the colour information from the background, giving a more realistic result. After applying a colour correction to both, adding grain, chromatic abberation etc. I was ready to export the finished sequence.



Tulip Petal Shader

Here is the last and final piece of shading for my model. To create the tulip petals, I downloaded a royalty free image of a petal
Then, I projected it onto the leaf mesh using a camera projection. Then I colour corrected the image using desaturate and adjusting the levels to get a bump channel. I wanted to create a metallic petal, but still include the complexity by using a leaf as well. So I created two shaders: a mia_xpasses shader with the flower texture as the color element, and a mia_xpasses shader with purple brushed metal material (using manipulated anisotropic reflections). I then used a layered shader and applied both shaders to them. I then separated the two with a black and white node, being output as an alpha and applied to the alpha channel in the layered shader.

Reference Photos for Interior Shot




To help with integration of the CG object, I returned to the location to take reference phototgraphs of the light sources in the environment. This would help me greatly in creating a more photorealistic render.

Interior Shot

After completing the rendering of all passes and compositing. Here is the finished image for the first shot:
Overall, I am happy with the outcome of the composite. I think the main strengths of the shot are the blur level and the colour correction in the scene. However I think the shadows are a little too dark for the scene.

Here is breakdown of the multipass workflow:

Placing the lights and matching shadowing of matte ball photograph.

Adding more lights to illuminate the object 

Testing IES lighting profiles for more realistic lighting

Placing shadow geo/creating white bounce cards for Final Gather.
To integrate the CG object into the scene, I imported the photograph into the scene using a camera map node, plugged into the Rayswitch node. From here, I imported the HDRI images I created for the environment into mirrorball nodes, plugged into the rayswitch node. Then I looked at my reference images for the lighting conditions and placed point lights accordingly around the room. To add more realism to the lighting, I tested IES profiles on point lights. In the end I chose an overhead profile as I thought this gave the most realistic shadows. I then created my stand in geometry to catch shadows of the box and the table legs.

When setting up the render passes I created Master Beauty (containing alpha, diffuse, specular, indirect, refraction and reflection passes), Ambient Occlusion (one for the floor, and one for the object for further control), Shadows (one for the shadows caught by the object, and one for the floor) and finally a colour matte (splitting the geometry into the red, green and blue channels. So I mapped the plant pot to the red channel, the top of the plant pot to the green channel, and the flowers to the blue channel). I rendered them all as individual targa files, which gave me control of having an alpha channel, as well as have separate parts to composite.

Here is the compositing workflow breakdown:



Tuesday, 2 December 2014

Shading + Integration

I have been working on more shading materials for my plant. In particular, I have been experimenting with layering multiple shaders together, as well as creating a brushed metal material with anisotropic reflections. Here is the grabs of today's work:

To begin with, I focussed on shading of the 'sunflowers'. As a base for my shading network, I applied an mia_material_x_passes material to the petals, where I made it a metal material. I wanted to create a reflective gold type material, so I set my 0 degree value to 0.8


(in BRDF settings) then change the reflection colours to a more yellow/gold colour to represent the sunflower petals. To add further detail, I mapped a ramp to the top of the petals (using a simple planar projection) and added different shades of yellow and added a dirt image to give more ageing to the model. For the stem of the sunflower, I wanted to make the plant look more organic and resemble a real flower, so I wanted to reuse the material originally, used to create the pipe covers of the tulip flower, then merge this into a brushed metal. To create this, I mapped another ramp node using a sampler info node (cylindrical mapping). Originally, I used the sampler info node, however, it did not give the desired results I wanted. Following this, I then created the brushed metal by creating a very rough, non-glossy metal with anisotropic reflections. When I researched into brushed metal, I noticed that the surface detail runs perpendicular to the reflections, creating a distinguishing look.

In addition to shading, I have began integrating the object and added an mental ray light (area light), with the HDRI, Final gather map and background image mapped to a rayswitch node plugged into the render camera. In addition, I have set a ground plane to catch shadows. As far as shading goes, I am aound 85% complete. Then lighting and integration is the next step.




Friday, 28 November 2014

Shading Update

Here is the most recent render of my project:



So far, I have shaded the plant pot, the pipe plant stems and the glass plant in the centre. I have added a dirt map to the top of the plant pot to add more imperfections to the model. As for the plant stem, I have created a shader that is a combination of frosted glass and a shiny plastic. After looking at plant stems up close, it is clear that there is some translucency to the edges showing a different colour. To replicate this in Mental Ray, I mapped a sampler info node (facing ratio) to a V ramp (with different variations of green). I then took a volume noise node, then applied it to the bump channel.

The next steps:

To complete the shading of the model (first version). To do this I will now look into adding fur to the other plant stem. Then I will shade the leaves using SSS nodes.


Interior Shot

The interior shot for the assessment has been shot and edited. Here is the material I collected:

Plate


Lat-long map (no blurring)
Blurred map (for Final Gather)
Colour Grid (for white balance)
In the end, I changed my mind on capturing images from the National Museum of Scotland. This was because there would be a lot of tourists which would affect the HDRI. So I decided to choose a more quiet location - the Eric Liddell centre. This location was much more quiet and would allow me to capture everything I needed.

The image I captured is good and I am happy with the results. However, the feel of the image has changed. In this instance, the plant inserted will sit next to other objects which are on a sale.



Matte Ball (lighting reference)

Monday, 24 November 2014

HDRI completion

Since previous posts, I had made a decision to use a 'ready-made' HDRI to use as the lighting for the module. Since the HDRI had already been captured, I thought it would be useful to gain experience merging and creating HDRI images. 

Here is some images of my progress:

 After importing the images through Photoshop's Merge to HDR Pro function, adjusted the images colour information, ready for import into Nuke.

Inside of Nuke, I unwrapped the image using the Spherical Transform node. From there I colour corrected the images and used roto nodes to remove the photographer from the images.

Despite some issues with colour temperature, overall I am happy with the image.

Monday, 17 November 2014

Materials - Plant Pot


To date, I have been working on a solid copper material for the the plant pot. This task has proved very challenging and has still some work to go before it is perfected.

In image 1, I started originally with a basic brown/red colour generated from a cloud 3D texture. From here, I then added this to the diffuse parameter of a mental ray architectural material (mia_material_x_passes). I then referenced the refractive index website to get an accurate IOR (Index of Refraction) for a copper material. This meant that the object would behave correctly when placed in the environment. From here I wanted to add a hammered bump map to the material, to give more depth and add more visual interest. Here is a sample image I used as a reference:


In order to achieve this effect, I created a ramp node, with a with a circular falloff. In the 2D placement node, I then adjusted the repeats of the texture to 30 on both the U and V coordinates. This gave the effect shown in image 4. Overall I am pleased with the outcome of this effect so far. To add more detail to this, I will add more procedural ageing such as dust and dirt. I think the best method of creating this would be through 3D texture nodes. More experimenting is needed.

NOTE: to help my shading skills, I have referenced Maya's inbuilt shader presets in order to give myself a reference to work up to. I find this process has helped me achieve more realistic results as well as increasing my knowledge of Mental Ray.

The next steps for the remaining pressure dial and button elements on the plant pot, I will apply a mix of copper, chrome and glass shaders to accent this area of the pot. Here is a work in progress:



Update on filming and static shot

In the past couple of weeks, I have learned a lot of ways of shading, lighting and integrating my CG object into live action and static shots. From acquisition of my moving shot, I have came across the following issues:
  • The bench is too close to the camera (where I wanted to place the plant pot). To fix this I have began a removal of the bench to just reveal the grass, allowing for the plant to be the subject of the shot. At the moment, the shot is progressing and more information will be documented on this in the next post.
  • The HDRI was captured at a different time and day of the shot, making the colours different. In addition, there was no matte ball captured in the scene, as well as there was faults in the image. So I feel that the acquisition of this shot has not turned out as well as I had hoped. This was largely due to lack of planning for contingency.


Taking the HDRI into consideration, I have two options to progress with the video section of the project, re-capture the HDRI again to ensure the matte ball is included, or use a stock HDRI from the sIBL Archive. Both options will deliver. In this case, I will be using a stock HDRI.


As for the interior shot, I have decided to focus capturing the HDRI and matte ball myself, learning from my previous experience. As for the location of the interior shot, I want to give the plant value and emphasise complexity by integrating the plant in a museum setting. To achieve this, I have contacted the National Museum of Scotland, asking for permission to photograph the main area. I feel the plant will fit nicely in this setting and will help suspend the audiences disbelief. In addition to appropriateness of the location, the lighting of the location is well lit and provides a nice even lighting, which will make my HDRI very useful.


Photography of this location will take place as soon as possible (assuming permission is given). If I do not get permission to photograph this location, I will recreate a similar location to replicate a museum setting.





Saturday, 1 November 2014

Shot preparation

In this post I will outline my decisions for 3d integration of my plant into live action. 

When I filmed this shot I originally wanted to place the plant in front of the bench. However for the majority of the shot, the plant is too close to the camera and is showing enough of the plant. This would render the shot irrelevant with no visual interest. To solve this issue, I will manipulate the footage to paint out the foreground bench. Once the bench is removed, I will then place the bench further along to make more space for the plant. 

As I have began to learn more about match moving and 3d integration. I realise in order to create a realistic 3d scene from the footage, setting scale and proportions is essential. So I will revisit the place where I captured the footage and measure a distance of an object in the foreground (for example the bench). Will allow for accurate solving with camera tracker. 

In addition capture of the environment lighting can be done at the same time. At the moment, I am adding more details to my textures and making sure that the materials I have selected are working. This process is very iterative and I will continue to add and make changes right up until final render into passes. 

Monday, 20 October 2014

Live action filming

After finishing the model. It is important in texturing/shading that the environment is considered early on. For this project I wanted to integrate my plant into an open and inviting place. The obvious choice was the meadows.

Shot planning
In the planning stage of filming, I wanted to get smooth and clear motion, to focus on the subject in the shot. So I made the decision to use a camera slider attached to a tripod.

The main idea behind my shot was to keep the shot simple and the integration subtle. Here is a frame from the shot:

From this shot. The plant will be integrated in front of the bench. The main purpose of this shot is to convey complexity and subtlety of nature. By choosing the bench as a subject, the plant visual effect should look 'invisible'. Here is the first frame from the shot:


Since this shot has moving elements (leaves on the trees), I will research into animating the plants in the pot to move with a 'wind' like force. This will add to the realism and will help integrate the plant making the shot more seamless. 

Unfortunately, due to booking issues, I was unable to capture HDRI information on the same day. The solution to this problem will be to return to the same location (at roughly the same time of footage capture) to photograph the HDRI using a chrome ball. 

Aside from the HDRI problem, I am happy with the shot and compositing this shot together will be fun.

Next Steps:
Continue texturing/shading plant model. 

Tuesday, 14 October 2014

See the big picture

Today has been focused on portfolio. To date, my portfolio looked very thin and not interesting. Since it will be the first point of contact for me when I graduate. I have dedicated some time to this. So I have updated all of my current work including this project (which is still a work in progress). My main goal when I finish university is to enter creative industries related employment within the first year of graduating. So making contacts and improving my portfolio can only help my chances of achieving this goal. So I have linked to this live blog to add more information for those who are interested. I have used Behance for my portfolio for two main reasons: it's easy and quick to update, and it allows to connect to multiple social networks alongside the adobes creative cloud. Ideal for my purpose. I'll upload a link to my Behance very soon. 


Saturday, 11 October 2014

Modelling Process Finished

At this point in the process. The model is now complete and the shading portion of the project can now begin. During this process the following must happen:
  • Acquisition of material - For this project, I am required to render two shots (a static photograph and a moving video) of an interior and exterior scene, for which one has to be filmed by myself. Due to the lack of royalty free material (that I can afford), I have decided to film the video and download a royalty free image.
  • Capture Environment - There is a very useful kit bag containing a chrome ball and a tripod. This will be very useful in creating my own HDRI images for image based lighting. In addition, once I have sourced a royalty free image (for my interior shot), I may still create my own HDRI to give me more control.
I have began to research into the complexities of Mental Ray and will continue learning as much as possible. The most interesting part of Mental Ray is the attention to detail with real physics and applied mathematics to create lifelike renders. 

From this development. More posts with test renders and the outcomes of the footage acquisition stage will be posted.

Tuesday, 7 October 2014

Updated Design

Here is the updated model from previous feedback:



















The design is really beginning to take shape and become more lifelike. I added more details to my 'sunflower', with a more organic stem and leaves protruding out. One of my final adjustments (until I think of another one) will be adding more detail to the stem of my 'tulip'. To do this I will add leaves that will derive from the base of the stem. Here is some reference photos:

Update 07/10/2014

After sending my recent designs, I have received some feedback:

My model is improving in complexity but could be improved by adding more lifelike realism to the flower stems. Again, I began researching back into flowers and picked up on a couple of things:

Close up, there are very subtle details such as hair strands or thorns that add more realism to a flower. To achieve this effect, I have researched into Maya's Fur generation tools. At first glance, Maya Fur is a flexible tool which allows to generate thousands of hair strands on a model which can be fine tuned in terms of thickness and randomness. However, this may add to render times so I will continue researching into adding Fur.

In addition, flower stems are organic and are not 'perfect'. The main issue with my plant stems are they are too static. In order to solve this issue, I will create a more wavy stem that will add to the realism of the plant. This will be modelled using simple NURBS extrusion with curves. From this I will then tesselate the object back to polygons to add further detail such as fur.

As I continue the modelling process of my plant. I am continuing to familiarise myself with Mental Ray and proper texturing processes. After this section of the model is completed, UV mapping of the object will then commence.

Saturday, 4 October 2014

Update 04/10/2014

I received feedback I have made more changes to my model. So far I have kept my plant pot as it is for the moment. This allowed me to focus more on creating the flowers. I have modelled two flowers (one inspired by a tulip, and the other a sunflower). Here is the model to date:


Perspective View
So in comparison from my original design, I went back and looked at anatomy of a flower. This helped me look into the details that make up a flower. From my initial research into flower anatomy, I then began to sketch a design for my flower, replacing parts of the flower with metallic parts (for example I replaced the receptacle with a gimbal - see below). In addition, to add further interest and complexity to my flower, I added a spring to the stem to give the impression of flexibility.

I modelled the first flower (the 'tulip') mostly using polygons. The flower petals and pistil were modelled using NURBS and bend deformers.

However, I created my second flower (the 'sunflower') using only polygons. I wanted to create an aeroplane rotor blade to represent the complexity of the sunflowers petals. In order to create this, I created a simple cube and added a twist modifier. Then I used the 'duplicate special' function to copy the blades around the centre of the flower.

Overall, I am happy with the current design and I will be submitting this design for further feedback.
Tulip Anatomy

Front View
Sunflower Inspiration

Wednesday, 1 October 2014

First Feedback

Today, I submitted my most recent model for feedback. Here is a summary of the feedback I received:

  • The model fits the brief, however the design of the flowers lack complexity. The main aim of the project is for the plants is to reflect visual interest.
This information will help me build on my current model and continue to improve. So my next steps are to focus on a solid design for the flowers in my plant pot. Once I am happy with a design, I will begin modelling and attaching to my existing plant pot.


Monday, 29 September 2014

Progress 29/09/2014

At the moment, I have received the brief and I am in the process of modelling the plant. So my initial design ideas for a metallic plant, the steampunk theme stood out to me. Here is a screen grabs of my initial design:


After looking at designs of steampunk items, I wanted a very sharp and blocky feel to my plant, however it would still have a sense of value and robustness. I added a pressure gauge, complete with red, amber and green warning lights to help add to the steampunk feel. In addition, I added a plate which would have an engraving on it, to give my plant an antique feel as well as adding to the value of the object.

The plants which sit on top are currently work in progress. However, my main intentions is to build a series of plants to sit in the pot that are made up of mechanical parts. So I modelled the first set of flowers by using cogs stacked on top of each other, with their stems made of steel pipe.

As for the texturing element of this project, I would like the following texture scheme:

  • The plant pot will be polished brass, and the engraved plate and pipes will be steel. 
  • The pressure gauge will be textured with an image with a glass shader on top. 
  • The plant stems will be steel with the pipe fittings a metallic red. 
  • The cogs (flower petals) will be stainless steel.
Further Design Ideas:
To add more fullness to the plant, I will fill out the plant with steel wire (with bolts as flowers) to resemble a small bush.

Animation Ideas:
For the 3D integration into live action part of the assessment, I have some ideas to give the plant more life:

  • Animate the plants to follow people walking by.
  • Animate the warning lights (with a simple glow). 
To sum up this entry, I am still working through the modelling process and beginning to flesh out ideas about textures/shaders and potential animation ideas. I have now sent my initial idea for some feedback. An evaluation will soon follow...

Opening Post

Here is a blog that will document all of my thoughts/processes throughout the Advanced 3D Design module.