Imagine you want to mask/hide some parts of your images, like windows, water, sky, shadows, vegetation, or noise, so that they will not be used in the reconstruction. Masks can also help the reconstruction when you need to turn the scanned object on its side, upside down or just around to capture all details in a more convenient way. You can create alpha masks in an external image editing software and bring the masked images into RealityCapture (RC) or generate and export them automatically directly through this application.
Masks represent a non-destructive way of editing images. They may be separate (png) images or the information on your selection can be added to the originals (saved as tiffs).
They are stored in alpha channels and come as grayscale images.
Areas painted black are unmasked, the white areas are masked. You can possibly use up to 256 shades of grey in an alpha channel. However, for purposes of use in RC, we do not recommend you to use any level of transparency in the masked areas of images and apply any filter in the images, since it could confuse its algorithms during processing. The alpha channels are specifically used during feature detection and meshing.
You can check the masks directly in RC. This is how you do that:
To display an image back, click the Source part of the Image 2D/VIEW tab.button in the
You can also select between the imported layers in the Source panel by pressing the TAB key on the keyboard.
When exporting a mesh in obj, fbx, dxf, dae, bvh, htr, trc, asf, amc, c3d, aoa, or mcd formats, you can find Export texture alpha in the Texturing settings of the Export Model window, and set it to True in order to export the mask.
Masks can be generated and exported automatically through the Depth and Mask button in the Export part of the MESH MODEL tab or the SCENE 3D/TOOLS tab.
Depth maps (defining a distance between the camera and the surface that it is looking at) define which part of the inserted object is visible. They are created from a rendered reconstructed mesh used for automatic fitting the object into the image. Their output format is .exr for depth layers and .png. for masks.
In the 'Export Depth Maps and Masks' dialog window, you can define separately whether you want to export mesh masks and/or camera depths maps. For explanation of the undistortion settings in the export dialog, please navigate to Undistorted Images.
Masks can be imported back to RealityCapture by Drag & dropping them back to RealityCapture after exporting them to the same folder as original inputs are located.
When using masks, you can choose if you: