In the fourth stage of the proposed upsampling algorithm, the discarded pixels are recovered by fusing the interpolated pixels with the virtual view pixels in order to exploit the advantages of both types of approach and to compensate the compression distortion.
At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views.
The LR views will be upsampled by fusing the virtual view pixels with directional interpolated pixels with the aid of the pattern of the texture surrounding the discarded pixels.
Localization algorithm generates the spatial coordinates by fusing the calibration data, a pair of detected pixel points and the feedback angles of pan tilt units.
All recovered horizontal edges are obtained from the virtual view pixels, and the two diagonal direction pixels are obtained by equally fusing the directional interpolated pixels with the virtual view pixels.
In this case, the discarded pixels are recovered by fusing interpolated pixels with one of the available virtual views that gives the minimum differences when compared with original FR pixels.
Figures 5(d)–5(g) are the fused results obtained by fusing Figure 5(b) and Figure 5(c) with the pixel averaging method, the gradient pyramid method, the DWT method, and the proposed method, respectively.
This can be done by warping one of the views onto the other - for example, by rendering the right view using the left view pixels and the disparity map - and then fusing the two views.
Hence, the main idea of the proposed method is to fuse, one-by-one, the pixels of the input image expressed by six color spaces.
The idea is to fuse one-by-one the pixels coming from different information sources, in order to get a final reliable and accurate segmentation result.
