Apparatus and methods for the optimal stitch zone calculation of a generated projection of a spherical image

a technology of spherical images and optimal stitch zones, applied in the field of video image postprocessing, can solve the problems of unsatisfactory artifacts around stitch lines, compression techniques have been developed, and may be less than optimal when handling content embodied

Active Publication Date: 2018-04-12
GOPRO
View PDF0 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present patent provides methods and apparatus for optimally stitching together a spherical image of a panoramic image using a plurality of images. The technical effects include improved image quality and reduced bandwidth requirements for transmitting the image. The methods and apparatus can be used in various applications such as spherical camera systems and integrated circuits.

Problems solved by technology

Conventional stitching algorithms may result in undesirable artifacts around the stitch lines due to imperfections in the stitching process.
Moreover, prior techniques involved the use of equirectangular projections for handling these spherical images (e.g., for so-called virtual reality (VR) content) and accordingly compression techniques have been developed that may be less than optimal when handling content embodied within these equirectangular projections.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

first embodiment

[0055]FIG. 2A illustrates a process for stitching images captured by a spherical camera system 100 where the stitching zone runs along a meridian zone of the spherical image, while FIG. 2B illustrates example images resulting from the process of FIG. 2A. FIGS. 2A and 2B are described together for clarity and convenience.

[0056]Referring now to FIG. 2A, at step 202, an image sensor receives a first circular image corresponding to a first hyper-hemispherical field of view and a second circular image corresponding to a second hyper-hemispherical field of view. For example, as shown in FIG. 2B, a first circular image (e.g., image “A”) 250 and a second circular image (e.g., image “B”) 260 may be received at a video processing system. The first circular image 250 may represent, for example, the field of view captured by a first camera 110 (e.g., a front-facing camera) of a spherical camera system 100 and the second circular image 260 may represent, for example, the field of view captured b...

second embodiment

[0062]FIGS. 3A and 3B illustrate a process for stitching images in a spherical camera system 100 where the stitching zone now runs along the equatorial zone of the spherical image (as opposed to the meridian zone as shown in FIGS. 2A and 2B), while FIG. 3B illustrates example images resulting from the process of FIG. 3A. In other words, the stitching methodology of FIG. 3A only utilizes a single stitch line. FIGS. 3A and 3B are described together for clarity and convenience.

[0063]A first circular image 350 and a second circular image 360 may be received at step 302 at a video processing system, which may be similar to the first circular image 250 and second circular image 260 respectively discussed above. The first circular image 350 and the second circular image 360 may be projected at step 304 to a first rectangular image 352 and a second rectangular image 362 respectively. Here, instead of using a conventional equirectangular projection, a projection may instead be used in which ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

Description

RELATED APPLICATIONS[0001]This application is related to, U.S. patent application Ser. No. 15 / 234,869 filed Aug. 11, 2016 and entitled “Equatorial Stitching of Hemispherical Images in a Spherical Image Capture System”, which claims the benefit of priority to U.S. Provisional Patent Application Ser. No. 62 / 204,290 filed on Aug. 12, 2015, the contents of each of the foregoing being incorporated herein by reference in its entirety.COPYRIGHT[0002]A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.BACKGROUND OF THE DISCLOSUREField of the Disclosure[0003]The present disclosure relates generally to video image post-processing and in one exemplary aspect, to methods and apparatus f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(United States)
IPC IPC(8): G06T3/00G06T3/40
CPCG06T3/005G06T3/4038G06T3/0068H04N23/45H04N23/698G06T3/12G06T3/08G06T3/14
Inventor ABBAS, ADEELMACMILLAN, TIMOTHYDOUADY-PLEVEN, CESAR
Owner GOPRO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products