Special issues with fisheye lenses

From PanoTools.org Wiki
(Difference between revisions)
Jump to: navigation, search
m (Other Links: url updated)
 
(40 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
== Introduction ==
 
== Introduction ==
  
Fisheye lenses and adapters are very popular because they allow full-spherical panoramas to be constructed from just a few images -- as few as 2 or 3, more typically 6 or 7.
+
Fisheye lenses and adapters are very popular because they allow full-spherical panoramas to be constructed from just a few images -- as few as 2 or 3, more typically 4-7. Their vast [[Field of View]] is achieved by a special mapping of the reality to the flat image. See [[Fisheye Projection]] for details.
  
There are a few issues that are specific to fisheye lenses and adapters.
+
== Types of Fisheye Images ==
  
 +
Consider the following five images:
  
== Nodal Point (Entrance Pupil) ==
+
[[Image:FisheyeTutorialWideRectOnFilmThumbnail.jpg]]
 +
[[Image:FisheyeTutorial16mmFisheyeOnFilmThumbnail.jpg]]
 +
[[Image:FisheyeTutorial8mmFisheyeOnFilmThumbnail.jpg]]
 +
[[Image:FisheyeTutorial8mmFisheyeOnD300Thumbnail.jpg]]
 +
[[Image:FisheyeTutorial8mmFisheyeOnD300TippedThumbnail2.jpg]]
  
Fisheye lenses and adapters do not have a single nodal point (entrance pupil) as most rectilinear lenses do.  Instead, the nodal point of a fisheye lens depends on the angle from the lens axis, typically moving forward as the angle increases from 0 degrees to 90 degrees.
+
* The first image, for reference, is from a conventional rectilinear wideangle lens. [*]
  
In theory, this means that it is impossible to get a perfectly stitched panorama from a fisheye lens.   
+
* The second image is '''"full-frame"''' fisheye, using a lens with supposed 16mm focal length to fill a 36x24mm frame on filmThe usable fov of this image is about 98 degrees horizontal by 147 degrees vertical. However, the widely used Zenitar 16mm fisheye has only about 82 degrees horizontal and 125 degrees vertical FoV, which suggests that its actual focal length is slightly more than 17mm.
  
In practice, stitching can be almost perfect if you calibrate your nodal point using the same angle that you usually use for stitching.
+
* The third image is '''"full circular"''' fisheye, using an 8mm focal length lens to place its entire 22.08mm image circle within a 36x24mm frame on film.  The usable fov of this image is 180 degrees horizontal and vertical.
 +
 
 +
* The fourth image is "'''portrait cropped circular"''' fisheye, using the same 8mm focal length lens, but now with a Canon 300D digital SLR whose sensor size is only 22.7x15.1 mm ([[crop factor]] 1.6).  The usable fov of this image is only about 120 degrees horizontal by 180 degrees vertical.
 +
 
 +
* The final image is a "'''diagonal cropped circular"''' fisheye, using the same 8mm lens and Canon 300D digital SLR, but now tipped so that the diagonal of the sensor is vertical.  The usable fov of this image is about 145 degrees horizontal by 180 degrees vertical.
 +
 
 +
[*] Actually these images are all computationally extracted from a spherical panorama, using Panorama Tools and Photoshop.  They agree well with real images from a Sigma 8mm F4 EX on Canon 300D, but comparison with other lenses will be approximate.
 +
 
 +
== Number of Images Needed for Full Spherical==
 +
 
 +
* For full-frame fisheye, the number of frames depends on the focal length.  The illustrated case should work with 4 around plus zenith and nadir (6 total). For the Zenitar 16mm it is at least 5 (better 6) around plus zenith and nadir. (All for 36x24mm film or full frame sensor in portrait orientation).
 +
 
 +
* In theory, 2 full circular fisheyes are enough, but quality around the seams will probably suffer. 
 +
 
 +
* 3 full circular fisheyes are enough to give good overlap at the equator.
 +
 
 +
* 3 portrait cropped circular fisheyes are not enough -- there will be small holes at the equator.
 +
 
 +
* 3 diagonal cropped circular fisheyes are enough to get good overlap. 
 +
 
 +
* 4 portrait cropped circular fisheyes are also enough. 5 should be better but is not talked about much. (Maybe odd numbers make people uncomfortable.)
 +
 
 +
* 6 portrait cropped circular fisheyes seems to be popular. 
 +
 
 +
Zenith and nadir (the poles) are liable to be soft if the camera is perfectly level, because those areas come from the very edge of every frame.  They can be improved by shooting separate zenith and/or nadir images.  If you shoot the equatorial images tipped slightly up or down, then you can get overlap and improved quality for free at one pole.  The other pole can be covered by a separate zenith or nadir shot, or with a reflective ball, logo, or Photoshop clone tool if it's not important.
 +
 
 +
When shooting handheld or on [[monopod]], more overlap is safer than less.  Many people get good results with 6 around plus zenith and/or nadir if those are important.
 +
 
 +
== Entrance Pupil (No-Parallax Point) ==
 +
 
 +
Fisheye lenses and adapters do not have a fixed entrance pupil ([[no-parallax point]]), as most rectilinear lenses do.  Instead, the entrance pupil of a fisheye lens depends on the angle from the lens axis, typically moving forward as the angle increases from 0 degrees to 90 degrees.
 +
 
 +
In theory, this means that it is impossible to get a perfectly stitched panorama from a fisheye lens.
  
 +
In practice, stitching can be almost perfect if you calibrate your camera mount using the same angle from lens axis that you usually use for stitching.
  
 
== Control Points ==
 
== Control Points ==
Line 23: Line 61:
 
You do not need a lot of control points to get good stitching with fisheye lenses.  If you have properly calibrated your a/b/c lens distortion parameters, then placing only 3-4 control points on each seam often yields good results.
 
You do not need a lot of control points to get good stitching with fisheye lenses.  If you have properly calibrated your a/b/c lens distortion parameters, then placing only 3-4 control points on each seam often yields good results.
  
== Number of Images ==
+
== Chromatic Aberration ==
  
In theory, 2 full-frame fisheye's are enough, but quality around the seams will probably suffer(There are also legal issues here. One IPIX patent specifically targets this case.)
+
Some fisheye lenses show significant color fringing caused by lateral [[chromatic aberration]] of a type that is well corrected by the Photoshop RAW converterThe Sigma 8mm f4 EX is one such lens, as described for example on [http://michel.thoby.free.fr/SIGMA8mm/CorrectionCA&FO/PS_CS_ability.html  Michel Thoby's page]
  
3 side-cropped fisheyes are enough, if you tip the camera so that sensor diagonal is vertical. This gives enough hfov to overlap around the equator. Zenith and nadir quality will still probably not be so good.
+
Other fisheyes suffer from non-linear lateral (also called transverse) [[chromatic aberration]] which is not easily corrected with the RAW converter since correction in one area causes fringing in another area. This can be solved with the [[Panorama Tools Plugins]] Correct-> Radial Shift filter which allows for very sophisticated corrections. There is an excellent way to determine correction parameters using [[PTShift]] from [http://www.pinlady.net/vr/ Eric Gerds page]
  
4 side-cropped fisheyes in portrait orientation is enough. 5 should be better but is not talked about much. (Maybe odd numbers make people uncomfortable.)
+
== Other Links ==
  
6 seems to be popular. Zenith and nadir are still liable to be soft.
+
See [http://johnhpanos.com/360tute.htm John Houghton's tutorial] for tips.
 +
See [http://panopticus.altervista.org/fishlist/fishlist.htm Luca Vascon's FishList] for a complete catalogue of all fiheye lenses.
 +
For highly technical discussion, see [http://www.pauck.de/marco/photo/stuff/peleng_fisheye/fisheye_performance_comparison/fisheye_performance_comparison.pdf "Fisheye lens designs and their relative performance" (Kumler and Bauer, SPIE 2000)].
  
Shooting handheld or on monopod, some people get good results with 6 around, tipped slightly up or down, plus a nadir or zenith to fill in the hole. That gives overlap everywhere.
+
[[Category:Tutorial:Basic need]]

Latest revision as of 12:49, 12 February 2010

Contents

[edit] Introduction

Fisheye lenses and adapters are very popular because they allow full-spherical panoramas to be constructed from just a few images -- as few as 2 or 3, more typically 4-7. Their vast Field of View is achieved by a special mapping of the reality to the flat image. See Fisheye Projection for details.

[edit] Types of Fisheye Images

Consider the following five images:

FisheyeTutorialWideRectOnFilmThumbnail.jpg FisheyeTutorial16mmFisheyeOnFilmThumbnail.jpg FisheyeTutorial8mmFisheyeOnFilmThumbnail.jpg FisheyeTutorial8mmFisheyeOnD300Thumbnail.jpg FisheyeTutorial8mmFisheyeOnD300TippedThumbnail2.jpg

  • The first image, for reference, is from a conventional rectilinear wideangle lens. [*]
  • The second image is "full-frame" fisheye, using a lens with supposed 16mm focal length to fill a 36x24mm frame on film. The usable fov of this image is about 98 degrees horizontal by 147 degrees vertical. However, the widely used Zenitar 16mm fisheye has only about 82 degrees horizontal and 125 degrees vertical FoV, which suggests that its actual focal length is slightly more than 17mm.
  • The third image is "full circular" fisheye, using an 8mm focal length lens to place its entire 22.08mm image circle within a 36x24mm frame on film. The usable fov of this image is 180 degrees horizontal and vertical.
  • The fourth image is "portrait cropped circular" fisheye, using the same 8mm focal length lens, but now with a Canon 300D digital SLR whose sensor size is only 22.7x15.1 mm (crop factor 1.6). The usable fov of this image is only about 120 degrees horizontal by 180 degrees vertical.
  • The final image is a "diagonal cropped circular" fisheye, using the same 8mm lens and Canon 300D digital SLR, but now tipped so that the diagonal of the sensor is vertical. The usable fov of this image is about 145 degrees horizontal by 180 degrees vertical.

[*] Actually these images are all computationally extracted from a spherical panorama, using Panorama Tools and Photoshop. They agree well with real images from a Sigma 8mm F4 EX on Canon 300D, but comparison with other lenses will be approximate.

[edit] Number of Images Needed for Full Spherical

  • For full-frame fisheye, the number of frames depends on the focal length. The illustrated case should work with 4 around plus zenith and nadir (6 total). For the Zenitar 16mm it is at least 5 (better 6) around plus zenith and nadir. (All for 36x24mm film or full frame sensor in portrait orientation).
  • In theory, 2 full circular fisheyes are enough, but quality around the seams will probably suffer.
  • 3 full circular fisheyes are enough to give good overlap at the equator.
  • 3 portrait cropped circular fisheyes are not enough -- there will be small holes at the equator.
  • 3 diagonal cropped circular fisheyes are enough to get good overlap.
  • 4 portrait cropped circular fisheyes are also enough. 5 should be better but is not talked about much. (Maybe odd numbers make people uncomfortable.)
  • 6 portrait cropped circular fisheyes seems to be popular.

Zenith and nadir (the poles) are liable to be soft if the camera is perfectly level, because those areas come from the very edge of every frame. They can be improved by shooting separate zenith and/or nadir images. If you shoot the equatorial images tipped slightly up or down, then you can get overlap and improved quality for free at one pole. The other pole can be covered by a separate zenith or nadir shot, or with a reflective ball, logo, or Photoshop clone tool if it's not important.

When shooting handheld or on monopod, more overlap is safer than less. Many people get good results with 6 around plus zenith and/or nadir if those are important.

[edit] Entrance Pupil (No-Parallax Point)

Fisheye lenses and adapters do not have a fixed entrance pupil (no-parallax point), as most rectilinear lenses do. Instead, the entrance pupil of a fisheye lens depends on the angle from the lens axis, typically moving forward as the angle increases from 0 degrees to 90 degrees.

In theory, this means that it is impossible to get a perfectly stitched panorama from a fisheye lens.

In practice, stitching can be almost perfect if you calibrate your camera mount using the same angle from lens axis that you usually use for stitching.

[edit] Control Points

The autopano program often does not find control points that are good for fisheye stitching. It has a tendency to clump many control points in a small area, leaving large areas with no control points at all.

Manual control point placement is more reliable and often worth the trouble.

You do not need a lot of control points to get good stitching with fisheye lenses. If you have properly calibrated your a/b/c lens distortion parameters, then placing only 3-4 control points on each seam often yields good results.

[edit] Chromatic Aberration

Some fisheye lenses show significant color fringing caused by lateral chromatic aberration of a type that is well corrected by the Photoshop RAW converter. The Sigma 8mm f4 EX is one such lens, as described for example on Michel Thoby's page

Other fisheyes suffer from non-linear lateral (also called transverse) chromatic aberration which is not easily corrected with the RAW converter since correction in one area causes fringing in another area. This can be solved with the Panorama Tools Plugins Correct-> Radial Shift filter which allows for very sophisticated corrections. There is an excellent way to determine correction parameters using PTShift from Eric Gerds page

[edit] Other Links

See John Houghton's tutorial for tips. See Luca Vascon's FishList for a complete catalogue of all fiheye lenses. For highly technical discussion, see "Fisheye lens designs and their relative performance" (Kumler and Bauer, SPIE 2000).

Personal tools
Namespaces

Variants
Actions
Navigation
tools
Tools