PanoTools.org Wiki - User contributions [en]

User:Albiorix

2009-04-17T19:35:59Z

Albiorix: /* GSoC project */

==Lighttwist==
Lighttwist [http://vision3d.iro.umontreal.ca/category/projet/lighttwist/] is an application that allows projecting images on planar and non-planar surfaces. It creates an immersive experience by compensating for irregularities and deformation of the projection screen. Lighttwist deals with images, video or 3D and can also synchronize images with sound from several speakers.

=====Set up=====
* surface to be projected on;
* projector(s);
* camera (sees what the viewer will see);
* network for synchronization between the camera and projectors.

==Applications==
Great thing about Lighttwist is its scalability. Setting up network with multiple computers is not necessary. One of the solutions for home use is to get a video splitter to split the DVI output from the computer to control several projectors (there is a variety of mini projectors on the market suitable for use in the small rooms).
Again, main purpose of Ligttwist is to create an immersion experience, which allows to showcase artistic work with bigger impact on the viewer. But besides that there were also proposed various different uses for the Lighttwist, such as using it in the surgery room [http://www.lighttwist.org/twiki/pub/V3D/PublicationsScientifiques/tardifj_projector_EMBC03.pdf] or in the classrooms (e.g. planerariums, presentations, as proposed by Yuval Levy).

==Description of the problem==
* Simplest case
: Screen to be projected on is flat, projector and camera are perfectly aligned. We only need to find the invertible map that transforms pixel coordinates from the camera space to the projector space. Only in this simple case we can use homographies represented by 3x3 invertible matrices
* General case
: Geometry of the screen is arbitrary, multiple projectors are not necessarily aligned with the user. Also requires catadioptric or fisheye lens to capture what observer sees in this case. Since use of homographies to establish correspondence between the camera space and projector space is no longer possible, use other techniques, such as structured light. [http://mur08.iro.umontreal.ca/wp/wp-content/uploads/2008/09/tardifj_multiprojectors_3dim03.pdf].

==Challenges==
* Resolution
:: There is a big difference between the resolution of a camera and projector(s). The ratio is normally 4:1 (camera having approx. 1000x1000 pixels and projectors 4000x768 pixels) and can go up to 8:1 when projecting on a hemisphere.
* Size of the images
:: It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* Lack of content of appropriate quality
:: It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution.

==GSoC project==
Right now Lighttwist is able to project a single row of images. To create a seamless picture, areas illuminated by different projectors must overlap, but these areas also look brighter. To compensate for it image from one projector is blended with its neighboring projectors. One of the things that needs to be done is to extend this to allow projecting several rows to use Lighttwist for more complicated surfaces (e.g. corners, which would allow to make it more usable in the home setting, where it is not always possible to create a cylinder or a hemisphere to project on (see Applications)).

One of the simplest approaches is to simply create a mask for each projector so that areas of overlap are only illuminated by one projector. But due to vibrations and inevitable numerical errors this might result in noticeable gaps in intensity. Better thing to do is to precompute the alpha mask for each projector with values between 0.0 and 1.0. Alpha values can be treated as weights assigned to each projector at a particular pixel. So we need to develop a way to smoothly reduce the intensity of the projected image closer to edges (where it overlaps with another projected plane). Also to get a uniformly illuminated image we need to introduce the constraint that at any pixel in the image all aphas must sum up to 1.0.

We can apply a commonly used in mosaics blending technique:
: for every pixel in the image:
:: each projector that illuminates this pixel gets weight of 1.0 and 0.0 otherwise
:: for each projector alpha = weight*factor, where factor is a distance from the pixel to the edge of the projected plane of this projector (all in camera coordinates). Normalize alphas.
Alpha for a given pixel depends on the distance to the closest invisible (for this projector) pixel. Function used to compute blending doesn't have to be linear, this is just the simplest solution.
This would most probably work in case, where all projectors are the same. In case they are not, we need to take care of gamma correction either before or while doing blending.

:::I plan to devote 40+ hours per week for GSoC. I will be able to start working on the project as soon as my exams are finished, which is 6th of May. More detailed plan of attack is described in my GSoC application [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123878501180].

NOTE: ''Most of the content of this page, unless otherwise noted, comes from the email discussions with Yuval Levy and Sébastien Roy.''

[http://vision3d.iro.umontreal.ca/category/projet/lighttwist/ Lighttwist official site]

[http://tot.sat.qc.ca/video/oct04/lighttwist.html Video of the lecture on Lighttwist]

[http://tot.sat.qc.ca/logiciels_lighttwist.html More links to videos on Lighttwist]

User:Albiorix

2009-04-17T19:35:37Z

Albiorix: /* GSoC project */

==Lighttwist==
Lighttwist [http://vision3d.iro.umontreal.ca/category/projet/lighttwist/] is an application that allows projecting images on planar and non-planar surfaces. It creates an immersive experience by compensating for irregularities and deformation of the projection screen. Lighttwist deals with images, video or 3D and can also synchronize images with sound from several speakers.

=====Set up=====
* surface to be projected on;
* projector(s);
* camera (sees what the viewer will see);
* network for synchronization between the camera and projectors.

==Applications==
Great thing about Lighttwist is its scalability. Setting up network with multiple computers is not necessary. One of the solutions for home use is to get a video splitter to split the DVI output from the computer to control several projectors (there is a variety of mini projectors on the market suitable for use in the small rooms).
Again, main purpose of Ligttwist is to create an immersion experience, which allows to showcase artistic work with bigger impact on the viewer. But besides that there were also proposed various different uses for the Lighttwist, such as using it in the surgery room [http://www.lighttwist.org/twiki/pub/V3D/PublicationsScientifiques/tardifj_projector_EMBC03.pdf] or in the classrooms (e.g. planerariums, presentations, as proposed by Yuval Levy).

==Description of the problem==
* Simplest case
: Screen to be projected on is flat, projector and camera are perfectly aligned. We only need to find the invertible map that transforms pixel coordinates from the camera space to the projector space. Only in this simple case we can use homographies represented by 3x3 invertible matrices
* General case
: Geometry of the screen is arbitrary, multiple projectors are not necessarily aligned with the user. Also requires catadioptric or fisheye lens to capture what observer sees in this case. Since use of homographies to establish correspondence between the camera space and projector space is no longer possible, use other techniques, such as structured light. [http://mur08.iro.umontreal.ca/wp/wp-content/uploads/2008/09/tardifj_multiprojectors_3dim03.pdf].

==Challenges==
* Resolution
:: There is a big difference between the resolution of a camera and projector(s). The ratio is normally 4:1 (camera having approx. 1000x1000 pixels and projectors 4000x768 pixels) and can go up to 8:1 when projecting on a hemisphere.
* Size of the images
:: It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* Lack of content of appropriate quality
:: It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution.

==GSoC project==
Right now Lighttwist is able to project a single row of images. To create a seamless picture, areas illuminated by different projectors must overlap, but these areas also look brighter. To compensate for it image from one projector is blended with its neighboring projectors. One of the things that needs to be done is to extend this to allow projecting several rows to use Lighttwist for more complicated surfaces (e.g. corners, which would allow to make it more usable in the home setting, where it is not always possible to create a cylinder or a hemisphere to project on (see Applications)).

One of the simplest approaches is to simply create a mask for each projector so that areas of overlap are only illuminated by one projector. But due to vibrations and inevitable numerical errors this might result in noticeable gaps in intensity. Better thing to do is to precompute the alpha mask for each projector with values between 0.0 and 1.0. Alpha values can be treated as weights assigned to each projector at a particular pixel. So we need to develop a way to smoothly reduce the intensity of the projected image closer to edges (where it overlaps with another projected plane). Also to get a uniformly illuminated image we need to introduce the constraint that at any pixel in the image all aphas must sum up to 1.0.
We can apply a commonly used in mosaics blending technique:
: for every pixel in the image:
:: each projector that illuminates this pixel gets weight of 1.0 and 0.0 otherwise
:: for each projector alpha = weight*factor, where factor is a distance from the pixel to the edge of the projected plane of this projector (all in camera coordinates). Normalize alphas.
Alpha for a given pixel depends on the distance to the closest invisible (for this projector) pixel. Function used to compute blending doesn't have to be linear, this is just the simplest solution.
This would most probably work in case, where all projectors are the same. In case they are not, we need to take care of gamma correction either before or while doing blending.

:::I plan to devote 40+ hours per week for GSoC. I will be able to start working on the project as soon as my exams are finished, which is 6th of May. More detailed plan of attack is described in my GSoC application [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123878501180].

NOTE: ''Most of the content of this page, unless otherwise noted, comes from the email discussions with Yuval Levy and Sébastien Roy.''

[http://vision3d.iro.umontreal.ca/category/projet/lighttwist/ Lighttwist official site]

[http://tot.sat.qc.ca/video/oct04/lighttwist.html Video of the lecture on Lighttwist]

[http://tot.sat.qc.ca/logiciels_lighttwist.html More links to videos on Lighttwist]

User:Albiorix

2009-04-15T02:05:06Z

Albiorix: /* Applications */

==Lighttwist==
Lighttwist [http://vision3d.iro.umontreal.ca/category/projet/lighttwist/] is an application that allows projecting images on planar and non-planar surfaces. It creates an immersive experience by compensating for irregularities and deformation of the projection screen. Lighttwist deals with images, video or 3D and can also synchronize images with sound from several speakers.

=====Set up=====
* surface to be projected on;
* projector(s);
* camera (sees what the viewer will see);
* network for synchronization between the camera and projectors.

==Applications==
Great thing about Lighttwist is its scalability. Setting up network with multiple computers is not necessary. One of the solutions for home use is to get a video splitter to split the DVI output from the computer to control several projectors (there is a variety of mini projectors on the market suitable for use in the small rooms).
Again, main purpose of Ligttwist is to create an immersion experience, which allows to showcase artistic work with bigger impact on the viewer. But besides that there were also proposed various different uses for the Lighttwist, such as using it in the surgery room [http://www.lighttwist.org/twiki/pub/V3D/PublicationsScientifiques/tardifj_projector_EMBC03.pdf] or in the classrooms (e.g. planerariums, presentations, as proposed by Yuval Levy).

==Description of the problem==
* Simplest case
: Screen to be projected on is flat, projector and camera are perfectly aligned. We only need to find the invertible map that transforms pixel coordinates from the camera space to the projector space. Only in this simple case we can use homographies represented by 3x3 invertible matrices
* General case
: Geometry of the screen is arbitrary, multiple projectors are not necessarily aligned with the user. Also requires catadioptric or fisheye lens to capture what observer sees in this case. Since use of homographies to establish correspondence between the camera space and projector space is no longer possible, use other techniques, such as structured light. [http://mur08.iro.umontreal.ca/wp/wp-content/uploads/2008/09/tardifj_multiprojectors_3dim03.pdf].

==Challenges==
* Resolution
:: There is a big difference between the resolution of a camera and projector(s). The ratio is normally 4:1 (camera having approx. 1000x1000 pixels and projectors 4000x768 pixels) and can go up to 8:1 when projecting on a hemisphere.
* Size of the images
:: It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* Lack of content of appropriate quality
:: It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution.

==GSoC project==
Right now Lighttwist is able to project a single row of images. To create a seamless picture, areas illuminated by different projectors must overlap, but these areas also look brighter. To compensate for it image from one projector is blended with its neighboring projectors. One of the things that needs to be done is to extend this to allow projecting several rows to use Lighttwist for more complicated surfaces (e.g. corners, which would allow to make it more usable in the home setting, where it is not always possible to create a cylinder or a hemisphere to project on (see Applications)).

One of the simplest approaches is to simply create a mask for each projector so that areas of overlap are only illuminated by one projector. But that doesn't guarantee the seamless picture and looses the light from many projectors.
Better thing to do is to precompute the alpha mask for each projector with values between 0.0 and 1.0. Alpha values can be treated as weights assigned to each projector at a particular pixel. So we need to develop a way to smoothly reduce the intensity of the projected image closer to edges (where it overlaps with another projected plane). Also to get a uniformly illuminated image we need to introduce the constraint that at any pixel in the image all aphas must sum up to 1.0.
One way I could think of the solution is as follows:
: for every pixel in the image:
:: each projector that illuminates this pixel gets weight of 1.0 and 0.0 otherwise
:: for each projector alpha = weight*factor, where factor is a distance from the pixel to the edge of the projected plane of this projector (all in camera coordinates). Normalize alphas.
This would most probably work in case, where all projectors are the same. In case they are not, we need to take care of gamma correction either before or while doing blending.

:::I plan to devote 40+ hours per week for GSoC. I will be able to start working on the project as soon as my exams are finished, which is 6th of May. More detailed plan of attack is described in my GSoC application [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123878501180].

NOTE: ''Most of the content of this page, unless otherwise noted, comes from the email discussions with Yuval Levy and Sébastien Roy.''

[http://vision3d.iro.umontreal.ca/category/projet/lighttwist/ Lighttwist official site]

[http://tot.sat.qc.ca/video/oct04/lighttwist.html Video of the lecture on Lighttwist]

[http://tot.sat.qc.ca/logiciels_lighttwist.html More links to videos on Lighttwist]

User:Albiorix

2009-04-15T02:04:01Z

Albiorix:

==Lighttwist==
Lighttwist [http://vision3d.iro.umontreal.ca/category/projet/lighttwist/] is an application that allows projecting images on planar and non-planar surfaces. It creates an immersive experience by compensating for irregularities and deformation of the projection screen. Lighttwist deals with images, video or 3D and can also synchronize images with sound from several speakers.

=====Set up=====
* surface to be projected on;
* projector(s);
* camera (sees what the viewer will see);
* network for synchronization between the camera and projectors.

==Applications==
Great thing about Lighttwist is its scalability. Setting up network with multiple computers is not necessary. One of the setups for home use is to get a video splitter to split the DVI output from the computer to control several projectors (there is a variety of mini projectors on the market suitable for use in the small rooms).
Again, main purpose of Ligttwist is to create an immersion experience, which allows to showcase artistic work with bigger impact on the viewer. But besides that there were also proposed various different uses for the Lighttwist, such as using it in the surgery room [http://www.lighttwist.org/twiki/pub/V3D/PublicationsScientifiques/tardifj_projector_EMBC03.pdf] or in the classrooms (e.g. planerariums, presentations, as proposed by Yuval Levy).

==Description of the problem==
* Simplest case
: Screen to be projected on is flat, projector and camera are perfectly aligned. We only need to find the invertible map that transforms pixel coordinates from the camera space to the projector space. Only in this simple case we can use homographies represented by 3x3 invertible matrices
* General case
: Geometry of the screen is arbitrary, multiple projectors are not necessarily aligned with the user. Also requires catadioptric or fisheye lens to capture what observer sees in this case. Since use of homographies to establish correspondence between the camera space and projector space is no longer possible, use other techniques, such as structured light. [http://mur08.iro.umontreal.ca/wp/wp-content/uploads/2008/09/tardifj_multiprojectors_3dim03.pdf].

==Challenges==
* Resolution
:: There is a big difference between the resolution of a camera and projector(s). The ratio is normally 4:1 (camera having approx. 1000x1000 pixels and projectors 4000x768 pixels) and can go up to 8:1 when projecting on a hemisphere.
* Size of the images
:: It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* Lack of content of appropriate quality
:: It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution.

==GSoC project==
Right now Lighttwist is able to project a single row of images. To create a seamless picture, areas illuminated by different projectors must overlap, but these areas also look brighter. To compensate for it image from one projector is blended with its neighboring projectors. One of the things that needs to be done is to extend this to allow projecting several rows to use Lighttwist for more complicated surfaces (e.g. corners, which would allow to make it more usable in the home setting, where it is not always possible to create a cylinder or a hemisphere to project on (see Applications)).

One of the simplest approaches is to simply create a mask for each projector so that areas of overlap are only illuminated by one projector. But that doesn't guarantee the seamless picture and looses the light from many projectors.
Better thing to do is to precompute the alpha mask for each projector with values between 0.0 and 1.0. Alpha values can be treated as weights assigned to each projector at a particular pixel. So we need to develop a way to smoothly reduce the intensity of the projected image closer to edges (where it overlaps with another projected plane). Also to get a uniformly illuminated image we need to introduce the constraint that at any pixel in the image all aphas must sum up to 1.0.
One way I could think of the solution is as follows:
: for every pixel in the image:
:: each projector that illuminates this pixel gets weight of 1.0 and 0.0 otherwise
:: for each projector alpha = weight*factor, where factor is a distance from the pixel to the edge of the projected plane of this projector (all in camera coordinates). Normalize alphas.
This would most probably work in case, where all projectors are the same. In case they are not, we need to take care of gamma correction either before or while doing blending.

:::I plan to devote 40+ hours per week for GSoC. I will be able to start working on the project as soon as my exams are finished, which is 6th of May. More detailed plan of attack is described in my GSoC application [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123878501180].

NOTE: ''Most of the content of this page, unless otherwise noted, comes from the email discussions with Yuval Levy and Sébastien Roy.''

[http://vision3d.iro.umontreal.ca/category/projet/lighttwist/ Lighttwist official site]

[http://tot.sat.qc.ca/video/oct04/lighttwist.html Video of the lecture on Lighttwist]

[http://tot.sat.qc.ca/logiciels_lighttwist.html More links to videos on Lighttwist]

User:Albiorix

2009-04-14T19:59:12Z

Albiorix:

==Lighttwist==
Lighttwist [http://vision3d.iro.umontreal.ca/category/projet/lighttwist/] is an application that allows projecting images on planar and non-planar surfaces. It creates an immersive experience by compensating for irregularities and deformation of the projection screen. Lighttwist deals with images, video or 3D and can also synchronize images with sound from several speakers.

=====Set up=====
* surface to be projected on;
* projector(s);
* camera (sees what the viewer will see);
* network for synchronization between the camera and projectors.

==Applications==
Great thing about Lighttwist is its scalability. Setting up network with multiple computers is not necessary. One of the setups for home use is to get a video splitter to split the DVI output from the computer to control several projectors (there is a variety of mini projectors on the market suitable for use in the small rooms).
Again, main purpose of Ligttwist is to create an immersion experience, which allows to showcase artistic work with bigger impact on the viewer. But besides that there were also proposed various different uses for the Lighttwist, such as using it in the surgery room [http://www.lighttwist.org/twiki/pub/V3D/PublicationsScientifiques/tardifj_projector_EMBC03.pdf] or in the classrooms (e.g. planerariums, presentations, as proposed by Yuval Levy).

==Description of the problem==
* Simplest case
: Screen to be projected on is flat, projector and camera are perfectly aligned. We only need to find the invertible map that transforms pixel coordinates from the camera space to the projector space. Only in this simple case we can use homographies represented by 3x3 invertible matrices
* General case
: Geometry of the screen is arbitrary, multiple projectors are not necessarily aligned with the user. Also requires catadioptric or fisheye lens to capture what observer sees in this case. Since use of homographies to establish correspondence between the camera space and projector space is no longer possible, use other techniques, such as structured light. [http://mur08.iro.umontreal.ca/wp/wp-content/uploads/2008/09/tardifj_multiprojectors_3dim03.pdf].

==Challenges==
* Resolution
:: There is a big difference between the resolution of a camera and projector(s). The ratio is normally 4:1 (camera having approx. 1000x1000 pixels and projectors 4000x768 pixels) and can go up to 8:1 when projecting on a hemisphere.
* Size of the images
:: It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* Lack of content of appropriate quality
:: It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution.

==GSoC project==
Right now Lighttwist is able to project a single row of images. To create a seamless picture, areas illuminated by different projectors must overlap, but these areas also look brighter. To compensate for it image from one projector is blended with its neighboring projectors. One of the things that needs to be done is to extend this to allow projecting several rows to use Lighttwist for more complicated surfaces (e.g. corners, which would allow to make it more usable in the home setting, where it is not always possible to create a cylinder or a hemisphere to project on (see Applications)).

One of the simplest approaches is to simply create a mask for each projector so that areas of overlap are only illuminated by one projector. But that doesn't guarantee the seamless picture and looses the light from many projectors.
Better thing to do is to precompute the alpha mask for each projector with values between 0.0 and 1.0. Alpha values can be treated as weights assigned to each projector at a particular pixel. So we need to develop a way to smoothly reduce the intensity of the projected image closer to edges (where it overlaps with another projected plane). Also to get a uniformly illuminated image we need to introduce the constraint that at any pixel in the image all aphas must sum up to 1.0.
One way I could think of the solution is as follows:
: for every pixel in the image:
:: each projector that illuminates this pixel gets weight of 1.0 and 0.0 otherwise
:: for each projector alpha = weight*factor, where factor is a distance from the pixel to the edge of the projected plane of this projector (all in camera coordinates). Normalize alphas.
This would most probably work in case, where all projectors are the same. In case they are not, we need to take care of gamma correction either before or while doing blending.

:::I plan to devote 40+ hours per week for GSoC. I will be able to start working on the project as soon as my exams are finished, which is 6th of May. More detailed plan of attack is described in my GSoC application [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123878501180].

NOTE: ''Most of the content of this page, unless otherwise noted comes from the email discussions with Yuval Levy and Sébastien Roy.''

[http://vision3d.iro.umontreal.ca/category/projet/lighttwist/ Lighttwist official site]

[http://tot.sat.qc.ca/video/oct04/lighttwist.html Video of the lecture on Lighttwist]

[http://tot.sat.qc.ca/logiciels_lighttwist.html More links to videos on Lighttwist]

User:Albiorix

2009-04-09T06:29:47Z

Albiorix: Blanked the page

User:Albiorix

2009-04-09T01:15:38Z

Albiorix: /* LightTwist */

=LightTwist (UNDER CONSTRUCTION)=
==Introduction==

LightTwist is a software that allows for projecting images from multiple projectors onto surfaces with complex geometry. LightTwist is currently under development at the University of Montreal in the lab of Professor Roy. The key is to fill up the field of view of the viewer with images, thus creating an immersion experience. This is achieved by projecting images on the surfaces that “wrap around” the viewer (e.g. projecting on the walls in the room).

==Problem description==
===Set up===
* surface to be projected on;
* projector(s);
* camera (to be placed where the viewer will be);
* network for synchronization between the camera and projectors.

===Simplest case===
Flat screen and projector are perfectly aligned with the viewer. Since the observer is replaced by the camera, all we need to do is to find the invertible map between the pixels in the camera and pixels in the projector. The approach limited to only flat surfaces is to use homographies represented by 3x3 invertible matrices to get the transformation.

===General case===
* arbitrary geometry of the screen;
* multiple projectors not necessarily aligned with the user;
* catadioptric or fisheye lens to capture what observer sees in this case;
* use of homographies to establish the camera-projectors transformation is no longer possible. The solution to this is to use structured light instead.

==Structured light==
The idea is to project a pattern of black and white stripes (horizontal and vertical to capture x and y coordinates) that encode the projector points. Stripes of width 2^(b-1) (b = 1,...,n) pixels are used to encode n bits. Get the binary coordinates bitwise. In practice bit 1 and 2 are useless since stripes get too narrow for camera to distinguish.

==Advantages==
* using structured light we don't need to know the locations of the camera and projector, also there is no need to calibrate camera or projectors.
* projection surface: is it absolutely arbitrary. Projection is even possible on the surfaces with gaps.
* high quality of the projected images/videos.
* immersion experience.

==Challenges==
* space. There are two possible ways of placing the projectors: they can be inside or outside relative to the surface and viewers. In any case projectors have to be several meters away from the surface to avoid occlusion of view.
* resolution. Is a big problem due both to the lack of content of appropriate quality and difficulties in managing large amounts of data. If for stale images this problem is solvable, for video it becomes a big issue, since there are no video cameras that can provide such high resolution.
* reconstruction precision. There is a big difference between the resolution of a camera and projector. The ratio is normally 4:1 (camera having 1000x1000 pixels and projectors having 4000 x 768 pixels approx.) and can go up to 8:1 when projecting on the hemisphere. This complicates the algorithm for mapping.
* setting up the network. We need one computer for each projector and a camera plus an extra computer to synchronize (LightTwist uses PureData to generate messages to control computers in the network).
* bandwidth. It is hard to manage images of size 4096x768 (in case of 4 projectors). It is even harder to manage video.
* lack of content of appropriate quality. It is not the biggest challenge when it comes to images, but there is no video camera that can support required resolution yet.
* limited spots from which the image looks undistorted (flat surface gives the most range, more complicated surfaces generally put some limitations on the location of the viewer).

== Future ==
As projectors become more available, there will be more interest in creating interactive environments. LightTwist is one of the tools that can make it easy for the user.
There are a lot of possible applications for the LightTwist:
* it has a great artistic potential, since it can greatly enhance the impression from the artwork;
* use in medicine (e.g. projecting information obtained from MRI scanner directly on the body of the patient);
* use in education (e.g. create a planetarium in a classroom, again use for medical studies);

==LightTwist and Hugin==
Both applications will win from the cooperation. LightTwist is the tool, that can best showcase the features of Hugin. Hugin on the other hand is a free tool that is capable of creating high-quality content for the LightTwist.
It will be beneficial for the LigthTwist to get introduced to the OpenSource community, such as Hugin. Besides being able to participate in the development process, these people are also the potential users of the application.

User:Albiorix

2009-04-09T00:45:35Z

Albiorix: /* SoC2009 Yulia Kotseruba */

=LightTwist=
==Introduction==

SoC 2009 student proposals

2009-04-09T00:44:57Z

Albiorix: /* Yulia Kotseruba: Straight-line detection for automated lens calibration */

Student Proposals: Student info and short project synopsis, with link to a new Wiki page where the project is expanded in full detail. See template below:

== MO Faruque Sarker: Handling very large images using VIPS ==

* A second year PhD student at U of Wales, Newport under Robotic Intelligence Lab (my homepage at: http://ril.newport.ac.uk/sarker/index.php).
* Coding Platform: Ubuntu 8.10 x64, Pentium 4 3GHz, 32GB RAM
* I'm interested to work in processing large images in Hugin. We have got a 16 mega-pixel Prosilica GE4900C CCD camera for tracking about 30 mobile robots. It gives about 50MB image file per frame using a huge memory. I'm running my tracking algorithm on Ubuntu 8.10 x64 and got some nice results of tracking markers (http://ril.newport.ac.uk/sarker/index.php?pid=21).

[[User:Writefaruq | Handling very large images using VIPS]]

== Lukáš Jirkovský ==

* first year undergrad of University of West Bohemia
* Platform used for coding: Arch Linux, Pentium 4 Northwood 2GHz, 1.5 GB RAM
* Coding skills: C++, PHP, Java, Matlab
* [[User:Stativ | Ghost removal for enfuse]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/stativ/t123797116006 Project proposal in Google's webapp

== Prashant Kumar Aanand ==

* 2rd Year student pursuing a Bachelors in Architecture and Regional Planning at Indian Institute of Technology, INDIA.
* Coding platform : Ubuntu 8.10 * 32; Pentium 4; 3GHz; 2GB Ram.
* coding skills : c++, Java, Matlab.
* Hugin colour balancing :- introducing new features like temperature curves etc
* Hugin raw support : better modularization

== [[User:Leonox|León Moctezuma]]: QuickTimeVR Playback in VLC ==

* Enrolled last Semester Bachelor of Computer Science at [www.buap.mx Benemérita Universidad Autónoma de Puebla].
* Coding Platform: Ubuntu 8.10
* [http://wiki.videolan.org/SoC_2009/QuickTimeVR_Playback Project proposal] on the VideoLAN Wiki
* Mentor (VLC): Most likely Antoine Cellier.
* Comentor (FreePV): Yuval Levy. Note: we're discussing this with VLC / Jean-Baptiste Kempf, including Wiimote navigation.
* http://socghop.appspot.com/student_proposal/review/google/gsoc2009/leonox/t123831053541 Google webapp proposal

== Dev Ghosh: Mosaic Mode for Hugin/Panotools==

* PhD candidate, Electrical Engineering and Computer Science, Northwestern University, Evanston, Illinois, USA
* Coding Platform: Ubuntu 8.10, AMD Athlon 64 3500+, 2 GB RAM, Eclipse
* Coding skills: C/C++, MATLAB, Python
* Possible Mentor: Daniel German
* [[User:Dg| Mosaic Mode for Hugin/Panotools]]
* Google webapp Proposal Link: (Incomplete and can't edit right now. Please see wiki link above.) http://socghop.appspot.com/student_proposal/show/google/gsoc2009/dkg/t123865551999

== [[User:Albiorix|Yulia Kotseruba]]: Straight-line detection for automated lens calibration ==

* 4th year Computer Science student at University of Toronto studying Artificial Intelligence
* Coding Platform: Mac OS 10.5.6, 2.53 GHz Intel Core 2 Duo, 4 GB RAM, XCode, Eclipse
* Coding skills: C/C++, Java, Python, Matlab, OpenGL, Prolog
* [[User:Albiorix | Straight-line detection for automated lens calibration]]
*[[User:Albiorix | LightTwist]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123854228105 Google proposal

== Mokhtar M. Khorshid: Accounting for Camera Movements ==

* Holder of B.S. in Computer Science & Mathematics from AUC (top of my class) and starting my master studies in Computer Science.
* Coding Platform: Vista 64-bit (as well as Windows XP 32-bit Professional & Ubuntu 8.10 on secondary machines), Quad Core 2.4 GHz, 6GB RAM, 8800 GTS graphics card, Visual Studio 2005/2008 .NET (in addition to Eclipse + GCC).
* Coding skills: Expert in C++ (10+ years), seasoned algorithm designer (ACM programming contestant that ranked 1st, 2nd, 3rd, and 4th in various national and regional contests), I have experience with Computer graphics, OpenGL, and wxWidgets. Last year I participated in GSoC and built the wxWallCtrl, check an unofficial binary sample here: [http://Thunder-Power.com/wxWallCtrlSample.zip]. I am familiar with SVN, Perforce, and SourceSafe and most bug tracking systems.
* I am the lead software architect of the I2B game project ([http://www.I2Black.com])
* [[User:MokhtarKhorshid| Accounting for Camera Movements]]
* My GSoC proposal link is [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/lotus/t123836236772]. We are currently discussing concrete requirements since task may be altered.

== Tim Nugent ==

* 3rd Year PhD student in Bioinformatics at University College London, UK
* Ubuntu and Centos Linux, with XP imprisoned in Vmware
* Coding skills: C/C++, Perl
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859124187 Straight-line detection for automated lens calibration]
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859431227 Bracketing Panorama Model]

== Seth Berrier: Simple Masking & Bracketed/HDR Exposure Stacks ==
(Sorry for the last minute addition. Hope I can find room among this qualified bunch!)

* 6th Year PhD student & Doctoral Candidate in Computer Science at University of Minnestoa, USA
* Main Coding Platform: Mac OS X 10.5 w/ Apple GNU Toolchain & Eclipse IDE, 15" MacBook Pro, 2.4 GHz Core 2 Duo, 4G mem, NVIDIA GeForce 8600M GT
* Other Platforms:
** Win XP Pro w/ Visual C++ & VS .net, 2k5 or 2k8 OR MinGW & Eclipse IDE
** Other *nix platforms (Ubuntu & Solaris in particular) using basic GNU toolchain from shell
* Computer Science Knowledge:
** Veteran in C++ (with a bit of C#, Java, Perl, LISP, StandardML, Pascal, Fortran, Basic, VB for Apps, HTML, Javascript)
** Very experienced in OpenGL, GLUT, Cg and general graphics algorithms
** Basic knowledge of Qt GUI programming & Qt Eclipse integration
** Experienced with Matlab and some LabVIEW
** Good Numerical Methods foundation with some practical experience
** Basic, non-theoretical experience in real-time image processing for computer vision (Hough transform, Canny edge detection, etc)
* [[SoC2009_Seth_Berrier | Simple Masking & Bracketed/HDR Exposure Stacks]]

== James Legg: Enblend / Enfuse Gimp plugin ==

* I'm in the third and final year of a Computer Science and Mathmatics BSc at the University of York, in the United Kingdom.
* Coding Platform: Ubuntu 8.10, Pentium dual-core 2GHz, 2GB RAM
* The [[User:James Legg‎ | Enfuse / Enblend Gimp plugin]] will allow a user of the Gimp to use the Enblend or Enfuse algorithms to merge layers of an image through the Gimp's menu or using a Gimp script.

== Sumit Sinha ==

* 2rd Year student pursuing a Bachelors degree in Computer Science at Indian Institute of Technology, INDIA
* Coding Platform: Vista 32-bit, Dual Core 1.6 GHz, 1GB RAM, Visual Studio 2005/2008 .NET.
* Coding skills: C/C++, JAVA
* Better Algorithm for Seam Optimization in Enblend/Enfuse
* Hugin RAW support

== Joe Templeman ==

* Studying at Imperial College London, 2nd Year Computing MEng student
Coding:
* Main coding platform: Ubuntu 8.04: 2.66Ghz C2D E6750, 4GB RAM, Eclipse, GDB etc
** Alternative platforms include Windows XP, Dell D430, 1.2Ghz C2D ULV, 2GB RAM, Visual Studio 2005/2008, Eclipse
* Experienced C and Java, also C++, Haskell, Prolog
* Strong mathematical and theortical grounding including
** Logical/Inductive reasoning about programs
** Formal specifications
** Software engineering design patterns

Photography Skills:
* Nikon D50, D1H, 8mm Peleng fisheye, 15-30mm Sigma
* I’ve not been very active recently but I invested a lot of time into Hugin and panoramas in general and hosted a load on Flickr.
** I wrote quite a widely used [http://www.flickr.com/photos/jftphotography/sets/72157600232700728/ tutorial]
** Feel free to check out my Panoramas etc, all using Hugin [http://www.flickr.com/photos/jftphotography/sets/72157600108689306/ here].
* I’ve also worked as a part time post-production photography consultant specialising in photo-stitching, specifically Hugin.
** http://www.bennorthover.com/folio4.html (The stereographic projections I assisted on are 3,4 and 5th and published as an advert in the economist)

Project:
* [[User:Joetempleman|Mask editing built into hugin, moving on to a enblend plugin for gimp for further and more specific mask editing.]]
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/joetempleman googleapp proposal]

== Achin Agarwal ==

* Second year undergraduate student of Computer Science and Engineering at the Indian Institute of Technology, Kharagpur, India.
* Coding Platform: Intel Core 2 Duo, 2.53 GHz, 512 MB graphics card NVIDIA chipset2250, Windows XP, Visual Studio 2005/2008.
* Coding skills: C, C++, Java, OpenGL, MATLAB.
* Utility for creating a Philosphere.

== Satyajeet Singh ==
* Final year undergraduate student at Netaji Subhas Institute of Technology, Delhi University, New Delhi, India.
* Coding: Intel P4 3.0 GHz, 1 GB RAM, Windows XP, Fedora Core 9, Visual Studio 2008, OpenCV
* Coding Skills: C, C++, Visual Basic. I like coding and have developed recent interest in the field of Image Processing in last 10 months.

Photography Skills:
* Canon 7.2 Mega Pixel Camera
** Yes, I do photograph panaroma

You and Us:
* Open Source Projects:
** OMR-AI: [http://sourceforge.net/projects/omr-ai/| Low cost OMR processing solution]
** DEDUCTO: A board game for OLPC
* Vision of Project: Many a times when creating panoramas, there may be moving objects and high exposure difference which can disturb resulting panorama. I wish to create a continuous tone panorama.

[[Dynamic Image Stitching with High Exposure Difference]]

[http://socghop.appspot.com/student_proposal/show/google/gsoc2009/satyajeet/t123877899132 GSoC Proposal]

[[Category:Community:Project]]

SoC 2009 student proposals

2009-04-02T06:08:57Z

Albiorix: /* Yulia Kotseruba: Straight-line detection for automated lens calibration */

Student Proposals: Student info and short project synopsis, with link to a new Wiki page where the project is expanded in full detail. See template below:

== Tom Templeton: The Template Project ==

* Enrolled second year master of Sample at Example University in Nowhereland.
* Coding Platform: Ubuntu 8.10, Pentium 4 3GHz, 1GB RAM
* The [[SoC2009_Tom_Templeton | Template Project]] is all about a short description of an example project that does what it does according to specifications.

== Lukáš Jirkovský ==

* first year undergrad of University of West Bohemia
* Platform used for coding: Arch Linux, Pentium 4 Northwood 2GHz, 1.5 GB RAM
* Coding skills: C++, PHP, Java (Java only because I have to ;-) )
* [[SoC2009_Lukas_Jirkovsky | Ghost removal for enfuse]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/stativ/t123797116006 Project proposal in Google's webapp

== [[User:Leonox|León Moctezuma]]: QuickTimeVR Playback in VLC ==

* Enrolled last Semester Bachelor of Computer Science at [www.buap.mx Benemérita Universidad Autónoma de Puebla].
* Coding Platform: Ubuntu 8.10
* [http://wiki.videolan.org/SoC_2009/QuickTimeVR_Playback Project proposal] on the VideoLAN Wiki
* Mentor (VLC): Most likely Antoine Cellier.
* Comentor (FreePV): Yuval Levy. Note: we're discussing this with VLC / Jean-Baptiste Kempf, including Wiimote navigation.
* http://socghop.appspot.com/student_proposal/review/google/gsoc2009/leonox/t123831053541 Google webapp proposal

== Dev Ghosh ==

* PhD candidate, Electrical Engineering and Computer Science, Northwestern University, Evanston, Illinois
* Coding Platform: Ubuntu 8.10, AMD Athlon 64 3500+, 2 GB RAM, Eclipse
* Coding skills: C/C++, MATLAB, Python
* Possible Mentor: Daniel German
* [[SoC2009_Dev_Ghosh | mosaic mode for Hugin]]
* Google webapp Proposal Link: Coming soon!

== [[User:Albiorix|Yulia Kotseruba]]: Straight-line detection for automated lens calibration ==

* 4th year Computer Science student at University of Toronto studying Artificial Intelligence
* Coding Platform: Mac OS 10.5.6, 2.53 GHz Intel Core 2 Duo, 4 GB RAM, XCode, Eclipse
* Coding skills: C/C++, Java, Python, Matlab, OpenGL, Prolog
* [[SoC2009_Yulia_Kotseruba | Straight-line detection for automated lens calibration]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123854228105 Google proposal

== Mokhtar M. Khorshid: Accounting for Camera Movements ==

* Holder of B.S. in Computer Science & Mathematics from AUC and starting my master studies in Computer Science.
* Coding Platform: Vista 64-bit, Quad Core 2.4 GHz, 6GB RAM, 8800 GTS graphics card, Visual Studio 2005/2008 .NET.
* Coding skills: Expert in C++ (10+ years), seasoned algorithm designer, I have experience with Computer graphics, OpenGL, and wxWidgets.
* [[SoC2009_Mokhtar_Khorshid | Accounting for Camera Movements]]

== Tim Nugent ==

* 3rd Year PhD student in Bioinformatics at University College London, UK
* Ubuntu and Centos Linux, with XP imprisoned in Vmware
* Coding skills: C/C++, Perl
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859124187 Straight-line detection for automated lens calibration]
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859431227 Bracketing Panorama Model]

== Seth Berrier ==
(Sorry for the last minute addition. Hope I can find room among this qualified bunch!)

* 6th Year PhD student & Doctoral Candidate in Computer Science at University of Minnestoa, USA
* Main Coding Platform: Mac OS X 10.5 w/ Apple GNU Toolchain & Eclipse IDE, 15" MacBook Pro, 2.4 GHz Core 2 Duo, 4G mem, NVIDIA GeForce 8600M GT
* Other Platforms:
** Win XP Pro w/ Visual C++ & VS .net, 2k5 or 2k8 OR MinGW & Eclipse IDE
** Other *nix platforms (Ubuntu & Solaris in particular) using basic GNU toolchain from shell
* Computer Science Knowledge:
** Veteran in C++ (with a bit of C#, Java, Perl, LISP, StandardML, Pascal, Fortran, Basic, VB for Apps, HTML, Javascript)
** Very experienced in OpenGL, GLUT, Cg and general graphics algorithms
** Basic knowledge of Qt GUI programming & Qt Eclipse integration
** Experienced with Matlab and some LabVIEW
** Good Numerical Methods foundation with some practical experience
** Basic, non-theoretical experience in real-time image processing for computer vision (Hough transform, Canny edge detection, etc)
* [[SoC2009_Seth_Berrier | Proposal Coming Soon]]

SoC 2009 student proposals

2009-04-02T06:07:52Z

Albiorix: /* Yulia Kotseruba: Straight-line detection for automated lens calibration */

Student Proposals: Student info and short project synopsis, with link to a new Wiki page where the project is expanded in full detail. See template below:

== Tom Templeton: The Template Project ==

* Enrolled second year master of Sample at Example University in Nowhereland.
* Coding Platform: Ubuntu 8.10, Pentium 4 3GHz, 1GB RAM
* The [[SoC2009_Tom_Templeton | Template Project]] is all about a short description of an example project that does what it does according to specifications.

== Lukáš Jirkovský ==

* first year undergrad of University of West Bohemia
* Platform used for coding: Arch Linux, Pentium 4 Northwood 2GHz, 1.5 GB RAM
* Coding skills: C++, PHP, Java (Java only because I have to ;-) )
* [[SoC2009_Lukas_Jirkovsky | Ghost removal for enfuse]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/stativ/t123797116006 Project proposal in Google's webapp

== [[User:Leonox|León Moctezuma]]: QuickTimeVR Playback in VLC ==

* Enrolled last Semester Bachelor of Computer Science at [www.buap.mx Benemérita Universidad Autónoma de Puebla].
* Coding Platform: Ubuntu 8.10
* [http://wiki.videolan.org/SoC_2009/QuickTimeVR_Playback Project proposal] on the VideoLAN Wiki
* Mentor (VLC): Most likely Antoine Cellier.
* Comentor (FreePV): Yuval Levy. Note: we're discussing this with VLC / Jean-Baptiste Kempf, including Wiimote navigation.
* http://socghop.appspot.com/student_proposal/review/google/gsoc2009/leonox/t123831053541 Google webapp proposal

== Dev Ghosh ==

* PhD candidate, Electrical Engineering and Computer Science, Northwestern University, Evanston, Illinois
* Coding Platform: Ubuntu 8.10, AMD Athlon 64 3500+, 2 GB RAM, Eclipse
* Coding skills: C/C++, MATLAB, Python
* Possible Mentor: Daniel German
* [[SoC2009_Dev_Ghosh | mosaic mode for Hugin]]
* Google webapp Proposal Link: Coming soon!

== [[User:Albiorix|Yulia Kotseruba]]: Straight-line detection for automated lens calibration ==

* 4th year student at University of Toronto
* Coding Platform: Mac OS 10.5.6, 2.53 GHz Intel Core 2 Duo, 4 GB RAM, XCode, Eclipse
* Coding skills: C/C++, Java, Python, Matlab, OpenGL, Prolog
* [[SoC2009_Yulia_Kotseruba | Straight-line detection for automated lens calibration]]
* http://socghop.appspot.com/student_proposal/show/google/gsoc2009/albiorix/t123854228105 Google proposal

== Mokhtar M. Khorshid: Accounting for Camera Movements ==

* Holder of B.S. in Computer Science & Mathematics from AUC and starting my master studies in Computer Science.
* Coding Platform: Vista 64-bit, Quad Core 2.4 GHz, 6GB RAM, 8800 GTS graphics card, Visual Studio 2005/2008 .NET.
* Coding skills: Expert in C++ (10+ years), seasoned algorithm designer, I have experience with Computer graphics, OpenGL, and wxWidgets.
* [[SoC2009_Mokhtar_Khorshid | Accounting for Camera Movements]]

== Tim Nugent ==

* 3rd Year PhD student in Bioinformatics at University College London, UK
* Ubuntu and Centos Linux, with XP imprisoned in Vmware
* Coding skills: C/C++, Perl
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859124187 Straight-line detection for automated lens calibration]
* [http://socghop.appspot.com/student_proposal/show/google/gsoc2009/ultrawide/t123859431227 Bracketing Panorama Model]

== Seth Berrier ==
(Sorry for the last minute addition. Hope I can find room among this qualified bunch!)

* 6th Year PhD student & Doctoral Candidate in Computer Science at University of Minnestoa, USA
* Main Coding Platform: Mac OS X 10.5 w/ Apple GNU Toolchain & Eclipse IDE, 15" MacBook Pro, 2.4 GHz Core 2 Duo, 4G mem, NVIDIA GeForce 8600M GT
* Other Platforms:
** Win XP Pro w/ Visual C++ & VS .net, 2k5 or 2k8 OR MinGW & Eclipse IDE
** Other *nix platforms (Ubuntu & Solaris in particular) using basic GNU toolchain from shell
* Computer Science Knowledge:
** Veteran in C++ (with a bit of C#, Java, Perl, LISP, StandardML, Pascal, Fortran, Basic, VB for Apps, HTML, Javascript)
** Very experienced in OpenGL, GLUT, Cg and general graphics algorithms
** Basic knowledge of Qt GUI programming & Qt Eclipse integration
** Experienced with Matlab and some LabVIEW
** Good Numerical Methods foundation with some practical experience
** Basic, non-theoretical experience in real-time image processing for computer vision (Hough transform, Canny edge detection, etc)
* [[SoC2009_Seth_Berrier | Proposal Coming Soon]]

SoC 2009 student proposals

2009-03-31T23:22:17Z

Albiorix: /* Yulia Kotseruba: Straight-line detection for automated lens calibration */

SoC 2009 student proposals

2009-03-31T23:12:22Z

Albiorix: