Projection mapping

Projection mapping, similar to video mapping and spatial augmented reality, is a projection technique[1][2] used to turn objects, often irregularly shaped, into a display surface for video projection. These objects may be complex industrial landscapes, such as buildings, small indoor objects or theatrical stages. By using specialized software, a two- or three-dimensional object is spatially mapped on the virtual program which mimics the real environment it is to be projected on. The software can interact with a projector to fit any desired image onto the surface of that object.[3] This technique is used by artists and advertisers alike who can add extra dimensions, optical illusions, and notions of movement onto previously static objects. The video is commonly combined with, or triggered by, audio to create an audio-visual narrative. In recent years this technique has also been widely used in the context of cultural heritage as it has proved to be an excellent edutainment[4] tool thanks to the combined use of a digital dramaturgy.

Projection mapping (San Francisco)

History

Although the term "projection mapping" is relatively new, the technique dates back to the late 1960s, where it was referred to as the Madame Leota effect,[5] video mapping, spatial augmented reality,[6] or shader lamps.[7] One of the first public displays of projections onto 3D objects was debuted in 1969, when Disneyland opened their Haunted Mansion ride, which featured singing busts. Head shots of the singers were filmed on 16mm film and then projected onto busts of their faces to make them appear animated.[7] Another early example of projection mapping was in the 1967 TV movie Magical Mystery Tour during the Blue Jay Way scene, where images were projected onto George Harrison, including a cat's face and a headless male torso with the words "Magical Mystical Boy" written on its chest.[8]

The next record of projection mapping is from 1980, when installation artist Michael Naimark filmed people interacting with objects in a living room and then projected it in the room, creating illusions as if the people interacting with the objects were really there.[9][10]

In 1984 the Stephen Sondheim original Broadway production of Sunday in the Park With George, written and directed by James LaPine, was the first known use of projection mapping in a Broadway musical or play.[11] Projection mapping was used at the end of Act II, in the Chromolume #7 special effects sequence designed by Bran Ferren[12] to project geometrically-correct moving cinematic images onto the surface of the 4' diameter sphere topping the Chromolume device. Note; due the brightness limitations of available video projection technology of the time, the images were projected using 7000w xenon illuminated, 35mm motion picture film (projected at 48 frames per second). The images on the film were digitally pre-distorted, to provide the necessary warping, to map correctly onto the sphere from the high projection angle in the Booth theater.

The first time the concept of projection mapping was investigated academically[13] was at the University of North Carolina at Chapel Hill in the late 1990s, where a team led by Ramesh Raskar worked on a project called Office of the Future to connect offices from different locations by projecting people into the office space as if they were really there.[14] By 2001, more artists began using projection mapping in artwork, and groups such as Microsoft began experimenting with it as a means of technological advancement.

Methods
The Sydney Opera House during the 2013 Vivid Sydney projection display

After the object which will be projected on is chosen or created, software is used to map the corners of the video to the surfaces. First, one must choose the images or video to project. Then, place each video on to its designated surface. Alternatively, one may choose to map the entire scene in 3D and attempt to project and mask the image back onto its framework. The next step is defined as "masking," which means using opacity templates to actually "mask" the exact shapes and positions of the different elements of the building or space of projection. In 3D Mapping, coordinates need to be defined for where the object is placed in relation to the projector, the XYZ orientation, position, and lens specification of the projector have to result to a determined virtual scene.[15] One such tool to help achieve this end is BLAM! add-on for Blender's open source 3D animation suite. Adjustments are commonly needed and made by manually tweaking either the physical or virtual scene for best results. Large projectors with 20,000 lumens output or greater are used for large-scale projections such as on city skyscrapers. Due to the sheer scale and brightness required for some projects, often large arrays of powerful projectors will combine into a single image through a method known as "edge blending" or "stacking".[16] The result is a much brighter projection that maintains its seamless look. This is at the root of most large projection mapping shows, and requires skill and patience to set up in specialised software. Otherwise, for smaller productions, smaller projectors with less output will work. A 2200 lumen projector is adequate for projections under indoor light or theatrical lighting in most cases. Video mapping software such as MadMapper, HeavyM, Qlab, Troixatronix's Isadora, FaçadeSignage, ArKaos MediaMaster and GrandVJ and VPT 6.0 are all downloadable for use in projects like these, though Adobe Photoshop, Adobe After Effects, Blender Blam!, and other packages can also be used by a creative artist. Also, extensible open-source software frameworks such as MPM (Multi-Projector-Mapper)[17] are available among others. Projection mapping can be separated into four categories:

  • VJ'ing or VeeJay-ing (video Jockeying) used where live events are augmented by (often interactive to music) projections which are fully dynamic, controlled live, and consist of pre-programmed videos and combinations of effects and effect overlays.
  • Theatrical: where projections are preset and scenes are "cued" on demand, usually in a set order, in conjunction with dance or onstage performance, often interactive.
  • Static/Interactive: where a display is set up and loops or interacts with the environment and viewers via programming.
  • Video: where a generally long segmented show is present as a single fluid video that is not interactive and plays from beginning to end.

Productions, advertisement and art
Projection mapping at Fête des Lumières by P. Warrener in Lyon (2008)
Projection mapping on Cinderella Castle

Projection mapping first came to prominence through guerrilla advertising campaigns and video jockeys for electronic musicians.[18] Large companies such as Nokia, Samsung, Unilever Pakistan, Pakistan Tobacco company, Bank Alfalah, Brighto Paints, Benson & Hedges, John Players Gold Leaf and BMW have since used video projections to create campaigns for their products in major cities across the world. These advertising campaigns commonly use mapping techniques to project scenes onto the sides of buildings and churches. Projection mapping can also be interactive, as Nokia Ovi Maps did a project in which the projections would mimic people's movements.[19] Projection mapping has been used at conferences as a means of decoration or immersing audience members in an experienced-based theme. This can be as elaborate as projecting onto a flat surface, or projecting onto an unusual object such as a car or a chair. The festival Fête des Lumières in Lyon, a festival to honour the Virgin Mary, has recently also started incorporating 3D mapping into their productions, creating the illusion of a giant pinball machine on the side of a building. Common techniques for these performances included both 3-D mapping techniques and 3D projection to create the illusion of depth, as well as motion such as crumbling buildings.

It is also being used in technology such as Domes where it is combined with Virtual Reality and Augmented Reality to create 360 degree projections for a more immersive experience.

The use of projection mapping in TV and films is becoming more popular. For the sci-fi flick Oblivion, the directors used projection mapping to create an immersive environment.[20] For a 2016 TV commercial, Audi used projection mapping to showcase the technology of the Audi Q7 model. The ad, titled Projection of Greatness[21], was filmed with no CGI and used only content that was caught live in camera.[22]

In the electronic dance music (EDM) community, it is becoming increasingly common for DJs to accompany their music with synced visuals. It can either be pre-recorded, or played live by a Video Jockey(VJ). Though normal projection screens are commonly used, some visual artists are beginning to create custom made, 3D installations to project onto.[23] Many EDM artists employ projection mapping techniques at many of their shows. Artists who are solely visual also use projection mapping as a means of creative expression, believing that it can enhance existing creative mediums such as painting and drawing.[24]

Artists may use it as an avant garde form of expression as it is new technology that can turn their creative ideas into 3D projections, connecting with audiences in a new way.[25] Video projections have appeared in urban centres such as New York City and London, where artists have used guerilla projections in public without any necessary approval. This way, artists can show their work in any location as anything and anywhere can be a canvas. Often people also use it as a means of activism; the group Occupy Wall Street has used it to project onto the Verizon Wireless building in New York City as a means to visually spread the word that Occupy Wall Street is still alive.[26] The Japanese theatre play Mysteries of Yoshitsune I&II (2012-14) is notable for the first major use of projection mapping in Japanese theatre stage play.[27][28][29]

Recently, projection mapping has been used more and more frequently by Walt Disney Imagineering and Walt Disney Creative Entertainment in the Disney Parks. Examples of this include, but are not limited to, The Magic, the Memories and You, Disney Dreams!, Celebrate the Magic, Once Upon a Time, Disneyland Forever, Halloween Screams, Believe... In Holiday Magic, Remember... Dreams Come True, Happily Ever After[30] and most recently Sunset Seasons Greetings at Disney's Hollywood Studios.

When Paul Oakenfold became the first DJ to perform live at Stonehenge, projection mapping was used to transform the prehistoric monument into a spectacular light show. [31] In order to avoid causing damage to the ancient stones, only 50 of Oakenfold's close friends were invited, and they all had to wear noise-cancelling headphones in order to hear the music above the nearby A303 road.

gollark: It says they cost a lot, *not* the actual fraction of budgets these things cost.
gollark: This is mostly irrelevant.
gollark: http://www.mybudget360.com/wp-content/uploads/2014/12/college-tuition.png
gollark: I mean, probably a decent amount, but not "oh bees it costs ten times more now" quantities.
gollark: There's probably some information on this. How much of their budgets is in fact spent on sports?

See also

References
  1. Maniello, Donato (2014). Augmented Reality in public spaces. Basic Techniques for video mapping. Vol. I. Brienza: Le Penseur. ISBN 978-8895315348.
  2. Maniello, Donato (2018). Advanced video mapping techniques. Spatial Augmented Reality applied to cultural heritage. Vol. II. Brienza: Le Penseur. ISBN 978-8895315584.
  3. "What is projection mapping". Retrieved 13 February 2015.
  4. Maniello, Donato (2018). Spatial Augmented Reality. The development of edutainment for augmented digital spaces. Vol. III. Brienza: Le Pensuer. ISBN 978-8895315591.
  5. DoomBuggies.com</a>, <a href='http://doombuggies com/'>Jeff Baham. "The Secret Tech Behind Disney's Haunted Mansion Illusions". Gizmodo. Retrieved 2020-04-17.
  6. Raskar, Ramesh (1998). "Spatially Augmented Reality" (PDF). IWAR.
  7. "The Illustrated History of Projection Mapping". Retrieved 25 March 2013.
  8. "The Beatles: Blue Jay Way Is a Hidden Masterpiece". Den of Geek. Retrieved 2020-01-16.
  9. Naimark, Michael. "Spatial Correspondence in Motion Picture Display" (PDF). SPIE Proceedings, vol. 462, Optics and Entertainment, Los Angeles, 1984.
  10. Naimark, Michael. "Two Unusual Projection Spaces". Presence, Special Issue on Projection, MIT Press, 14.5, October 2005.
  11. "Sunday in the Park, Isolating with Mandy and Bernadette, While Overlooking the Isle of Toronto – Times Square Chronicles". Retrieved 2020-04-17.
  12. "Sunday In the Park with Geoge". IBDB.
  13. Raskar, Ramesh. "Spatially Augmented Reality" (PDF). Office of the Future. IWAR. Retrieved 21 September 2016.
  14. Towles, Herman. "Office of the Future". UNC.
  15. "Virtual replica of the real scene". Retrieved 11 July 2012.
  16. "Edge Blending and Stacking in Projection Mapping". Retrieved 26 June 2020.
  17. "Multi-Projector-Mapper". Retrieved 5 February 2014.
  18. Sigrist, Peter. "A short history of 3D projection mapping". Archived from the original on 17 April 2011. Retrieved 3 July 2012.
  19. O'Neill, Megan. "Comcast is looking for a Executive Director, XFTV Programming. WEB VIDEO 3D Projection Mapping Taking The Advertising World By Storm".
  20. "Projection Mapping in Oblivion (starring Tom Cruise)".
  21. "Projection of Greatness: The all-new Audi Q7".
  22. "Illuminating Audi's latest advancements".
  23. "deadmau5 lights up London with amazing 4D projection- Nokia".
  24. "How To Use Projection Mapping In Events".
  25. "Mission / Artist Statement". Integrated Visions.
  26. Day, Adrienne. "When Skyscrapers are your Screen".
  27. "Moon Saga 〜義経秘伝〜 Vol.2 Live Report" (in Japanese). Excite Japan. 2014-08-08. Retrieved August 28, 2014.
  28. "Gacktが紡ぎだす歴史ファンタジーの世界感を 日本の舞台史上最大規模のプロジェクションマッピングで演出する Moon Saga－義経秘伝－第二章". Theatrix (in Japanese). Entertainment Plus. 2014-07-24. Retrieved August 28, 2014.
  29. "原作、脚本、音楽、演出、主演をGacktがプロデュースする舞台『Moon Saga－義経秘伝－第二章』、絶賛上演中！". Theatrix (in Japanese). Entertainment Plus. 2014-08-18. Retrieved August 28, 2014.
  30. Mine, Mark R.; van Baar, Jeroen; Grundhöfer, Anselm; Rose, David; Yang, Bei (July 2012). "Projection-Based Augmented Reality in Disney Theme Parks". Computer. 45 (7): 32–40. doi:10.1109/MC.2012.154.
  31. "Projection Mapping Lights Up Stonehenge".
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.