Bullet time

Bullet time (also known as frozen moment, dead time, flow motion or time slice)[1] is a visual effect or visual impression of detaching the time and space of a camera (or viewer) from those of its visible subject. It is a depth enhanced simulation of variable-speed action and performance found in films, broadcast advertisements, and realtime graphics within video games and other special media. It is characterized both by its extreme transformation of time (slow enough to show normally imperceptible and unfilmable events, such as flying bullets) and space (by way of the ability of the camera angle—the audience's point-of-view—to move around the scene at a normal speed while events are slowed). This is almost impossible with conventional slow motion, as the physical camera would have to move implausibly fast; the concept implies that only a "virtual camera", often illustrated within the confines of a computer-generated environment such as a virtual world or virtual reality, would be capable of "filming" bullet-time types of moments. Technical and historical variations of this effect have been referred to as time slicing, view morphing, temps mort (French: "dead time") and virtual cinematography.

For the novel, see Bullet Time (novel).

The term "bullet time" had first been used within the original script of the 1999 film The Matrix,[2] and later in reference to the slow motion effects in the 2001 video game Max Payne.[3][4] In the years since the introduction of the term via the Matrix films it has become a commonly applied expression in popular culture.

History

Muybridge horse photos

The technique of using a group of still cameras to freeze motion occurred before the invention of cinema itself with preliminary work by Etienne Jules Marey on chronophotography, later experimented by Eadweard Muybridge. In Sallie Gardner at a Gallop (1878), Muybridge analyzed the motion of a galloping horse by using a line of cameras to photograph the animal as it ran past.[1] Eadweard Muybridge used still cameras placed along a racetrack, and each camera was actuated by a taut string stretched across the track; as the horse galloped past, the camera shutters snapped, taking one frame at a time. The original intent was to settle a debate Leland Stanford had engaged in, as to whether all four of the animal's legs would leave the ground when galloping. Muybridge later assembled the pictures into a rudimentary animation, by placing them on a glass disk which he spun in front of a light source. His zoopraxiscope may have been an inspiration for Thomas Edison to explore the idea of motion pictures.[5]

Muybridge also took photos of actions from many angles at the same instant in time, to study how the human body went up stairs, for example. In effect, however, Muybridge had achieved the aesthetic opposite to modern bullet-time sequences, since his studies lacked the dimensionality of the later developments. A debt may also be owed to MIT professor Harold Edgerton, who, in the 1940s, captured now-iconic photos of bullets using xenon strobe lights to "freeze" motion.[6]

Bullet-time as a concept was frequently developed in cel animation. One of the earliest examples is the shot at the end of the title sequence for the 1966 Japanese anime series Speed Racer: as Speed leaps from the Mach Five, he freezes in mid-jump, and then the camera does an arc shot from front to sideways.

In 1980, Tim Macmillan started producing pioneering film and later, video,[7] in this field while studying for a BA at the (then named) Bath Academy of Art using 16mm film arranged in a progressing circular arrangement of pinhole cameras. They were the first iteration of the "'Time-Slice' Motion-Picture Array Cameras" which he developed in the early 1990s when still cameras for the array capable of high image quality for broadcast and movie applications became available. In 1997 he founded Time-Slice Films Ltd. (UK).[8] He applied the technique to his artistic practice in a video projection, titled Dead Horse[9] in an ironic reference to Muybridge, that was exhibited at the London Electronic Arts Gallery in 1998 and in 2000 was nominated for the Citibank Prize for photography.[10]

The first music video to use aspects of bullet-time was "Midnight Mover", a 1985 Accept video.[11] In the 1990s, a morphing-based[12] variation on time-slicing was employed by director Michel Gondry and the visual effects company BUF Compagnie in the music video for The Rolling Stones' "Like A Rolling Stone",[1][13] and in a 1996 Smirnoff commercial the effect was used to depict slow-motion bullets being dodged.[14] Similar time-slice effects were also featured in commercials for The Gap[2] (which was directed by M. Rolston and again produced by BUF),[15] and in feature films such as Lost in Space (1998)[1] and Buffalo '66 (1998)[2] and the television program The Human Body.

It is well-established for feature films' action scenes to be depicted using slow-motion footage, for example the gunfights in The Wild Bunch (directed by Sam Peckinpah) and the heroic bloodshed films of John Woo. Subsequently, the 1998 film Blade featured a scene that used computer generated bullets and slow-motion footage to illustrate characters' superhuman bullet-dodging reflexes. The 1999 film The Matrix combined these elements (gunfight action scenes, superhuman bullet-dodging, and time-slice effects), popularizing both the effect and the term "bullet-time". The Matrix's version of the effect was created by John Gaeta and Manex Visual Effects. Rigs of still cameras were set up in patterns determined by simulations,[2] and then shot either simultaneously (producing an effect similar to previous time-slice scenes) or sequentially (which added a temporal element to the effect). Interpolation effects, digital compositing, and computer generated "virtual" scenery were used to improve the fluidity of the apparent camera motion. Gaeta said of The Matrix's use of the effect:

For artistic inspiration for bullet time, I would credit Otomo Katsuhiro, who co-wrote and directed Akira, which definitely blew me away, along with director Michel Gondry. His music videos experimented with a different type of technique called view-morphing and it was just part of the beginning of uncovering the creative approaches toward using still cameras for special effects. Our technique was significantly different because we built it to move around objects that were themselves in motion, and we were also able to create slow-motion events that 'virtual cameras' could move around – rather than the static action in Gondry's music videos with limited camera moves.[16]

Following The Matrix, bullet time and other slow-motion effects were featured as key gameplay mechanics in various video games.[17] While some games like Cyclone Studios' Requiem: Avenging Angel, released in March 1999, featured slow-motion effects,[18] Remedy Entertainment's 2001 video game Max Payne is considered to be the first true implementation of a bullet-time effect that enables the player to have added limited control (such as aiming and shooting) during the slow-motion mechanic; this mechanic was explicitly called "Bullet Time" in the game.[19] The mechanic is also used extensively in the F.E.A.R. series, combining it with squad-based enemy design encouraging the player to use bullet time to avoid being overwhelmed.[20]

Bullet time was used for the first time in a live music environment in October 2009 for Creed's live DVD Creed Live.[21]

Technology

A row of small cameras set up to film a "bullet time" effect

The bullet time effect was originally achieved photographically by a set of still cameras surrounding the subject. The cameras are fired sequentially, or all at the same time, depending on the desired effect. Single frames from each camera are then arranged and displayed consecutively to produce an orbiting viewpoint of an action frozen in time or as hyper-slow-motion. This technique suggests the limitless perspectives and variable frame rates possible with a virtual camera. However, if the still array process is done with real cameras, it is often limited to assigned paths.

In The Matrix, the camera path was pre-designed using computer-generated visualizations as a guide. Cameras were arranged, behind a green or blue screen, on a track and aligned through a laser targeting system, forming a complex curve through space. The cameras were then triggered at extremely close intervals, so the action continued to unfold, in extreme slow-motion, while the viewpoint moved. Additionally, the individual frames were scanned for computer processing. Using sophisticated interpolation software, extra frames could be inserted to slow down the action further and improve the fluidity of the movement (especially the frame rate of the images); frames could also be dropped to speed up the action. This approach provides greater flexibility than a purely photographic one. The same effect can also be simulated using pure CGI, motion capture and other approaches.

Bullet time evolved further through The Matrix series (1999–2003) with the introduction of high-definition computer-generated approaches like virtual cinematography and universal capture. Universal capture, a machine vision guided system, was the first ever motion picture deployment of an array of high definition cameras focused on a common human subject (actor, Neo) in order to create volumetric photography. Like the concept of bullet time, the subject could be viewed from any angle yet, at the same time, the depth based media could be recomposed as well as spatially integrated within computer generated constructs. It moved past a visual concept of a virtual camera to becoming an actual virtual camera. Virtual elements within the Matrix Trilogy utilized state-of-the-art image-based computer rendering techniques pioneered in Paul Debevec's 1997 film The Campanile and custom evolved for The Matrix by George Borshukov, an early collaborator of Debevec. Inspiration aside, virtual camera methodologies pioneered within the Matrix trilogy have been often credited as fundamentally contributing to capture approaches required for emergent virtual reality and other immersive experience platforms.

For many years, it has been possible to use computer vision techniques to capture scenes and render images of novel viewpoints sufficient for bullet time type effects. More recently, these have been formalized into what is becoming known as free viewpoint television (FTV). At the time of The Matrix, FTV was not a fully mature technology. FTV is effectively the live action version of bullet time, without the slow motion.

See also

• Time-lapse photography

References

1. Argy, Stephanie (21 January 2001). "Frozen f/x still in action: There's less love for morph". Variety.com. Retrieved 3 April 2012.
2. Green, Dave (June 5, 1999). "Better than SFX". The Guardian. London. Retrieved December 18, 2009.
3. Max Payne: Official Police Dossier (game manual). The Game World: Bullet Time. PC CD ROM version. 2001. p. 19. When pressed into a tight spot, Max can activate Bullet Time, which will slow the action around him, while allowing him to aim his weapons in real-time. This ... even allows Max to dodge oncoming bullets.
4. "Max Payne". IGN. Retrieved 2014-07-28.
5. Hendricks, Gordon (1961). "The Edison Motion Picture Myth". Berkeley, California: University of California Press. Cite journal requires |journal= (help)
6. "High Speed Camera". Edgerton Digital Collections. 2009-11-28. Retrieved 2009-11-28.
7. Video of Tim Macmillan Early Work 1980 - 1994 on Vimeo
8. Rehak, B. (2007). The migration of forms: Bullet time as microgenre. Film Criticism, 32(1), 26-48.
9. Galloway, Alexander R. 2014. "Polygraphic Photography and the Origins of 3-D Animation". In Animating Film Theory, edited by Karen Beckman, p.67, n.17. Durham, NC: Duke University Press.
10. The British Journal of Photography (Archive: 1860–2005), 145(7283), 4.
11. "ACCEPT Remembered - Discography - Metal Heart". Archived from the original on 15 February 2002.
12. Thill, Scott. "'How My Brain Works': An Interview with Michel Gondry". Morphizm.com. Like with The Rolling Stones' video for "Like a Rolling Stone", which is already ten years old. I used morphing in a different way than it was used at the time.
13. "BUF".
14. "BUF".
15. "BUF".
16. "200 Things That Rocked Our World: Bullet Time". Empire. EMAP (200): 136. February 2006.
17. Porter, Will (1 September 2010). "A videogame history of bullet-time". GamesRadar. Retrieved 2 December 2016.
18. "Requiem: Avenging Angel Review". Gamespot. April 25, 1999.
19. Loveridge, Sam (July 23, 2016). "15 things you didn't know about Max Payne". Digital Spy. Retrieved January 9, 2018.
20. Burford, GB (5 January 2013). "The Remarkable Achievements Of A Game Called F.E.A.R." Kotaku. Retrieved 2 December 2016.
21. "Creed Announce First Live DVD". Guitar World. November 24, 2009. Archived from the original on January 10, 2010.