Animation and Live Action: Bringing Plasmatics to the Silver Screen_2

Luc Besson: The Extraordinary Adventures of Adele Blanc-Sec 2010 Luc Besson from The Fifth Element onwards has demonstrated the mastery of the kind of high-resolution imaginative interpretation that I associate with Total Cinema. Here the seamless integration of animatronic and digital pterodactyls and revivified mummies fit well in the Edwardian (Belle Epoque) imagined by Jacques Tardi in his comic books of the same name. But this is not just another example of the brilliant realisation and remediation of the strip form, it is Luc Besson tapping into the ‘steam-punk’ zeitgeist, and like Jean-Pierre Jeunet’s delightful MicMacs of the previous year (and Jeunet’s earlier Amélie (2001), Besson brilliantly evokes a poetic and magical France – here set in the Belle Epoque that marries the whimsical magic of Raymond Peynet, the suspension of disbelief of the fairy tale, with the francophile consciousness of Melies and Feuillade.

Just to recap: the phenomenon of Total Cinema is emerging out of the marriage (or convergence) of computer-generated imagery and filmed live action. This emerging hybrid (film/digital) art form was initially called virtual cinematography (a phrase coined, I think, by John Gaeta, the special effects director on The Matrix series). So virtual cinematography is the beginning of total cinema, and it comprises several technologies that I cover in this blog. To reiterate, these technologies include:

rotoscoping

photo-grammetry

motion capture

compositing

special effects

CGI – computer generated imagery – modelling and animation

crowd simulation software

time-slice video, and bullet-time

augmented reality – virtual reality

These are the founding technologies of Total Cinema, but the art forms of the 21st century (let’s call them Expanding Cinema – an adaption of the phrase coined by Gene Youngblood in Expanded Cinema his book of 1970, where he surveyed the multitudinous foundations of the new film-related arts emerging from the 1960s counter culture). Expanding Cinema will embrace a far greater range of speculative forms emerging from the digital world, and most especially perhaps the new spaces of augmented/enhanced reality, the world of games, the world of social media, and the contextualisation of film within our culture generally (Secret Cinema, ‘prosumer film-making’ and ventures of this sort).

We are in a melting pot of ideas, of technologies, of art practices and increasing audience empowerment that is changing the way we conceive of films, how we finance films, make films, distribute films, appreciate films, and respond to the cinematic experience. That moving pictures (film, animation and realtime-imagery) will be central to the multi-faceted face of 21st century art, I have no doubt. That these emerging new forms will be immersive, multi-sensory, multi-media, interactive and participative is also most likely. It is also extremely likely that we will never again have a standardised fixed form (as we did during the c90 years dominance of 35mm film technology). We are in a period of what Rosalind Krauss calls the post-medium condition. Expanding Cinema, like the digital computing/software world it now inhabits, is continually evolving. The artist’s palette of the 21st century is itself transforming. It is likely to continue to give us the richest, most accessible, most customisable, most available, continuously evolving, continually expanding cinema…

Peter Greenaway: Tulse Luper Suitcases 2003-04. This is a film-based multi-media project by Greenaway, comprising 4 films – 3 ‘source’ films and one feature-film (DVDs), as well as web-sites, books and CDROMs. “The project has been described by Greenaway as “a personal history of uranium” and the “autobiography of a professional prisoner”. It is structured around 92 suitcases allegedly belonging to Luper, 92 being the atomic number of uranium as well as a number used by Greenaway in the formal structure of his earlier work (most notably The Falls). Each suitcase contains an object “to represent the world”, which advances or comments upon the story in some way, although in many cases the contents are more metaphorical than real.” (wikipedia)

Over the last twenty years, several researchers, fascinated by these emerging forms, have attempted to provide suitable descriptors – Michael Nash in his Vision after Television: Technocultural Convergence, Hypermedia and the New Media Arts field (1996), traces the impact of digital on the ‘traditional’ (analogue) video arts; Peter Greenaway only last year (2014) reiterated his ‘Cinema is Dead, Long Live Cinema‘ mantra:

“Cinema’s death date was 31 September 1983, when the remote-control zapper was introduced to the living room, because now cinema has to be interactive, multi-media art,” and

“Every medium has to be redeveloped, otherwise we would still be looking at cave paintings… New electronic film-making means the potential for expanding the notions of cinema has become very rich indeed.”

(These pronunciations by Greenaway were made at a master class at the Korean Pusan Festival in 2014. http://www.independent.co.uk/news/world/asia/greenaway-announces-the-death-of-cinema–and-blames-the-remotecontrol-zapper-394546.html)

The diversity of the expanding cinema forms range from viral web videos, to stage illusions/performance, to spectacular films:

Jonas Akerlund and Lady Gaga: Telephone 2010. In this promop-video for her song Telephone, Gaga and Akerlund lean heavily on tropes from Quentin Tarantino’s Pulp Fiction, orchestrated in a short film story and syncopated by Gaga and Beyonce’s brilliant performance. A ‘pure pop for now people’ production (the descriptor comes from Davie Robinson’s Stiff Records button-badge of c1978), Telephone is a hymn to B movies, Noir film, pulp crime magazines and Captain America pop art. Its great!

Zack Snyder: Watchmen 2009. Another brilliant remediation of the comic-graphic novel form. As digital imaging technologies, CGI, and special effects arts grew to full maturity in the first decade of the 21st century, It became possible to do full justice to the new wave of reflective superhero comics from the likes of Alan Moore, Grant Morrison, and Frank Miller. Zack Snyder and Robert Rodriguez had worked together on Miller’s Sin City (2005) – a film that to me was the perfect synthesis of film and CGI for this remediated story. Watchmen explores the synergy in a somewhat less stylised form.

Chris Milk: The Wilderness Downtown 2009. In this multi-window, realtime, customisable package, where the narrative is driven by music, Milk and his Google colleagues create a showpiece ‘interactive movie’ that combines generic components composited in real-time with live Google Earth and Streetview feeds. Very powerful – because it is customisable to the individual user/viewer.

Improv Everywhere/Chad Nicholson: Frozen Grand Central 2007. Live participatory, immersive performance – like this and other events staged by from Improv Everywhere (see also Human Mirror 2001) demonstrate another strand of the various media-art experiments intertwining in Expanding Cinema.

Will-I-Am and Jesse Dylan: Yes We Can! 2008. This video went viral in 2008. It was composed by Will-I-am and Jesse Dylan (son of famous Bob), and is comprised of mostly monochrome clips and stills and audio quotes from the Barack Obama’s Presidential campaign of that year. Going viral means that it was recommended by burgeoning links through social media, quickly reaching over 22 million recipients. It was videos like this that awoke marketeers to the promotional potential of the viral, self-recommending nature of media artefacts in the social media matrix.

Musion: Eyeliner projection illusions 2009. Recreating stage presence by using h-tech versions of the 19th century Pepper’s Ghost illusion, Musion added another tool to the rapidly extending vocabulary of multi-media staging and lighting.

2012_Marshmallow-Laser-Feast_realtime-projection-mapping_c

Marshmallow Laser Feast: realtime-projection mapping 2012. In this short promo for Sony Playstation, Marshmallow – a team of artists and developers – create what used to be called ‘post-production fx’ in realtime, using clever projection-mapping, performance and digital smoke and mirrors. Phenomenal!

So this is a brief summary of the territory that 2014 film students will be entering. That it is a territory much dreamed about by experimental artists for the last 200 years (see Richard Wagner’s Das Kunstwerk der Zukunft of 1849), and envisioned in many different (analogue) forms by the Modernist avant garde (by El Lissitszky, Rodchenko, Kurt Schwitters, Lazlo Moholy Nagy etc etc), will not deter contemporary students from making their own explorations and innovations in this fantastically rich media palette.

Animation and Live Action: Bringing Plasmatics to the Silver Screen

It was Sergei Eisenstein, in a series of essays written in the early 1940s (later published as Eisenstein on Disney, and as Sergei Eisenstein: Disney – edited by Oksana Bulgakowa and Dietmar Hochmuth, Potemkin Press 2013), who described Disney’s films (and by extension all animated cartoons) as having the quality of plasmaticness:

“The rejection of the constraint of form, fixed once and for all, freedom from ossification, an ability to take on any form dynamically. An ability which I would call ‘plasmaticity,’ for here a being, represented in a drawing, a being of a given form, a being that has achieved a particular appearance, behaves itself like primordial protoplasm, not yet having a stable form, but capable of taking on any and all forms of animal life on the ladder of evolution.”

Walt Disney + Ub Iwerks: Steamboat Willy 1928. This was the short animated film that launched Disney’s most famous anthropomorphic character, Mickey Mouse. Eisenstein would have been thoroughly familiar with cartoons from Disney, Fleischer, Hannah-Barbera and other animators of this period.

Eisenstein envied the animator the freedom of the mythological shape-shifter – the ability to change the forms of his character to illustrate their evanescent identity, their dual or multiple nature, or to illustrate and express metaphorically their change in temperament or mood. Potemkin Press describe Eisenstein’s objective in the blurb for Sergei Eisenstein: Disney:

“His essay on Walt Disney was part of his unfinished book METHOD, a study of the relationship between archaic thought and art practice. Disney becomes the central subject of analysis, because in his work the synesthetic affects of sound and color, and the perfect visual rhythm unite with animism, totemism and the plasmatic qualities of form. Eisenstein discovered in these distinctive characteristics of form a long genealogical ancestry and a deep yearning for the freedom that could allow one to imagine and even represent differently the relations of man and nature.”

(http://us.potemkinpress.com/products/eisenstein-method-disney-edited-and-commented-by-oksana-bulgakowa-and-dietmar-hochmuth)

Walt Disney: Fantasia 1940. Disneys rather self-conscious masterpiece of this early period was of course Fantasia (1940), which drew upon the talents of his astonishing team of animators, the Philadelphia Orchestra, several classical compositions, and the arrangement and conducting skills of Leopold Stokowski. Thjis cel is from the section The Sorcerer’s Apprentice – one of eight animated sections in Fantasia.

Walt Disney: Three Little Pigs 1935 (from Silly Symphonies (1930-1940).

Eisenstein was so impressed with Disney’s work that in 1935, when he was a judge at the Cannes Film Festival, he insisted that Disney’s Three Little Pigs should get first prize. But it was the general ability of animators to create with total artistic (and ‘plasmatic’) freedom that was entrancing Eisenstein. Of course the possible synergies between animation and live-action cinematography had surprisingly been realised almost from the very beginnings of Film. As early as 1900, James Stuart Blackton had been employed as an artist on one of Thomas Edison’s shorts The Enchanted Drawing (1900) that illustrated this potential synergy.

1900_Blackton_Enchanted-Drawing_first-animation_c

James Stuart Blackton/Thomas Edison: The Enchanted Drawing 1900. Using stop-motion, the filming of an artist drawing where the drawing is made to animate in response to the artist’s drawing, was a major innovation in the history of film, pointing the way to the invention of rotoscoping by Max Fleischer in 1917, and flagging the potential of special effects.

Dave Fleischer + Max Fleischer: Mechanical Doll 1922. The Fleischer brothers invented a rostrum rig for creating rotoscoped animations in 1917. Rotoscoping involved back-projecting live action cine frames, one frame at a time, onto a translucent drawing board so that animators could trace-over the live-action image and convert the live-action to animation. Here, 5 years later the Fleischer’s explore the natural outcome of their rotoscoping process in this short animation integrating live-action and animation.

Dave and Max Fleischer: Mechanical Doll (1922)

For 1922, this is really innovative. Fleischer had invented a rotoscoping rig in 1917, and I guess that the use of this rig would suggest this delightful synthesis of live-action and cel animation – a practice made world famous some 60 years later by Disney in his Who Framed Roger Rabbit (1988)

Bob Sabiston/Flat Back Films: Rotoshop 2001. Sabiston’s Flat Back Films made quite a stir with this semi-automatic rotoscoping software. Experiments in computerised cartooning stem from at least 1990 (see Barlow, Blakemore, Weston-Smith: Images and Understanding (1990)), but Sabiston’s software is state of the art, vastly reducing time spent on the human interpretation of source material and manual rotoscoping.

Autoscope 2014 – this app is being developed right now in 2014, and is only available as a prototype. It follows Bob Sabiston’s clever Rotoshop (2001) as an automatic rotoscoping tool – rather successfully as far as the examples illustrate.

The modest developer of Autoscope (identified on his website as Paul, describes his Autoscope software:

“I turn normal videos into cartoons through the process of rotoscoping, or, to be more precise, autoscoping (don’t look it up; it won’t be in the dictionary … yet). My project, Autoscope, is the result of years of research, experimentation, trials, errors and correcting those errors. The videos I am putting up here show what Autoscope can do. These are just short clips but you could, if you wanted to, remake an entire feature film or an entire TV series in cartoon form.”

http://autoscope.atwebpages.com/index.htm

Richard Linklater: A Scanner Darkly 2006. From Philip K. Dicks ominous 1976 novella about surveillance, Linklater uses rotoscoping (Rotoshop) to semi-automate this high-budget, very successful animated feature. The advantage of rotoscope is that you can combine the best of live-action with the total control of the hand-drawn cel animation.

The most famous movies to benefit from automatic or semi-automated rotoscoping tools are of course Richard Linklater’s rotoscoped A Scanner Darkly (2006), and Ari Folman’s Waltz with Bashir (2008). You need to look at these award winning movies.

to be continued…. see following post

From Cel to CGI: Animation as the Protean Medium

In the early 1940s Sergei Eisenstein wrote a series of articles on the animated cartoons and films of Walt Disney, (published as Eisenstein on Disney) admiring and envying the protean nature of the animation media – the ability of the animator to draw (or create in whatever medium) whatever came into his or her imagination, and to express that directly in their films, often more-or-less single-handedly. In the period that Eisenstein was writing of (1930s-1940s) this total freedom was of course denied the live-action film-maker, who was limited to a palette of cinematography, in-camera effects, optical special effects, editing – and of course the essential métiers of fictional film-making – the production design, costume, make-up, styling, editing and (later) sound, music, colour, etc.

In animation, of course all these skills could be, and often are, under the control of a singular creative artist-animator, or at most a small team of animators who handled the in-betweening – the drawing of the frames that ensured smooth animation between master frames drawn by the chief animator. Other artists might be deployed painting backgrounds, making the sound-track, voice-recording, music and sound effects, etc.

For example, looking at the work of the most famous animators of the period 1920-1940, we have a plethora of examples, including Disney, of the total freedom of the animator. Of course, the pioneer of this form was Emile Cohl, working as early as 1908 with little masterpieces of animation like his Fantasmagorie:

Emile Cohl: Fantasmagorie 1908. Emile Cohl has been described as the ‘originator of the cartoon film’, and in their classic work The Technique of Film Animation (British Film Academy 1959), John Halas and Roger Manvell describe his work: “The French pioneer Emile Cohl put a series of black-line drawings on sheets of white paper and photographed them. On the screen he used the negative film, and so achieved an action performed by white figures on a black background. It might be claimed in his case that he was less concerned with developing any technical skill than with showing the simple charm possessed by his little match-stick creatures. Even at this primitive stage, the emphasis was artistic rather than technical.” Cohl was the first interesting animator, developing some of the basic techniques (principles) of animation – the idea of shooting a series of drawings and projecting these at a frame-rate fast enough (12 frames/sec) to fool our eyes and brains into seeing movement. At first working in France, he spent some time in the USA, teaching animation techniques. What Halas and Manvell have to say about Cohl is of course quite true, his animations were more a proof of concept than a technical demomnstration of how it could be done, However the illustration above shows that even this ‘humble pioneer’ was able to see how, and invent one of the stock-in-trade techniques that we now call ‘morphing’ (from morphology – study of form and shapes), whereby we gradually change one form into another in a sequence of minor changes) could create fascinating animations, and that animation itself could become not only a mass-cinema medium, but an art-form in itself.

Emile cohl: Un Drame 1908. Cohl’s surreal style of drawing, fully exploiting what Eisenstein called plasmaticness – the ability to change or mutate or transform one object into another at will – illustrates the complete freedom of the artist.

But at this period (1920s-1930s) it wasn’t just the animators who were exploring the seemingly infinite potential of drawing. New insights had come from the artist Paul Klee, based on his teaching practice at the Bauhaus c1920-1930. Klee published his ideas on drawing in two books: The Thinking Eye (covering 1921-22) and The Pedagogical Sketchbook. He annunciates the idea later deployed by the Surrealists of ‘taking a line for a walk’ – the Surrealists called this psychic automatism and invented randomised drawing games like the Exquisite Corpse to exploit this creativity. But other influences emerged from popular culture, notably in the then very young art of the newspaper comic strip, and in this metier, it is the drawing art of George Herriman and his remarkable series Krazy Kat that spring to the fore.

George Herriman: Krazy Kat 1938. Herriman is the great poet-artist of the comic form – a truly unique genius in this medium. His subtle, sardonic, insightful humour, married with his gentle surrealism – and the life with which he endows his tripartite cast of characters, makes this a really exceptional work. Ignatz the mouse hates Krazy Kat, who in turn really loves him, and interprets Ignatz’ incessant brick-throwing as a sign of affection.Krazy hates Offissa Bull Pup who in turn loves Krazy and hates Ignatz. With this slender yet richly fruitful plot-idea, Herriman explores the vagaries and frailties of the human condition and our attempts to relate to others – producing delightfully spare drawings in a series that picture the Jewish Ignatz, the black Kat and the WASP Pupp in a strangely urbanised Arizona Desert (Coccocino County) a landscape that often morphs radically from frame to frame. Herriman drew this strip from 1913 to 1944. I’ve chosen to situate this in 1924 because it was the year that the art critic Gilbert Seldes wrote an appreciative paper on Herriman’s Krazy Kat, that positioned it as ‘serious art’. With his playfully surreal plots, his inventive drawing and experimental frame layouts, Herriman exerted an enormous influence on the development of the comic-form. Herriman epitomises the artist-draftsman, adventurous, innovative, practising Paul Klee’s advice to draw by taking a line for a walk.

The freedom of the cel-animator and claymation animator to seamlessly change a shape from one thing into another – to metamorphose or just ‘morph’ objects – is one the characteristics of animation that particularly impressed Eisenstein. Dave Fleischer – the animator who pioneered rotoscoping (more on this later) in 1917 was an exemplar of animation. One of my favourites is his Betty Boop series, especially this one:

Dave Fleischer: Betty Boop in Snow White 1933. Fleischer – always an innovative animator – epitomises the expressive morphing and distortion of characters – here the Evil step-mother is asking her mirror who is the most beautiful one of all? when Betty (Snow White) enters the room.

While drawing a morph from one character to another was easy, creating credible, photo-realist transmutations or morphs was difficult, and it was an aspect of film-making that several directors played with before digitalisation – movies based on upon Robert Louis Stevenson’s novella The Strange Case of Dr Jekyll and Mr Hyde (1886) such as the 1912 version directed by Lucius Henderson, for example:

Lucius Henderson: Jekyll and Hyde (1912). As you can see Henderson relied on just about the simplest possible transition shot – Dr Jykell drinks the potion, bends down, there is a cut, and when he raises his head he is Mr Hyde. Other film-makers used short lap dissolves to achieve the transition – fading out on Jykell, cross-fading in with Hyde – a technique used on the very cusp of digital morphing software by Kevin Godley and Lol Creme in the elegant promo-video for their hit single Cry (1985). The first morph software that I came across was Gryphon Software’s Morph, available for the Mac around 1991-2.

Live-action film-makers utilised animation techniques of course, using stop-motion to gradually expose sequences that animated otherwise inanimate objects, or that ‘animate’ still photographs in a similar way. Or artists could paint, draw or scratch marks straight onto the film-stock, creating a camera-less animation technique. The Canadian Norman McLaren and New Zealander Len Lye excel at these kinds of animation (we’ll look at their work in a future post). Godley and Creme use the early portrait-photography head-rest in their 1985 promo-video Cry.

Godley and Creme: Cry 1985 Kevin Godley and Lol Creme were innovative film-makers as well as talented musicians. In their promo-video for the single Cry, they use a head-rest to help pin-register the eyes of several participants as they lap-dissolve between them. I talked to Kevin Godley a few years later about this video, and congratulated them on a successful use of an established optical effects to achieve this.

Of course, from about 1991-2 onwards, software companies like Gryphon had developed desktop versions of morphing tools (Gryphon’s Morph (c1992). This enabled the user to input two images, and control an automatic morph between them, controlling reference points for each image, specifying the number of in-between frames, and the output resolution and format.

Fantamorph desktop software. Most desktop morph solutions allowed you to input two resource images, then indicate which features should be retained in the final morph.

By the mid 1990s, the digital-film revolution was already underway on desktop computers like the Mac. We had software for non-linear editing (Adobe Premiere 1991) for compression (MPEG-2 1994, and Quicktime (1991). And with Gryphon’s Morph, we could make high-resolution animations from still images. Digital media has in the last twenty years or so, given us the tools by which we can successfully marry live-action cinematography with the effects taken for granted by hand-animators (cel and claymation animators) over the previous century. Another important step on the road to the development of Total Cinema.

To be continued….

Total Cinema and the Phantasmagoria

The blog is about Total Cinema, and like Total Cinema, it is a work-in-progress.

What do I mean by Total Cinema?

I am talking about films in which there appears to be no limit on the imagination of the director/creators in terms of their ability to visualise and illustrate their ideas. The amazing whirlpool battle in Pirates of the Caribbean is an example, the seamless and invisible scaling of Gandalf and the Hobbits in Lord of the Rings another, the low-Earth orbit space sequences in Gravity, – and so on.. Mostly Total Cinema exemplars are those films that rely upon a large component of computer-graphics (CGI) in their production. But they are ‘Total’ also in their potential to integrate – and to illustrate – the many different components of digital art (see later).

Ettiene-Gaspard Robertson: Phantasmagoria – 1802. Robertson’s ‘assembly of phantoms’ was a big hit in London in the very early 19th century. It utilised all the tricks of theatre and stage magician (much as Georges Melies did a century later) to bring ghosts, spirits, and phantoms to his audiences, whose screams and ejaculations would compliment Robertson’s own sound effects (the use of zithers, Chinese cymbals and other strange instruments). Robertson was a pioneer of the use of the new powerful (6-10 Candela) Argand Oil Lamps (invented 1780), used back projection onto theatrical scrim (thin gauze), and smoke and mirrors too…

The essential back-story of Total Cinema can be traced from early 19th century theatrical son et lumiere presentations like those of Ettiene-Gaspard Robertson and Paul Philipdor, called Phantasmagorias (‘assembly of phantoms’, from c1802). Tom Gunning has written an essay about Phantasmagoria (Illusions Past and Future), as theatres of the senses, using illusions, stage magic, smoke and mirrors and importantly the Argand oil-lamp-powered magic lantern projector, and traces it’s transmutations through the 19th century into Symbolist Theatre d’Art (1891), mentioning the mid-century impact of Wagner’s theories of the Gesamptkunstwerk (1849). By the end of the century of course we have the technologies of the gas-light and electric-light powered magic-lantern slide projectors, and the emergence of various moving-picture systems, culminating in the feast of immersive media technologies at the 1900 Paris Exposition. And the cultural historian Marina Warner examines the Phantasmagoria of Robertson, in her book of the same name examining the mediated products of fantasy.

1802_Philipdore_Phantasmagoria_magic-lantern_c

Paul Philipdor/Ettiene-Gaspard Robertson: Magic-Lantern projections in Phantasmagoria 1802. Robertson and Philipdor mounted their magic lantern on rails so that it could be moved backward and forwards to englarge and reduce the projected image. To an audience unused to large-scale moving images, this had a considerable shock effect.

“The phantasmagoria derived directly from the camera obscura and magic lantern shows and many displays had been staged before Robertson’s struck a chord with the public; but Robertson’s Gothic horror spectacular, and its many brilliant twists and devices, turned any spectator from a cool observer into a willing, excitable victim, Whereas the diorama and panoramas concentrated on battles, modern cityscapes, or exotic scenery, customs and people – they are the forerunners of the wide-screen epic film – the phantasmagoria shadows forth great silent movies like F. W. Murnau’s vampire movie Nosferatu (1919) and Robert Weine’s The Cabinet of Doctor Caligari (1919).”

Robertson’s ‘brilliant twists and devices’ included the Argand magic-lantern projector, mounting the projector on rails so that the projected image could be ‘zoomed’ in and out, the use of theatrical scrim (see-through muslin), back projection,

(Marina Warner: Phantasmagoria (2006) pps 147-148

Fura del Baus: Das Rheingold at Houston 2013. Fura del Baus are an adventurous and innovative production company. This is their recent interpretation of Wagner’s Das Rheingold. It illustrates in contemporary media some of Wagner’s aspirations for a total (composite) art work, that he called Gesamptkunstwerk in his 1849 paper: The Artwork of the Future Das Kunstwerk der Zukunft.

In 1967, I wrote a very juvenile but well-meaning (unpublished) essay on the Gesamptkunstwerk (Composite Art Work) for my degree year at Portsmouth College of Art. In summary it traced the immersive, multi-sensory and multimedia aspects of the theatrical arts from Greek Theatre through to 19th century music-hall, Richard Wagner, and into the 20th century via Edward Gordon Craig, Brecht, and Antonin Artaud, wrapping up with the then contemporary practitioners of immersive mediated environments, including Stan Vanderbeek (Moviedome 1963), John Cage and Al Hansen (Happenings 1959).

Stan Vanderbeek: MovieDome 1963 Vanderbeek studied at Black Mountain College where he met some of the great experimentalists of the 1960s – John Cage, Richard Buckminster Fuller, Merce Cunningham, Josef Albers. Vanderbeek was an impressive film-maker, impressing amongst others, Terry Gilliam and Eduardo Paolozzi with his collage-montage animations. The Moviedome was a construction inspired by Buckminter Fuller (the geodesic dome), that housed multi-projection displays of Vanderbeeks films and slide archives.

With the prescience of a 22 year-old, I knew straight away (I will trace some of the sources that inspired me in this essay) that this was the zeitgeist development of the time – the recurring themes of immersion, multi-media, multi-sensoria and synaesthesia (and later, increasingly interactivity), permeated the iterations of avant garde experimental art through the 20th century, culminating in the development of virtual realities, videogames, the internet and web in the millennial decade. Now of course, there are a proliferation of premonitory signals of the new art in what I am calling Total Cinema or the Cinema of Totality (currently characterised by spectacular fantasy and sci-fi movies of the ilk of Avatar (Cameron 2010), Gravity (Cuaron 2014), Pirates of the Caribbean (Verbinski et al 2003- present) and Lord of the Rings (Jackson, 2001-2003) – films where there has been apparently no technical limit to the imagination of the director.)

Edith Sitwell: preparation for Facade-An Entertainment from 1922. With music by William Walton and an improvised loud-hailer, Edith Sitwell performs her zeitgeist work, which received rave reviews for lots of formal innovations and later was made into ballet by Frederick Ashton. This kind of media-art-fusion, made highly contemporary by the improvised PA system, was another signpost on the multifold pathways to the art form of the 21st century.

2007_Verbinski_Pirates_Worlds-End_mocap_c

Gore Verbinski: Pirates of the Caribbean At Worlds End 2007. This was Verbinski’s third triumphant Pirates movie. I loved the way Verbinski compressed almost every possible cliche of the sea (Davy Jones Locker, Pieces of Eight, treasure-islands, ghost ships,) with new mythic hybrids, fusions of marine life and humans, – with all the facility of a great illustrator (see Mervyn Peake: Captain Slaughterboard Weighs Anchor, and Treasure Island). Here’s a binary shot of just one scene, showing the mo-cap performers rigged for motion capture, and the final scene.

I want to wrap this idea up now by saying, along with Tom Gunning, Lev Manovich, and recently Kristen Whissel, that the developments I am going to trace in this series of blogs are the seedlings of a 21st century art form that will draw from these themes and iterate them into a coherent and continually developing series of new art-forms that will be as particular to the 21st century as Cinema, Television and Computing were to the 20th. And all or most of these forms will include moving images of some kind. The cinema may be dead, but the Movies will develop and expand, enveloping us in a new immersive form that will integrate multiple media, incorporate social media, involve interactivity, and provide us with limitless scope for self-expression, for recording the world, for communicating with others, for exploring ideas. This is the media of our time.

Sergei Eisenstein: Eisenstein on Disney (1941,republished 1993)

Tom Gunning: Illusions Past and Future: The Phantasmagoria and its Specters 2004

Marina Warner: Phantasmagoria 2006

Lev Manovich: Software Takes Command 2014

Kristen Whissel: Spectacular Digital Effects – CGI and Contemporary Cinema 2014

Frank Rose: The Art of Immersion 2012

Stephen Keane: Cinetech – Film, Convergence and New Media 2007

Jean Cocteau: mythopoeic movies – La Belle et la Bete 1946

Jean Cocteau: La Belle et la Bete 1946. Josette Day as Belle and Jean Marais as the Beast. The costumes, by Christian Berard and Marcel Escoffier, (and with an uncredited Pierre Cardin as costume-maker); with production-design by Lucien Carre, Antonio Castilo, and Berard, compliment the (uncredited) brilliant prosthetic make-up of the Beast. The fabulous black and white cinematography is by Henri Alekan (who shot the GregoryPeck/Audrey Hepburn modern day fairy-tale Roman Holiday in 1953)

Cocteau’s poetic approach to film-making is summed-up in his collection of writings on Film, published as The Art of Cinema posthumously in 1994.

“A cinema studio is a factory for making ghosts. The cinema is a ghost language that has to be learned. It is incredible for a poet to know this. The day when a director understands that the author’s role is not limited to the script (to writing it) – the day when the author reveals himself – then the dead language of cinema will become a living language.”

Cocteau: Album de Cinema, 1943 from Cocteau: The Art of Cinema 1992

“The film unfolds to a perfectly poised slow tempo in surreal settings that gain intensity from the fabulous decor and costumes, the glittering lighting and the many moments of magic effects. The candle-lit shadow-play deepens the gothic atmosphere of the beast’s castle, harking back to early expressionist classics of the genre.”
— Marina Warner

“When Jean Cocteau made his film of La Belle et la Bête in l946, he imagined a beast who has no rival for hideous fascination among fairytale beasts before or since: Jean Marais’s growling, slowed, incantatory delivery, his sweeping, elaborately princely magnificence of apparel, his thick pelt curling out exuberantly from his lace collar and fine linen as he springs and lopes, and, above all, his staring pale eyes in the great leonine and brindled mask of his face with the two sharp incisors defining his mouth, has never been matched for erotic power. He captures a perfect and irresistible synthesis of repulsiveness and attractiveness, which evokes a genuine frisson of desire in me every time I see it; Cocteau’s realization of a dream about the power of love, as personified by Belle, exercises its seduction again and again over me, even while my common sense, my reason, and a long habit of skepticism about romance tell me I must resist. “

(Marina Warner from the DVD Notes for the BFI release of La Belle et la Bete)

Jean Cocteau: La Belle et la Bete 1946. The Prince aka the aspirant lover Avenant aka the beast, played by Cocteau’s lover Jean Marais with Josette Day as Belle.

Cocteau’s mythic films are his poetic response to the surge of interest in mythology, mythography and the psychology of myth that pervades this period. (A remarkable period for English writing too – in these years we have J.R.R. Tolkein writing his Lord of the Rings, Mervyn Peake creating Gormenghast, C.S. Lewis and his Narnia chronicles, J.R. Eddison and his Worm Ouroborus, as well as the mythographic analyses of Joseph Campbell (The Masks of God), Robert Graves (The White Goddess), etc), the components of Carl Jung’s writings (Psychology and Alchemy, Flying Saucers – the Myth of Things Seen in the Sky,), and of course Jackson Pollock’s paintings of the early-1940s, exploring Jungian archetypes (eg Stenographic Figure, 1942). Of course, with Cocteau, his primary mythopoeic drive is to interpret the mid-20th century zeitgeist in the forms and with a poetic awareness of the archetypal forms to be discovered in fairy stories, in mythologies, in dreams, in archetypes.

In Christian Berard and Lucien Carre’s gothic sets with the real arms holding the flickering and guttering candelabra, Belle (Josette Day) is lost in a dreamlike corridor in the Beast’s castle.

Interestingly in one of his last publications, the mythographer Joseph Campbell (famous by then not just for his vast body of mythographical work, but also because of his role in inspiring the mythology of Lucas’ Star Wars), describes the role that mythography played in his own quest for self-realisation (Pathways to Bliss – Mythology and Personal Transformation, 2004)

“Myth is not the same as history: myths are not inspiring stories of people who lived notable lives. No, myth is the transcendent in relationship to the present. Now, a folk hero is different from the subject of a biography, even when the hero may have been a real person once upon a time – John Henry or George Washington. The folk hero represents a transforming feature in the myth. When you have an oral mythic tradition, it’s right up to date. In the folktales of the American Indians, you have bicycles, you have the form of the Capitol dome in Washington. Everything gets incorporated into the mythology immediately. In our society of fixed texts and printed words, it is the function of the poet to see the life-value of the facts round about, and to deify them, as it were, to provide images that relate the everyday to the eternal.” (my italics)

(Joseph Campbell: Pathways to Bliss pps XVI 2004)

Cocteau is well aware of this poetical driver:

“A film is not the telling of a dream, but a dream in which we all participate together through a kind of hypnosis, and the slightest breakdown in the mechanics of the dream wakens the dreamer, who loses interest in a sleep that is no longer his own”

Jean Cocteau: The Art of Cinema pps 40)

Cocteau describes the experience of film, in a similar way to how William Gibson describes the experience of cyberspace: “Cyberspace. A consensual hallucination experienced daily by billions of legitimate operators, in every nation, by children being taught mathematical concepts… A graphic representation of data abstracted from banks of every computer in the human system. Unthinkable complexity. Lines of light ranged in the nonspace of the mind, clusters and constellations of data. Like city lights, receding…”

(from William Gibson: Neuromancer, 1983)

Jean Cocteau: Mythopoetic Movies – Orphee (1949)

Jean Cocteau, following the surrealists, really epitomised the magical realism or cine-poetic approach to film-making. Not many poets had tried their hand at movie-making before Cocteau, especially not poets particularly fascinated by the mytho-poetic dimensions of fable, fairy story and myth. Cocteau’s two signature post-WW2 movies – La Belle at La Bete (1946), and Orphee (1949) are absolutely must-see films in this refined genre – pioneer films that still stand pretty much on their own, despite the spate of fantasy and magic-realism films that have emerged coevally with modern CGI and digital sfx.

As a reminder of Cocteau’s ingenuity during this post-war period, when film stock was hard to come by, finance was difficult, Cocteau was 57 years old in 1946 when he made La Belle et la Bete, had recently recovered from an opium addiction. Cocteau could not afford the kind of expensive optical and special effects that Hollywood took for granted. He had to invent his own ‘effects’ to bring his re-telling of the story of Orpheus and the Underworld to the screen. In-camera effects and simple special effects were his narrative tools.

1949_Cocteau_Orphee_rubber-gloves_strip_c

Jean Cocteau: Orphee, 1949. Cocteau, strapped for finance, had to use his ingenuity in making the special effects necessary to illustrate Orphee’s transition from the real to the mythopoetic world of the underground. Cocteau chooses the device of the mirror, clever cutting, and a highly reflective basin of mercury. In this sequence we see Orphee approaching the mirror (or is it a pair of hands approaching Jean Marais, wearing the same rubber gloves? Also in this part of Orphee, we see Cocteau reversing the film so that Orphee’s rubber gloves seem to snap on instantly. These simple tricks are very impressive and disbelief-suspending.

Cocteau was making these movies in the context of a surge of interest in poetry and myth signalled by James Joyce: Finnegan’s Wake (1939), Erwin Panofsky: Studies in Iconology (1939), Joseph Campbell: A Skeleton Key to Finnegans Wake (1944), Robert Graves: The White Goddess (1948), Joseph Campbell:The Hero With A Thousand Faces (1949). In the wake of the mythic horrors and devastation of the Nazis and World War 2, and the dawn of the Atomic age with its apocalyptic threat, these timeless subjects came to the fore as mankind searched for new meaning as first peace, then a new ‘cold war’ era, dawned.

Although not a member of the ‘official’ Surrealists, Cocteau’s trilogy of films related to the legend of Orpheus: Blood of a Poet ((1931); Orphee (1949), and Testament d’Orphee (1960) fit well within the surrealist’s spectrum of interests (the subconscious, dreams, myths, universal archetypes, magic, chance, automatic writing, etc). Perhaps, like Appollinaire, Cocteau, in his twenties, had been influenced by the fantastic film series of Louis Feuillade (Fantomas (1913), Les Vampires (1915), Judex (1916). None of these films relied on much more special effects than George Melies had at his disposal, it was their dark mystery and hints of the supernatural that the Surrealists admired. Interestingly Georges Franju made a brilliant re-make of Judex in 1963.

Other significant surrealistic films that Cocteau almost certainly would have seen include:

Rene Clair: Entr-Acte 1924

Lotte Reiniger: Die Abenteur des Prinzen Achmed 1926

James Sibley Watson/Melville Webber: The Fall of the House of Usher 1928

Germain Dulac and Antonin Artaud: The Seashell and the Clergyman 1928,

Man Ray: L’Etoile de Mer (1928)

Jean Epstein: The Fall of the House of Usher 1928

Luiz Bunuel/Salvador Dali Un Chien Andalou 1929

Marx Brothers: Animal Crackers 1930

Carl Dreyer: Vampyr 1932

Marx Brothers: Duck Soup 1933

Dave Fleischer: Betty Boop as Snow White 1933

Marx Brothers: A Night at the Opera 1935

Charlie Chaplin: Modern Times 1936

Curtis Harrington: Fall of the House of Usher 1942

Maya Deren/Alexander Hammid: Meshes of the Afternoon 1943

Walt Disney/Salvador Dali: Destino 1945

While this is speculation (on what Cocteau saw), I wanted you to see that Cocteau’s work, though unique, fits within a broader tradition of artists exploring the unconscious, magic, myth and fable, and the absurdity of modern life.

Of course, making serious films in post war France, even with financing from the generous Duc de Noaille was difficult and to optimise his visualisation of the Underworld, Cocteau was forced by circumstance to be inventive with his special effects, resorting to the simplicity of the smoke and mirror ideas of Melies, and using in-camera effects.

Special effects can often be as simple as ‘in-camera’ effects – you know: the iris fade to black/or white, double exposure, running film in reverse, stop-motion, elapsed time, slow motion, rotating camera, inverting camera, using negative as positive, (etc).

Jean Cocteau: Orphee (1949). Heurtebise, Death’s chauffeur, follows Orpheus through the mirror into the Underworld, distance-fogging (under exposure) underlines the illusion.

Jean Cocteau: Orphee (1949) Heurtibise in the ‘reel’ world sees Orpheus in the Underworld.

http://www.criterion.com/films/610-orpheus

Doug Trumbull: Special Effects on 2001 A Space Odyssey

Modern special effects – certainly in my experience – really date from 1968 – the year that Stanley Kubrick’s 2001 A Space Odyssey was released. Of course, 2001 was made without any computer-generated imagery, but the aesthetics, the ‘visualisation of a near future that hadn’t quite got off the drawing board yet’ makes Kubrick one of those interesting artists who explored analogue prototypes of the digital (CGI) future that would be glimpsed a decade or so later – in the late 1970s (see previous post). Kubrick employed a 23 year old animator called Doug Trumbull to create some of the special effects he needed for 2001. Interestingly, Trumbull’s parents had been a mechanical engineer and an artist – a perfect gene-pool for a special-effects artist!

Previously Trumbull had been making detailed animations about space travel, for the company Graphic Films in LA, and when Kubrick approached his colleague Con Pederson about the sfx on 2001, Trumbull also pitched for the job (eventually both Pederson and Trumbull were employed by Kubrick,, along with Tom Howard and Wally Reevers).

in the 1960s special effects were still largely to do with model-making and clever cinematography, and what was clever about 2001 was two things: the way the camera was controlled mechanically, so that Kubrick could shoot the high-resolution sequences marrying together live-action foregrounds with front-projected very high resolution backgrounds; and secondly, the new ‘Slit-Scan’ process invented by Trumbull for the Star-Gate sequence in the film.

Trumbull lists all the important innovations and workflow practices for 2001:

• the creation of a control room/riling system/idea centre – a room where all the ideas, storyboards, visuals, status reports, etc were kept and filed.

“One of the most serious problems that plagued us throughout the production was simply keeping track of all ideas, shots, and changes and constantly re-evaluating and updating designs, storyboards, and the script itself. To handle all of this information, a “control room,” constantly manned by several people and with walls covered by pert charts, flow diagrams, progress reports, jog sheets, punch cards, and every conceivable kind of filing system, was used to keep track of all progress on the film.”

Trumbull: Creating Special Effects for 2001 A Space Odyssey (American Cinematographer 49(6):416-420,451-453. June 1968.)

For a flavour of this data-base room, see:

http://www.mach25media.com/2001lacma.html

• the use of front projection and retroreflective matting instead of glass-matte paintings to create more realistic backgrounds (since the 1990s this has been superseded by blue-screen/green-screen systems.

http://www.visual-memory.co.uk/sk/2001a/page2.html

Herb A. Lightman : Front Projection for “2001: A Space Odyssey” American Cinematographer

Front-Projection special effects set-up. Instead of a glass painting, Kubrick adapted a front projection technique to create high-resolution back-drops for his Ape-Man sequences and other sequences used throughout 2001 A Space Odyssey. The rear screen is made of a highly reflective material made by 3M – its called a retro-reflective screen. The backgrounds were shot on 10×8 Ektachrome transparencies, and Kubrick had to construct his own 10×8 size projector. These background images were projected onto a semi-reflective glass screen, so that in one take the camera could record both foreground and background images in one take.

”

On the set of “2001: A Space Odyssey,” producer-director Stanley Kubrick uses binoculars to check fine focus on the vast front-projection screen. Special 3M material reflects 100 times the light falling upon the screen, provided that projector and film camera lenses are aligned on precisely the same axis. Kubrick wanted to use an 8×10 transparency for maximum sharpness, found there was no projector for it in existence, built his own.”

• Back Projection (rear-screen or back-projection was used in 2001 for shots of instrument panels)

1968_Kubrick+Trumbull_back-projection-scene_c

“Interior view of the Orion commuter ship approaching the Space Station, with all of its scopes showing readouts. Preparation of these readouts for all the spacecraft ate up tons of technical material and required many months to animate.” Each instrument screen on the cockpit dashboard was a back-projected animation. Here the interface graphics (the cockpit screen readouts) were animated diagrams and schematics from hundreds of technical journals, coloured with gel filters.

• Rotoscoping – where other cheaper or easier effects could not be used, Trumbull, Pederson and co used manually intensive rotoscoping’:

Max Fleischer – the animator later responsible for Betty Boop, Talkartoons and Popeye among many other cartoons – invented this rotoscoping rig in 1917. The idea of tracing live action as an animation tool led to the inricate special effects and compositing technologies in use today. Fleischer also developed ‘karaoke’-style on-screen bouncing-ball lyrics in the 1920s. Rotoscoping involved back projecting a live-action sequence frame by frame onto a translucent drawing frame, where the main actions the animator was interested in could be traced off onto a transparent animation cel.

“Since we couldn’t afford to tie up the animation stand, or any camera, for very laborious and time-consuming rotascope jobs on so many shots, a unique rotascoping system was devised. Using ordinary darkroom enlargers, equipped with carriers for rolls of 70mm film, each frame-by-frame image was projected onto specially marked animation peg boards, to which the projected image of the perforations had to be visually aligned.” (Trumbull, op cit)

• The best technical advisors/the cooperation of leading research/R&D labs on the promise of product placement:

“On the recommendation of Clarke, Kubrick hired spacecraft consultants Frederick Ordway and Harry Lange, who had assisted some of the major contractors in the aerospace industry and NASA with developing advanced space vehicle concepts, as technical advisors on the film. Ordway was able to convince dozens of aerospace giants such as IBM, Honeywell, Boeing, General Dynamics, Grumman, Bell Telephone, and General Electric that participating in the production of “2001” would generate good publicity for them. Many companies provided copious amounts of documentation and hardware prototypes free of charge in return for “product placements” in the completed film. They believed that the film would serve as a big-screen advertisement for space technology and were more than willing to help out Kubrick’s crew in any way possible. Lange was responsible for designing much of the hardware seen in the film.”
George D. DeMet : The Special Effects of “2001: A Space Odyssey”  Originallly published in DFX, July 1999

• Doug Trumbull: more on Slit Scan

Slit-scan was a technique of gradually exposing film, one strip at a time while the camera and/or the background was moved in stages. Trumbull adopted the idea from panoramic camera, and from the idea of the ‘photo-finish’ cameras invented to determine which horse had actually won a race.

output from a modern ‘photo-finish’ camera system. The camera records a temporal event, just as the panoramic camera recorded a spatial event.

1843_Puchberger_Panoramic-slit-scan_camera_c

Joseph Puchberge: Panoramic ‘strip-scan’ camera invented in 1843, for the purpose of taking wide aspect ratio panoramas.

Slit-Scan – the progressive, labour intensive, special effects process now wholly superseded by digital effects.

I’d like to compare Trumbull’s final ‘Star-Gate’ sequence from 2001 A Space Odyssey with a recently made video explaining the slit-scan process.

Trumbull: Stargate Sequence from 2001 A Space Odyssey (1968)

“As the black monolith vanishes into a strangely symmetrical alignment of Jupiter and its moons, the camera pans up and the “Stargate” engulfs the screen. For this infinite corridor of lights, shapes, and enormous speed and scale, I designed what I called the Slit-Scan machine. Using a technique of image scanning as used in scientific and industrial photography, this device could produce two seemingly infinite planes of exposure while holding depth-of-field from a distance of fifteen feet to one and one-half inches from the lens at an aperture of F/1.8 with exposures of approximately one minute per frame using a standard 65mm Mitchell camera.” (Trumbull: op cit)

Slit-scan recreated: John Hess explains slit-scan and recreates a slit-scan rig:

https://www.youtube.com/watch?v=KhRo2WbWnKU

Bernard Lodge: original Dr Who titles 1963. Working from a technical innovation called Howl-Around discovered and used by BBC video technician Ben Palmer, Bernard Lodge began his own experiments with video feedback (howl-around), much as Delia Derbyshire and Dick Mills had utilised audio-feedback in their production of Ron Grainer’s Dr Who theme. This produced visuals that are the video equivalent of Trumbull’s slit-scan effects 5 years later – a mysterious, electronic, temporal-spatial voyage through the new space time of cybernetic (video-feedback) space.

Slit-scan used in original Dr Who titles, designed by Bernard Lodge (1963)

	Shea on Jacqueline de Jong: Situationi…
	Task 2.3: History of… on graphic design in the 1920s
	bobcotton on Richard Buckminster Fuller: Ge…
	Quels enjeux derrièr… on Richard Buckminster Fuller: Ge…
	Ep. 100 – 2001… on Doug Trumbull: Special Effects…

media+art+innovation

A forum about innovation in old and new media

Month: August 2014