The Relationship Between Experimental Animation and Sound Exploration

In order to gain a better understanding of more abstract and less structured conceptual creation in 3D space, I Intend to explore visuals inspired by the geometric stylisation of cubist movements such as artists Jean Metzinger and Sonia Delaunay to see how they would move in relation to sound. The 70s and 80s inspired experimental synth-pop bands such as ’Cluster’, ’Brian Eno’ and ’Tangerine Dream’ Use music that evokes the epitome of electronics, which in my own mind seems to perfectly fit aesthetically with abstractly formed computer-generated imagery.

Cubist inspiration and Reference

When reflecting on Cubism as an artistic movement it makes statements about the modernism movement that help speculate on how arts perception is progressing.

Jean Metzinger

Music Inspiration and Development

An interesting quotation to consider looking into the Functions of experimental and electronic music that stimulates visual ideas of movement is from Pauline Oliveros stating:

“I think of the delay system as a time machine, because first, you have to be present to make a sound and play it. Then it’s recorded and played back in the future so what the future is essentially dealing with is really the past. So it sort of expands your sense of time” (Pauline in Holmes, 2016, p.169)

Going forward with experimentation in this aspect, I think audio delay systems present in the late 60s and 70s synth-pop provide interesting associations with the sci-fi and the extraterrestrial, and I could play on these widely accepted associations to create ‘alien’ or ‘otherwordly’ insinuations that evoke a sense of mystery without the need of extensively defined visuals. In reference to Holmes Seven fundamental traits of electronic music, one of the points he discusses is electronic music as the ability to expand the perception of tonality (2016). Highlighting the fact that electronic music can ”stretch the concept of the pitch into the opposite direction, toward a less defined tonality into the realm of noise” (Holmes, 2016, Pp.171). Taking this concept in a literal visual sense, I could adapt a 3D perception using influences from aspects such as sound waves to perceive music.

Here is an example of electronic music by Cluster, which I will use as inspiration when writing different music pieces that could compliment my visuals.

Something that experimental provides aesthetically visuals for in terms of creating aesthetic computerised animation is a variation in the shapes of soundwaves

Experimental Music Test 1

Taking this into garage band, and using instruments reminiscent to that of those typically used in an experimental synth-pop formation, I tried to replicate interesting sounds and patterns which will be a basis for further experimentation later on.

Experimental Song 2

Bibliography

. Holmes, Thom, 2016. Electronic and Experimental Music. Fifth Edition. New York: Routledge

Thesis Idea- Viewer engagement with Animated Documentary

Going forward with a thesis topic for this coming year, the area of research around viewer engagement with the animated documentary is something I wish to pursue. This is due to the fact that not only will its finding benefit my final major project, but could potentially benefit the area of animated documentary in my findings of with method of animation best accentuates the portrayal of personal experiences in the most visually engaging ways. Key areas I wish to look into include the emotional response of facial expression and scientific areas such as the mirror neuron system which take into considerations aspects of human empathy. I also wish to delve into areas that look at anonymity provided by animation, and confessional and therapeutic aspects of creating personal documentation through animation.

Previous/ Similar Studies Found-

Animated documentary: Viewer engagement, emotion, and performativity – AUBREI – Arts University Bournemouth Research Excellence and Impact (Emotion in Animated film)

Some Research References-

  • Hill, Annette. “Documentary Modes of Engagement.” In: Austen, Thomas and Wilma De Jong (Eds.). Rethinking Documentary: New Perspectives, New Practices . New York: Open University Press, 2008: 217– 231.
    Emotion in Animated Films, edited by Meike Uhrig, Taylor & Francis Group, 2018. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/ual/detail.action?docID=5548779.
    Created from ual on 2022-02-11 13:13:12.]

Canet, Fernando and Héctor Perez. “Character Engagement as Central to the Filmmaker– Subject Relationship: En Construcción (José Luis Guerin, 2001) as a Case Study.” Studies in Documentary Film , 10(3), 2016: 215– 232.
Emotion in Animated Films, edited by Meike Uhrig, Taylor & Francis Group, 2018. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/ual/detail.action?docID=5548779.
Created from ual on 2022-02-11 13:14:05.

Fore, Steve. “Reenacting Ryan: The Fantasmatic and the Animated Documentary.” animation: an interdisciplinary journal , 6(3) 2011: 277– 292.
Emotion in Animated Films, edited by Meike Uhrig, Taylor & Francis Group, 2018. ProQuest Ebook Central, http://ebookcentral.proquest.com/lib/ual/detail.action?docID=5548779.
Created from ual on 2022-02-11 13:15:10.

Week 3: Concept Art and Research

For my project I wanted to look into aesthetic considerations that explored the dynamic movement and environment of my characters and how the lighting might be developed later on in 3D space.

I thought the most appropriate setting would be a theatre stage, perhaps reminiscent of that in ‘Vaudeville’ theatre. A stated by Crafton “Although `Vaudeville was nearly defunct at the time, cartoons from the 1930s through the 1960s riffed on its memory” (2013, pp.7).

In regards to Vaudeville’s English context the term describes ” a catch fall for musical comedy” (Cullen, 2006 pp.12), which suits aesthetically the genre in which I intend to make my film. This is particularly prevalent in my plans to incorporate ‘trap doors’ and value comedy over morals. While this may be unachievable for my current modelling abilities, I feel the heavy felt curtains and the grandiose atmosphere created by the French influence is a great place to start building references. I do feel that perhaps the elaborate-ness of the vaudeville stage may not be befitting of my overall film aesthetic due to my simplistic character designs, and may take away viewer focus from my animated performance.

Vaudeville Stage Examples

Below I have drawn and environmental concept work which indicates the rough style and lighting I would like to incorporate into my work going into the modelling and pre-visualisation stage. This piece also helps me gain a clearer understanding of the differing character personalities of the two skeletons while utilising only the movements of their eyebrows. The main thing I wish to take into consideration is the heavy use of spotlights, which potentially, will behave like their own characters within the piece, which I intend to explore more in the storyboard and animatic of my film. These lights, as well as concepts of the ‘trap door’ which will seemingly have a mind of its own. One of the key things I wish to conceptualise is the absence of visual audience within the scene. The use of sound will be the main and only implication of audience engagement as I feel this separates the scene further from the ‘real world’ and allows more for modelling time. I also believe the disembodied voice adds a ‘ghostly’ effect which strengthens the uncanny implications of the dead.

Concept art piece: environmental

An important step when creating computer animation is to create a character turnaround sheet so you can begin to gain a rough understanding of all angles of your future model. I will utilise this going forward into my character modelling stage, and also make more reference to the real anatomical skeleton to get a further level of accuracy than that provided in these drawings.

Character Turnaround

References

.Crafton, D. (2013). Shadow of a Mouse: Performance, Belief, and World-Making in Animation. United States: University of California Press.

.Cullen F. (2006). Vaudeville, Old and New: An Encyclopaedia of Variety Performers. Taylor & Francis Ltd.

Workshop: Camera Sequencer

Considering cinematography and camera work in 3D space is imperative to creating effective and well-considered motion pictures. Learning and adapting Ideas for the below video, I intended to create two establishing shots utilising the camera sequencer feature in Maya.

(17) How to Speak Movie Part 1: The Camera – YouTube

Sequence 1

For this first test, I used this mountain terrain environment to consider a larger environmental establishing shot that eventually draws the viewer to a small ‘cabin’ in by the central lake. This goes from a wide shot to a slow pan down, to a zoom shot that focuses on the central point where a potential plot will be developed.

Using Dolly Aim Constraint

The cameras used in this workshop imitate the functions of those in real life, being restricted to a ‘dolly’ track which in real life only allows the camera to go from side to side attached to a track. Using this method in 3D space makes more authentical and life-like camera motions in a ‘fake’ and forcibly intentional space.

See the source image
Dolly Controlled Camera

The Camera Sequencer

The camera sequencer works in the way multiple separate playblasts from the separate cameras would once be edited in video software but takes away the additional step so it is simple to preview in Maya. This will prove effective for shot planning and production efforts later on in my work so that cinematography can be planned later on without the requirement of additional software.

The Final Shot Compilation Using the Camera Sequencer

Sequence 2

Contrary to the previous shot which was slower and more relaxed in pace, for the next sequence I wanted to test a faster paced and more ‘tense’ environment through shot creation that will help build a story in 4 shots. A fast pan shot to establish the speed of the cars, a pan shot to establish the number of people, hinting towards and city environment, and two close-ups to establish a potential interaction.

The Camera Sequencer Shots

Camera Sequence 2

Week 3: Collaborative Project

Group Meeting and Notes:

We discussed our progression with being inducted and understanding how to use the VR oculus rift. We showed our progress with our Google Tilt Brush development and discussed how we intend to develop the storyboards created in the previous week into VR space. The VR team began implementing and testing the modelled assets and their potential functions in VR

VR Induction and Testing

Following on from last week’s research into storyboard creation in tilt brush for VR, myself and Mariana got inducted into using the virtual reality headsets provided at the university to practice and get used to using the equipment. During this process, we were able to better understand how 3D space works in immersive engagement which can later help us better understand how to create 3D assets and animations utilizing the very personal and up-close experience that is inherently coupled with putting on the headset.

Learning to Draw in 3D Virtual Reality Space

Models

Progressing from last week’s models, this week I created the ice cream cart that the two seagulls will interact with, and the ‘Ice Cream’ Mini game will take place. This means that the model required surface area and interactable ice cream cones that are separated from the original mesh. In order to heighten the level of realism, I learned how to create an N Cloth material so that the roof of the cart would be able to realistically interact with elements such as wind in the unity engine.

Creating N Cloth and Passive Collider

N Cloth/ Cloth Simulation in Unity

Importing this model into unity proved to not effectively retain the baked simulation information, so I researched alternative solutions and there proved to be an efficient Cloth simulation very reminiscent of Mayas, within Unity programming. This can be controlled by both collision and elemental effects such as wind, which may prove useful at later stages of the project.

Following a youtube tutorial, I began to understand that by attaching a Cloth node to a specified object it functions very similarly to the Ncloth function in Maya, and began to translate my understanding of simulation friction, dampness and weight to the cloth in unity.

Cloth Functions in Unity

In this light, I imagined that the use of passive colliders, similarly to Maya, would be required for object collision. However, I came across several issues during this process that differed from Maya. Unity’s colliders seem to be created into specific shapes (Spherical, Cylindrical and Box), none of which accurately made the polygonal structure of the cart, which caused the shape of the cloth to fall in an unnatural and asymmetrical manner.

Colliders and Cloth Components Added

Following on from this, It created the cloth simulation to fall off the object as if it was attached to a cylinder, rather than the shape of the cart and fell off in a very fast and unnatural way that would not work for our game. After looking into several tutorials, I contacted a team member from the VR group to help me analyse exactly what the issue was and engage my learning and understanding of unity to a higher standard.

Cylindrical/ Spherical and Box Colliders Having Non-realistic Effects on Cloth

After consultation and working with our VR team member, Cal, he was able to assist me in further understanding the different functions of colliders. His initial exploration involved shaping the different spherical, cylindrical and box colliders into a shape that appeared reminiscent of the box cart mesh, in order to create the illusion of the cloth falling into the correct place. However, this proved ineffective and only created more issues in the unrealistic cloth formation.

With the both of us looking deeper into cloth simulation, the use of ‘cloth particles, is used to create greater accuracy as you can use a brush tool in order to indicate which aspects of the cloth you want to directly affect and bind to different elements of the mesh. Using this Method, Cal was able to demonstrate how to effectively get the cloth to be stabilised and attached to the mesh, and also have realistic object and simulation reactivity.

Effective Cloth Simulation by Cal

Critically reflecting on this process, I feel that when working in unity it will be extremely beneficial to understand in further depth the controls of cloth simulation as working and exporting in Maya cannot always be fully reliable. Taking this into consideration, however, I feel as a 3D artist predominately using Maya it will be very beneficial to further explore Ncloth’s relationship with different software and how to properly export a simulation for better industry standard practice.

Tutorials for Cloth Simulation Learning Reference

(38) Maya 2016 tutorial : How to export an nCloth object ( FBX ) – YouTube

CLOTH SYSTEM in Unity 2018 | Beginner’s Guide – Bing video

Experimental Animation Example Task

It can be argued that Fantasmagoire by Emile Cohl (19dhdhd) is entirely experimental animation, as it represents animation in one of its earliest rudimentary ‘modern’ forms. It experiments with character movement, expression and emotions in ways that, while being a source of entertainment, provide a foundation for the basis of character animation as we have become to know it. While it has a narrative foundation, I feel there is a deeper element at play that could arguably define it further as experimentation.

Making reference to Paul Wells Understanding Animation, Wells states that experimental animation heavily involves abstraction that “redefines ‘the body’ or resists using it as an illustrative image” (1998, p.43). While Phantasmagoria clearly represents characterised human bodies, there is a metamorphic element that explores the ‘interpretive form’ of the characters that “reconstruct a different conception of narrative” that arguably “prioritises abstract forms in motion” over conventional and linear storytelling (Wells, 1998 pp. 43-44). I think its key explorative elements and its founding ideas of assisting in the definition of animation as an art form over entertainment in conception, are what stands out as an experimental piece of work. Wells expansion of the ‘presence of the artist’ is also prevalent in this piece of work, narratively and also psychically as he demonstrates at the start the direct relationship between craft and craftsman, showing Cohls hand directly influencing the draw figure (1998, p.45). I think what separates the work from more conventional animation in its formation is the ‘dream-like’ non-linear narrative provided in the piece that distances itself from relation and has its “ own abstract logic” such as decapitation and defiance of the laws of gravity (Wells, 1998, p.45). I feel this is also accentuated in its titles direct name ‘A fantasy’.

As a piece that is also argued as the first animated cartoon, it is created with intention to create and discover drawn motion and characterisation that distinctly gives it a purpose other than purely entertainment factor, which associates well with the ideaology of experimentation within film and the animated medium.

References

Wells, P. 1998. Understanding Animation. Routledge: Oxon, United Kingdom.

Week 2: Character Design Concept Art

Baring in mind different aspects of design and how they will translate into 3D space, it is essential to consider stylistically how it will be modelled. As stated in the book ‘Virtual Character Design for Games and Interactive Media‘, the “development of good character art is not possible without a solid understanding of nature” (Sloan and Stuart, 2015, pp.3) . Due to my direct reference to the human skeleton, it is important that I consider aspects of the real human body and understand its anatomy. Going forward into the modelling stage, I will make reference to the book Anatomy: A Complete Guide for Artists (Sheppard, 1933).

Trying to keep the design as minimal as possible, I want to push expression with a lack of facial aspects, heavily relying on the eyebrows to convey the majority of emotion. This design also will help me explore aspects of rigging and character modelling without overcomplicating the design for myself.

Character Inspiration and Mood Boards

A Large influence for my character ideas is Jack Skellington and the concept works of Tim Burton, as I like the ‘lankier’ and threatening yet simultaneously friendly looking character appeal. I think this largely comes from a longer, sharper body contrasted with a softer and friendly face.

Character Inspiration Mood board

Applying these ideas to my own sketches and concepts, I have given the character sharper and longer exemplified collarbones contrasting with a ‘cute’ round face which lacks in emotive feature bar eyebrows. I think the simplistic and minimal facial expression will help add an uncanny element, since facial expression is predominantly read through the upper regions of the face, and accentuate his ‘dead’ ness (Tinwell, 2015).

Concept Art

Aesthetic inspiration

when designing the overall look of the film, I felt very inspired by early black and white cinema, and want to take aspects of this into the final composition of my short animated film. In order to do this I have been considering multiple post production editing solutions and ideas to help build and expand on my overall look development.
Due to one of my main editing software’s being Da Vinci resolve, I looked into old film effects that i can later use in tests to see how the old scratch film look will appear. This will be useful to provide tests with later on in the production stage

https://youtu.be/Sdp1t2s8s1k


Dance and Motion Inspiration

Thinking ahead for motion aesthetics and character reference Ideas, I think a strong visual for these skeletons could be the graceful and well timed dance motions of singing in the rain. The ballet-esque dance moves displayed in the film will I think epitomise the Hollywood association of the late 1920’s, and will help set my animation contextually and tonally.

References

.Sloan, R. and J Stuart. (2015). Virtual Character Design for Games and Interactive Media. Natick: CRC Press

.Sheppard, J. (1993). Anatomy: A complete Guide for Artists. New York: Dover Publications.

.Tinwell, A. (2015). The Uncanny valley in Games and Animation. Boca Raton, Florida: CRC Press