Author: Esme Duncan

Completed Gameplay Capture

Finalising all the work completed with the MA VR team in the week prior, we were able to produce a 5-minute long virtual reality experience from a comic book adaptation. Wit interactions are heavily inspired and directly referenced from In the works of Joshua Barkman (False Knees) the experience places the player as a seagull and the actons of unravelling between two seagulls and their day at the seaside. Going through these scenarios, different interactions such as an ice cream collecting mini-game, throwing beachballs and hitting seagulls with sticks add interactional applications for the player. Due to the immersive and in-depth experience players are affronted within the virtual reality space, It felt important that sound was integrated in an effective way, therefore the bird’s interactivity with the sound to bring its presence felt important to player engagement. Below is the final five-minute gameplay capture, displaying these features.

Final Gameplay capture with commentary from VR Students

The below video includes the gameplay capture featured with VR commentary to outline with more clarity the interactions and gameplay feature the player can get involved with.

Critically reflecting on the project, as well as my personal participation in it, the limited time span and ambitiousness of the project and the number of scenes that required animating created quite a few hurdles due to lack of experience. Despite these limitations, we were successful in creating a 5-minute long virtual reality experience that included several interactive elements that the player could engage with. While two out of three of these environments were completed, the last city environment proved to have too many elements that required additional work we didn’t factor into our timeline due to technical issues. Reflecting on my own personal engagement with the project, while I was able to help with early development including storyboarding, conceptual art and modelling I felt that my animations could be pushed to a higher quality in a similar light to those I created the last term. Due to several importing/exporting issues that occurred between Maya and Unity as well as reoccurring issues with the rig, the time spent animating was severely limited due to the initial plan. Due to polygon loss during the exporting process, a lot of the expression and motion in the Maya scene was lost when placed into Unity. The animation itself was also stripped from detail due to rigging issues and last minute directional changes, forcing myself and my team members to focus on meeting our deadline whilst sacrificing nuanced quality. However, taking into consideration stylization the minimal amount of animation and lack of realistic detail adds to character design and comedic effect.

Showreel Of Participation

Below is a showreel to display some of the work I produced during the length of the project, taking some of my reflection into consideration the areas that needed more development were my asset modelling and character animation as I feel these both suffered a lack of quality due to time constraints. To improve my asset modelling I would take more time with texturing as I felt some of the textures and detail did not match the overall world they were imported into. Initially, I explored using software called Nomad (an iOS application) it caused some exportation issues between both Maya and Nomad, this also drastically raised the number of polygons which would be inefficient to put into a Unity scene and would cause issues with real-time rendering overload. A process to help retain polygon quality onto a low poly model can be done by implementing the use of a ‘Normal Map’ which is “a special type of texture that tells the 3D program or game engine to display details on a polygon surface as though they were geometry” (Totten, 2012, p.106). When working with game engines in the future, I fully intend to administer this into my modelling work. In Nomad I was creating realistic textures whilst contradicting the textures being used in the False Knees game file which were very minimal and cell-shaded in style.

Miro Board

Cal from VR kept a record of each group meeting held and what was discussed as well as resolved during each week:

Meeting Notes (Collaborative Unity) – Google Docs

Throughout the entirety of the project, we were able to communicate and convey our progress and ideas very visually to one another through the use of the miro board below. This proved to be particularly useful during all group meetings and helped convey ideas very efficiently during class presentations. Below is the completed Miroboard.

Future research areas to improve and engage with Games engine relationship to computer animation-

.Blackman, S. 2011. Beginning 3d game development with Unity: the world’s most widely used multi-platform game engine. Apress.

. Penny de, B. 2012. Holistic game development with Unity: an all-in-one guide to implementing game mechanics, art, design, and programming. Waltham, MA: Focal Press.

.Botz-Bornstein, T. 2015. Virtual Reality. Leiden: BRILL.

.Cotton.M. 2021. Virtual Reality, empathy and ethics. Basingstoke: Palgrave Macmillan.

.Ryan, M, L.2003. Narrative as Virtual Reality: Immersion and Interactivity in literature and electronic media.

Collaborative Blog Posts

Module Introduction: Collaborative Unit: Initial Considerations – Esme’s Blog (arts.ac.uk)

Module Introduction: Collaborative Project: Idea and Skill Pitch – Esme’s Blog (arts.ac.uk)

Workshop: Camera Sequencer – Esme’s Blog (arts.ac.UK)

Collaborative Seminar 1:Collaborative Seminar – Esme’s Blog (arts.ac.uk)

Collaborative Seminar 2:Workshop: Group Seminar – Esme’s Blog (arts.ac.uk)

Week 1: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 2: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 3: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 4: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 5: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 6: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 7: Collaborative project – Esme’s Blog (arts.ac.uk)

Week 8: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 9: Collaborative Project – Esme’s Blog (arts.ac.uk)

Week 10: Collaborative Project – Esme’s Blog (arts.ac.uk)

References

Totten, C. (2012). Game character creation with Blender and Unity. John Wiley & Sons, INC: United States of America: Indianapolis, Indiana.

Team Summary:

We all prepare for the final critical presentation with the VR students and develop our own slides. I and Marianna also complete all animations for the beach scenes and import them successfully into unity with few further issues but the slight mesh and aesthetic setbacks that do not directly affect gameplay.

Final Critical Presentation with VR students:

Collaborative Project – Final Crit Presentation – Google Slides

As it is the final week of the development of our project, we complied presentations with the virtual reality students for their final critical presentation in order to be given constructive feedback by their professors. During this process, I and Marianna complied some slides to contribute to the overall presentation in which we showcased and examined the different sections of our collaboration such as initial concept art and modelling, the character rigging, speech bubble interactive design and the animation process. This was a very useful process as we were able to compile all the work we had completed together as a team and present it to an audience that had knowledge of the areas of potential improvement. While this presentation was more centred around the VR students and their unity build, so we did not have the presentational space to go into massive depth about our work on the 3D animation side of the project, we were given the chance to summerise how our contribution was vital to the completion of the project and gave us a chance to critically reflect on every aspect of production.

Critical Reflection and Feedback from VR Lecturers

Initially stating how we were able to produce a 5-minute gameplay sequence in software over the course of only 10 weeks, I would argue we achieved a lot that was very useful and education in the field of 3D produced work. I feel our particular successes were in the overall design and story-driven elements due to our concentration on the narrative drive. I feel exploring the method of storying boarding within the 3D environment itself proved massively beneficial on a personal level to gain an understanding of exactly the realm in which we were immersing ourselves and our skillsets.

Reading from the work of Bucher, he brings to attention two questions when considering storytelling (Bucher, 2018):

Who is the audience?

What is one thing you want them to walk away with?

When critically reflecting on these questions in regards to our narrative experience there are two answers regarding what we have produced. The audience is intended for people over 15, but more specifically people who enjoy the narrative experience of a comic book. By creating the addition of swearing and comedic violence, it begs the question as to what age group this exactly falls into, but I feel the real audience is vaguer than a specific age. The game’s ability to draw older audiences into more classical childlike narratives begs the question of VR and animation’s potential as a storytelling medium for more than pure video game entertainment. The game’s purpose, in my opinion, when reflecting on what we achieved seems to serve predominantly learning procedures to teach us effectively collaboration across disciplines. In spite of this, I think it serves a grander purpose of pushing the exploration of non-gameplay heavy experiences that can be created in Virtual reality that embody and underline the importance of an experience in which there is no expectation or pressure placed on a player to do well to succeed.

In terms of collaboration, one of the primary pieces of feedback we received during this critical presentation was how well coordinated and communicated we were as a team in order to create the aspect we did. This I feel was particularly effective in our regular communications and meetings every week. I also on many occasions called teammates using Microsoft teams to continue to be effective in the workflow without having to be present in the same room.

An interesting comment which changed my perspective of our gameplay narratives was the use of speech bubbles seeming ineffective in their state, especially with the audio present. Going forward with these ideas of the project it seems imperative to make this more effectively design, and perhaps integrate elements of the bubbles following the player so they are always reading and facing the viewer.

Relevant tutorial to explore this:

(51) How to make any object looking at and facing towards the player in Unity – YouTube

The major point of reflection in regards to the entire gameplay sequence is the lack of progression we were able to make in regards to the last city scene. If the workflow was more researched and understood prior to starting the project, I feel this would have been achieved much faster as the primary issues that set us back were the Maya to unity conversions. In a reflective element though, the entire process was extremely beneficial educationally and inspires me to want to continue progressing in the field of games animation in future. Since I and the rest of the team mutually agree on combining our efforts to finish the project outside of graded assessment, I feel this will push us all to create a finalised finished piece that can be used as a strong showreel material.

References

Bucher, J (2017), Storytelling for Virtual Reality: Methods and Principles for Crafting Immersive Narratives, Taylor & Francis Group, Oxford. Available from: ProQuest Ebook Central. [7 Feb 2022].

Meeting Notes and Weekly Goals:

This week’s meeting entailed how the rig issues that previously prevented the animation stage from starting are now at a malleable and workable stage in which all beach scene animations are a priority and should be completed within the course of the week. As well as this good progression was made on the Ice cream mini-game, as well as the development of the unity/ Maya rig tests.

This week’s Aims:

.Complete all personally assigned beach scene files (Interaction 4)

.Resolve any last issues that may prevent gameplay function in Unity

Issue Resolution: Non-Functioning Rigs in Unity

an Issue Marianna encountered when animating one of the interactions was that the animation, when imported into unity, would not apply to the models. After meeting with the VR students, it became apparent the importance of finalising the rig and model before importing and animating sequences intended for unity.

Using a process I discovered the last term when I had a similar issue regarding a non-functioning rig containing well-developed animation information, I exported Marianna’s animation for interaction 3 as an Anim file and imported this onto the most updated version of the rig in which I had fixed some issues regarding the rigging and skin weighting of the beak. While most of this importation was safely transferred, I had to reanimate the beak speaking in time with the relevant audio as the information could not be transferred onto a rig that did not previously exist. Despite this, the resolution was reached and functioned just fine in unity after engaging in a Microsoft teams meeting with our teammate Cal so we could test directly how well the process worked. Due to the nature of animated games, in which a finalised rig is required to apply animation information in the games engine, animated films can use a referenced rig that updates with the animated information. Proceeding with this information in future I will assist to create a cleaner pipeline in which myself and the other animations are definitely working with the same rig. This will further be prevented by the fact that my and my future collaborators’ rigging knowledge will be more in-depth, especially regarding functions in engines such as Unity, that will prevent issues needing to be consistently fixed.

Animation

As mentioned by Fothergill and Flick on the ethics of human-chicken relationships in video games, the idea of chickens being symbolic of cowardice and domesticity is strongly associated with its comedic effect (2015). While in the context of our project, seagulls in themselves are viewed widely as irritating and inconvenient to humans on a daily basis, which gives a further implication and suggestion for the use of violence in-game. A key aspect of the gameplay for our project is the ability to pick up objects in the environment and use them to attack the seagulls, especially in regards to this interaction here, and bring to attention an important aspect of gameplay. Due to society’s embedded behaviours, it seems obvious to a player without specific instruction that the intention of the game is to inflict violence on the bird who is causing you the most personal irritation. This is expanded by Bucher, who suggests that a key element to the success of a player to advance in a non-linear narrative is the “continued reliance on linear logic” which in its own way implies that the player themselves is the key driver to the narrative rather than a camera (2018,p.84) I feel societal association works to our benefit for this particular project, however, leaves questions for more ethical considerations in future. Violence in video games is something taken as a given, even in its comedic form, and especially for a game that in its aesthetic appearance seems harmless in presentation. It insinuates potential underlying factors that create the product to have a problematic ethical response. Especially in the first person, fully immersive experience of the Oculus rift, where it seems far less distant than simply watching a narrative play out through the confines of a screen. As discussed by Matthew Cotton, Immersive VR systems are considered “empathy-arousal” tools that can be utilised to ‘stimulate empathetic engagement towards marginalised or vulnerable peoples’ ( 2021: 113). In this instant, by using violence as a comedic effect it brings to attention a line perhaps that should be drawn through this incorporation that will be beneficial to consider, especially by what it represents in anthropomorphic characters than embody some kind of human experience. This being said, seagulls in our current climate are in some danger brought to attention by environmentalists, which may spread a negative environmental image to players.

The nature of this interaction is to engage with the viewer and their place as a ‘seagull’ who is part of the conversation at hand. The use of the ‘stick’ or piece of washed up driftwood for the player to take first-hand was something interesting to consider when approaching this piece, as the use of constraints in Maya was something that would not necessarily function the same in unity. Taking this into account, I broke the animation down into 5 separate FBX files that the VR students could then trigger and engage in based on player interactivity. File 1: The triggered initial dialogue between seagull A and B. File 2: The Looping animation, engaging the viewer to take the stick. FIle 3: The interactions between seagull A and B after the stick has been taken. File 4: a looping animation that awaits the player to hit seagull A with the stick. File 5: The interactions between Seagull A and B once this action has been triggered.

Breaking these down into the different files proved very useful for the VR students when coding into the unity file the different interactions. However, I feel this is something we should have regarded earlier on in the project, as the structural ‘shot’ planning could have been produced more effectively.

Speech Bubble Design for Sky Scene

For the sky environmental scene, the only ‘animation’ required was the speech bubbles that will be interacted with the skyspace. For this, I used my previous designs to work in cooperation with Marianna to create bubbles that appear rudimentary in concept but paired with movement appear to have a charm to them. Reflecting on our overall use of speech bubbles in regard to this project, I feel we perhaps could have considered character and emotional portrayal more with the linework involved. For example for the stupid seagull, creating the lines is a specific way that encapsulates his ‘simplicity’ such as lots of easily curved lines, whereas we could have used sharper, more dynamic lines for seagull A to accentuate his frustrations and more depth of thought and feeling.

I think that by incorporating a more ‘foul’ linguistic approach, it tries to separate itself from a younger audience despite its inherent childlike aesthetics that perhaps will assist in pushing forward the use of animated media in the adult world associations.

Critical Reflection on Animation Process

During this week we were productive in our endeavours to complete the first three scenes, the Beach, the Pier and the Sky, which was our minim aim for the 10-week project. This being said, we still needed to develop enough to at least begin animation in the city environment. Going forward with game student collaboration, I feel I have a much deeper understanding of how Maya works in relationship to game engine requirements, and will allow a much longer and more developed contingency time for aspects such as rigging, and will produce animated FBX file tests much earlier on to identify issues sooner.

References

.M. Cotton. 2021. Virtual Reality, empathy and ethics. Basingstoke: Palgrave Macmillan.

.B. Tyr Fothergill and C Flick. 2016. The Ethics of Human-Chicken Relationships in Video Games: The Origins of the Digital Chicken. SIGCAS Comput. Soc. 45, 3 (September 2015), 100-108. DOI: hht://doi.org./10.1145/2874239.2874254