Categories
Advanced and Experimental with Serra

Week 19

This week was dedicated to filming and editing the final project. We booked the 270-degree screen room and successfully loaded our project into the space. Overall, the process went relatively smoothly, although we encountered a few technical challenges along the way. Initially, we struggled to fit the resolution correctly to match the proportions of the wide screen. Fortunately, with the help of the technicians, we were able to configure everything correctly. Another issue we encountered was that our project had been built using POPs, while the computers in the room were running an older version of TouchDesigner that did not support it. Thankfully, this turned out to be less of a problem than we expected, and we were able to find an alternative workflow without significantly affecting the project.

By the end of the day, we had managed to record live footage inside the installation while simultaneously exporting windows directly from TouchDesigner. Seeing the project operating within the 270-degree space was particularly rewarding, as it transformed something we had been viewing on laptops into a much more immersive experience. Recording the interaction also reinforced Serra’s earlier advice about the importance of showing the audience how the installation is meant to be experienced. Capturing the interaction with the work made the concept much easier to communicate.

After filming, we moved into post-production. We divided the remaining tasks between the three of us to make the process more efficient. I focused on editing the footage and arranging the clips according to the layout and narrative structure we had previously agreed upon. Charlotte worked on the script and voice-over, while Ayca concentrated on writing the project statement. Although we were all responsible for different parts of the project, we remained in constant communication and made decisions together. Working this way allowed us to complete the project efficiently and reinforced how much trust and collaboration had developed within the group since our previous unit together.

Categories
Advanced and Experimental with Ting

Week 18

This week we continued from where we left off in the previous workshop, this time focusing on Studio Library and animation layers. Ting showed us how Studio Library can be used to save poses and animation clips and then easily transfer them between scenes. She also revisited animation layers, explaining how they allow animators to stack motion on top of existing animation without destroying previous work. Having seen them briefly before, I appreciated this second look because I was beginning to understand how these tools fit into a professional workflow. They seemed less like shortcuts and more like ways of working non-destructively and staying organized.

To put these ideas into practice, we were given a task that involved importing a jump animation, complete with the rig and environment, and modifying it so that the character jumped from one location to another. We then had to bring in the attack animation from the previous week’s Mario plant exercise and animate Mario interacting with it. I found this task interesting because it was less about creating everything from scratch and more about combining and adapting existing animations. It felt closer to how game animation pipelines might work, where animators are often required to reuse and modify assets rather than constantly creating new ones. Working with animation layers made it much easier to add changes without affecting the original motion.

Looking back, I realized how much my perspective on animation tools has changed over the course of the year. At the beginning, I wanted to animate everything manually because I thought using tools somehow diminished the craft. However, after learning about AnimBot, Studio Library and animation layers, I am beginning to understand that professional animation is not about doing things the hardest way possible. Instead, it is about finding efficient workflows that allow you to spend more time making creative decisions. The exercise also reinforced the importance of organization and planning, since managing multiple imported animations and layers quickly becomes confusing without a clear structure. I can see myself incorporating these workflows into future projects, as they make iteration much less intimidating and encourage experimentation without the fear of breaking previous work.

Categories
Advanced and Experimental with Serra

Week 18

This week was mainly focused on bringing together the different stages of our project and transforming the raw tracking data into a more coherent visual experience. Building on the work from the previous week, we expanded our MediaPipe setup by introducing heatmaps to represent areas of high activity. Rather than simply showing tracked points and lines, the heatmaps allowed us to visualize where movement was concentrated, adding another layer to the idea of the AI observing and analysing the subject. We also spent time experimenting with motion trails and refining the way movement data was displayed to make the visuals feel more dynamic and informative.

As we developed these elements, we realised that having access to data was not enough; we needed to communicate it in a way that felt believable and visually engaging. We spent time researching references on data visualisation, interface design and motion graphics, looking at how graphs, labels and different visual elements could work together to create the impression of a sophisticated analytical system. We also began working on the final stages of the experience, including the completion screen. Inspired by some of the references we found, we designed a sequence that displayed messages such as “100% Complete” and “Subject Categorized”, helping create the impression that the AI had successfully processed the participant.

During our tutorial with Serra, she once again stressed the importance of clarity and encouraged us to think carefully about who the audience was and how the experience would be understood. Following her advice, we decided to fully embrace the 270-degree room for the final presentation and restructured the project around that environment. We also developed the analysis stage using the POPs plugin in TouchDesigner, creating abstract particle formations that represented the AI processing large amounts of human data. This became the most visually overwhelming section of the project and contrasted nicely with the final stage, where the visuals became much cleaner and more machine-like. By the end of the week, we had established a clear progression from data collection, to analysis, and finally to categorisation. For the first time, it felt like the individual pieces were coming together into a complete experience rather than separate experiments.

Categories
Advanced and Experimental with Nigel

Week 16

There was no formal session this week, which gave me an opportunity to focus on developing my proposal independently. Most of my time was spent reading sources, refining my chapter structure and considering how the practical and theoretical aspects of the project could support one another.

One area I continued to think about was the relationship between traditional filmmaking and immersive storytelling. The more research I conducted, the more interested I became in one-shot cinema as a bridge between conventional film directing and 360° experiences. Both forms require directors to guide audience attention without relying heavily on editing, making them useful points of comparison for my research.

Although progress this week felt slower than during previous weeks, the independent study period allowed me to spend more time engaging with the literature and developing a clearer understanding of the topic.

Categories
Advanced and Experimental with Ting

Week 17

This week I continued refining my advanced animation shot and presented another pass to Ting. She felt that the changes I had made to the chest and cog were a big improvement and that the body was beginning to feel much more alive. Her main note this time was that the shoulders and neck still felt too rigid. She encouraged me to offset them slightly so that the upper body would appear more relaxed and natural. I found it interesting how such small details can make a big difference to the overall feel of a performance.

We also had a workshop introducing AnimBot. Ting gave us a walkthrough of many of its features and explained how professional animators use it to speed up their workflow and automate repetitive tasks. It was interesting to see how much time it could save, particularly when dealing with breakdowns, spacing and pose manipulation. To demonstrate its usefulness, Ting gave us a quick exercise involving a Mario-style piranha plant attack. The task was designed in such a way that completing it without AnimBot would have been considerably more difficult and time-consuming.

Unfortunately, because of issues with my operating system, I was unable to get AnimBot installed. I spent a large portion of the session trying to troubleshoot the problem and, if I am honest, I became quite frustrated. At one point I almost gave up on the workshop altogether because I felt like I had already fallen behind everyone else. Eventually, I decided that rather than spending the entire class fighting with the software, I would simply attempt the exercise without AnimBot. Although it was slower and probably not as efficient, I was glad I made that decision. Looking back, the experience reminded me that while tools can greatly improve a workflow, they should not become barriers to learning. It also reinforced something I have learned repeatedly throughout the year: when things do not go according to plan, it is often better to adapt and keep moving rather than wait for perfect conditions.

Categories
Advanced and Experimental with Ting

Week 16

This week I focused on creating the first pass of my advanced animation shot based on the hospital scene from The Walking Dead. Having spent the previous week planning and gathering references, I finally started blocking out the performance. I concentrated on getting the main poses and timing down rather than worrying about details. Since the scene relies heavily on acting and body mechanics, I wanted to establish a solid foundation before moving into polish.

After presenting the first pass, Ting thought it was a good start but had several notes for improvement. She suggested switching the character’s hand from FK to IK because the arm was swinging too much and distracting from the performance. She also felt that the centre of gravity could be more dynamic, encouraging me to make it “bouncier” so the character would feel more alive and connected to the ground. Another point she raised was that the chest animation felt too stiff. Although I had focused on the hips and limbs, I had neglected the upper body, causing the performance to feel rigid. These notes made me realize that believable motion comes from the entire body working together rather than individual parts moving independently.

Looking back, I noticed that I am becoming much more comfortable receiving feedback. Earlier in the year, I would often feel overwhelmed by notes because I interpreted them as evidence that the shot was not working. Now, I see feedback more as a roadmap for the next pass. I was happy that Ting considered the shot a strong starting point, and her comments gave me a clear direction for improvement. More than anything, this week reminded me that the first pass is not about perfection but about creating something solid enough to build upon.

Categories
Advanced and Experimental with Serra

Week 17

This week did not have a major workshop or technical lecture. Instead, Serra focused on explaining the requirements for the final submission and showed examples of how students from previous years had structured their work. I found this really useful because I had been feeling quite overwhelmed by the number of deliverables and was still unclear about what was actually expected from us. Seeing examples of successful submissions helped me understand how everything could be presented and gave me a clearer picture of how to organise our own documentation.

The rest of the session was dedicated to project work. During a brief discussion with Serra, she once again stressed the importance of clarity throughout the project. Although our concept involving AI and prediction algorithms was technically interesting, she reminded us that the audience needed to understand what they were seeing and why it mattered. One suggestion she made was to film the interaction inside the 270-degree screen room. She explained that even a short clip showing someone entering the installation and interacting with it would communicate the purpose of the project far better than screenshots alone. This advice made us think more carefully about how the final work would be experienced and documented.

We spent the remainder of the session working on the next stage of the project, which involved generating heat maps and motion trails from the movement data we had collected. After searching through tutorials and experimenting with different approaches, we were able to produce some visuals that we were genuinely excited about. Seeing these first visualisations emerge from the raw data was encouraging, as it felt like the project was finally beginning to take shape beyond the technical setup and into something with a stronger visual identity.

Categories
Advanced and Experimental with Serra

Week 16

This week we explored Reality Capture in Unreal Engine using Reality Scan. We began the session by selecting an object to record, and Serra gave us advice on how to achieve the best results. She stressed the importance of capturing footage slowly, ensuring all angles were covered and avoiding reflective or shiny objects, as these tend to confuse the software. I decided to scan my headphones, and after processing the footage we imported the model into Unreal, cleaned up the mesh and applied textures. Serra also demonstrated how the recorded object could be imported as a point cloud, which I found particularly interesting. Seeing the object represented as thousands of points immediately made me think about the possibility of animating point cloud values to create abstract and dynamic visuals.

Although I enjoyed the process, the workshop confirmed that photogrammetry is probably not something I would pursue extensively. I enjoy modelling assets from scratch, and I found the process of cleaning and correcting scans to be time-consuming and often inaccurate. While the technology is impressive, I personally prefer the control and precision that traditional modelling offers. However, I could still see potential for using point clouds and imperfect scans creatively rather than striving for realism.

Outside of the workshop, my group began developing the technical side of our project. Having previously experimented with MediaPipe during a TouchDesigner workshop, I spent some time brushing up on it before introducing it to the rest of the team. Once we were able to successfully track body motion, we started discussing which parameters would form the basis of our prediction algorithms and visualisations. We eventually settled on tracking hip, wrist and shoulder positions. By feeding this data into the system, we were able to generate a line graph representing changes in movement over time. Reaching this stage felt like an important milestone, as it marked the completion of the first technical stage of the project and gave us a foundation to build more complex visualisations from.

Categories
Advanced and Experimental with Serra

Week 15

This week we had a short but enjoyable workshop exploring 360° video production in Unreal Engine using Off World Live. Using environments downloaded from Fab, we learned how to render equirectangular 360° videos directly from Unreal before encoding the output in Adobe Media Encoder. Although the process itself was relatively straightforward, it was interesting to see how quickly immersive content could be produced using real-time workflows. The session also gave me a better understanding of the technical pipeline involved in creating 360° experiences, which I found particularly relevant given my interest in immersive storytelling.

After becoming familiar with the workflow, I spent some time experimenting with different scenes and camera positions. Seeing the results in a 360° format highlighted how different spatial composition becomes when there is no fixed frame. It also reinforced some of the ideas I have been exploring in my thesis regarding directing attention within immersive environments. Despite being a relatively short workshop, it was one of the more enjoyable sessions due to how quickly we were able to move from setup to final output.

Our group also used the opportunity to further discuss our project. By this stage, we had begun settling on the narrative we wanted to communicate and started dividing the production into different stages. This helped us establish a clearer structure for the project and think about how the different screens and visual elements would interact with one another. Having a more defined narrative allowed us to begin planning the screen layout and think more carefully about how the audience would experience the progression of the video.

Screen Layout and Transition Plans

Categories
Advanced and Experimental with Nigel

Week 15

This week consisted of online tutorial slots and support for the next stage of the thesis proposal. As I had already received detailed feedback on my literature review during an earlier tutorial, I did not require another dedicated feedback session. Instead, I used the time to continue developing my proposal and refining my research question.

At this stage, I was becoming more confident in the direction of my research. I continued reading literature relating to immersive storytelling, viewer attention and 360° film while refining the scope of the project. One challenge was finding research specifically focused on 360° animation, as most of the available literature focused on virtual reality and live-action immersive experiences. This encouraged me to broaden my search and investigate related areas such as one-shot filmmaking and visual attention studies.

The session reinforced the importance of independent research. Rather than looking for a single source that answered my question directly, I began combining ideas from multiple fields to build a framework for my own investigation.