One Universe at Different Times_Progress Update

Our inspiration:

  1. Einstein’s Dream:
    Multiple Universes Parallel / Intersect at Different Time

  2. Multiple Intersecting Universes:
    create multiple layers to represent multiple universes within each other different levels of layer with different transparency..
    inspired by Takahiro Kurashima

Working Progress:

  1. One Universe at Different Times
    Working with three.js

2. Combine ideas with zoetrop
Transfer to A-Frame

Next Step: Build another storyline from another perspective:

  1. Peak behind one of the face & discover something new
  2. Go forward to one of the face & the face react back to user
  3. Look at the face at different angles – user discovers its nuances, familiar yet different

Week 4_vision of future storytelling

How human communications needs will combine with emerging technologies to change the media landscape in the near future?

synchronization in time and space
Human communication takes forms of either person-to-person individual information exchange, including chatting or giving a talking to, or broadcasting-like one-to-all information conveying and sharing, such as mass media and storytelling. Both forms require two types of vicinity: temporal synchronization and spatial locality.

temporal synchronization
The first category of vicinity, temporal synchronization has been widely addressed throughout the history of technological development: besides talking face to face, the mailing system is the most primitive technology the human kind uses to communicate with others. Development of this technology experienced the period of using human power, animals (including horses and pigeons), to machineries (such as cars and planes). Those technologies largely reduce the delay in temporal synchronization among human communication. Sophisticated mailing systems makes it possible to handle large communication throughput, such as the well designed logistic algorithms and protocols. On the other side of the horizon, broadcasting media-based communication or storytelling starts with the spread of rumors, hanging of posters, printing of newspapers. Those technologies of communication are also largely dependent on means of transportations such as delivery by human, car, or plane. With the approach of Electric Age, both forms of communication got accelerated to further satisfy our need for temporal synchronization: telephones firstly made live communication over large distances possible. It started with landline phones and developed to cell phones, shortened the communication delay from spending the time to reach a land line to picking up a phone right away. Telegraph makes media storytelling faster as well. News and stories happening all over the global could be broadcast by radio wave and shared with people on the other side of the world via printing media. The advent of information age completely eliminated the communication delay and enables absolute temporal synchronization. People use FaceTime to talk to people on the fly. Internet websites can publish and share events and stories at the first second. Medias such as Instagram and Facebook even makes individual live storytelling possible by all the live video sharing functionalities. Technologies have confidently satisfied our communication needs on temporal synchronization.

On the other hand, the spatial locality has not been well tackled, despite our ardent desire for it. With telephone, people are far from being located in the same space when communicating with each other. The invention of camera gives mass media a chance to sort of bring the space where the event or story happened into the audience by a 2 dimensional projection of the space printed on a plane: photographs. Video recorders and TVs added another dimension to the projection: time, which is, however, far from realistic. People also uses sound to improve the lower-dimensional replica, in order to approximate spatial locality. An emerging technology, Virtual Reality, is one significant step further to realize true spatial locality. The 360-degree view created by VR plus head and gaze tracking has brought our pursuit for spatial locality during communication into a whole new level: people can talk to their friends using VR, just as if the friend were sitting next to him/her. Media could broadcast breaking news of stories by project the whole scene to their audiences via VR. These could be easily implemented in the near future by this emerging technology.

Although the current VR technologies allow the deception of our eyes and ears, other senses could also be satisfied potentially by the next level of VR: haptic, smell, taste, etc. The satisfaction of these senses will further increase the fidelity of our simulated spatial locality. These are the next level of Virtual Reality we could use in our communication of either forms, and a pseudo-trueness of the temporal and spatial vicinity could be achieved at the same time. However, pseudo is after all pseudo. The boldest vision of human kind to achieve spatial locality during human communication with absolute fidelity is teleportation. Only with means of teleportation can people communicate with each other over large distances within the same space. We could talk to a friend after we are teleported to them. Media could tell their stories by teleport their audiences to the space where the story is actually happening. Teleportation is far from emerging technologies, but one of the drives behind the research toward it would also be our communication needs for spatial locality.


This week, me and Alan began the project by scanning 3D models of ourselves. And, we took a video on both of us of sneezing. Later, we used slow motion to capture each frame and convert each motion into a panoramas.

Right now, we successfully import the panoramas with my 3D scanned object into the environment.

Next, we tried to connect the environment with Kinect and Kinectron. The code seems to grab the data from Kinect successfully; however, there’s nothing happen….


Week 3_ideas of the storylines

For this week, me and Alan had conversations about the ideas of how to intersect multiple stories in different spaces. We were inspired by the book, Einstein’s Dream, about the spaces that exist in different time. How can we bridge multiple time zones together and tell a story? This is the discussion that we have been discussing over the week. We decide to start brainstorming for final project and break down our working process starting from this week.

And, we came up with some ideas:

  1. Two Spaces Intersecting in Different Time
    We were thinking to shoot a 360 video at a public place, such as a coffee shot. The video captures the space at a fixed angle for couple hours. And, bring in a 3D model while working in three.js and set a focal point on a chair and table. The idea is just create a spot light for this location and bring audience attention of what to see and also show the time at the coffee shop. We were thinking even layering another video footage of a person interacting with the video that we shot at the coffee shop. So, a person sitting on a chair (laying with a 3D model chair) and the person from another video is placed on another chair that at the same table working independently.
  2. Two Spaces Laying on Top of Each Other in Different Time
    To extend the idea from the previous one; instead, we change the composition of the videos. For example, a second video is placed outside the first video. The camera is placing at the center of the two videos so when the inner video have lower transparency, the audience can see the outer video (second one).
  3. Alan Sneezing
    So, we thought if we 3D scan Alan’s head and duplicates to min 4 heads and place them into a circle all facing toward the center. Each head’s facial expression captures Alan’s sneezing moment starting from the beginning to after sneezing. And, when the camera turns to the last head (when the sneeze happens), something pop up and throw to the camera.

Week1_Future Storytelling

I was having conversations with one of my friend the other day about the format of videos that we are seeing and people are exploring nowadays. The media had developed from 2D, 3D and even now 4D, computer graphics, and virtual experiences. So, the format of storytelling has transformed to a non-traditional way.

We found a group of artists called AES+F, they are a group of artists create non-linear story but at the same time is super hyperrealistic and strange. It somehow contains the aesthetic of those ancient paintings. The video like this is another way of storytelling which does not have a clear storyline but somehow contains message behind. On the one hand, this video is somehow challenging people’s aesthetic, and their societal perceptions, as well as their understanding of the purpose behind the videos.