MoCap – Week 5

This week we experimented with the perception neuron kit. We started out by assessing each component to the correct part of the body, then connecting the parts in series and ending by putting all the chips necessary.

We then connected to our local router and checked to see if all the body parts where working correctly.

Once everything was in order we started the calibration process which proved to be a very painful experience since we could not surpass the first stance for more than 30 minutes.

Finally, when we managed to calibrate correctly we tried to live feed through Unreal Engine. There was a problem again and we got disconnected and no feed was broadcasting.

Overall it felt like the Perception Neuron was not the most reliable source for motion capturing. We will try it out again next time and see if we get a more solid outcome.

Environment Update:

Made some new material by using bit2material software. Snow material for the rocks  and dirty metal for some objects. Working on triggering various lights on several locations.

Animation Characters:

MoCap – Week 4

This week we were assigned to perform a sketch with a small plot that we had to come up with. We came up with the idea of creating two characters that would meet up in a bar set-up scenario and sit down to have a chat and some drinks. After some argument between them, the interaction escalates and the two characters are on for a fight. Some pushing occurs and at the end there is a chase around the table and the chased character is able to escape unharmed.  Second Capture was the Hula dance which Larysa performed.

Also we had the opportunity to enjoy some live action using IKinema.

Not the actual footage but the characters will remain as is: The mechanic and the business man:

MoCap – Week 3

LAB: Data Review + Fix Gaps

For our third lab we have to review our data from one of our recorder MoCap session and correct and fill any gaps that were present as well as assign back to their original position any unassigned markers. Overall our MoCap didn’t present many gaps and was smooth throughout.


The avatar that I chose to create was done in Fuse and featured a Matrix kind of “woman” with abnormal characteristics. Then it was send to Mixamo for some animation moves. I applied the newly created character into my scene to see how it can blend in.






MoCap – Week 2

LAB: Create a skeleton + Animation

For this week’s lab we had to record a 37 point skeleton and play around with it in space in order to use the data for later projects.

We started off by placing all the necessary points for the skeleton to be tracked properly on all 37 points:

Once this process was done properly we moved on to do the tracking routine. Started off as usual with the T-stance and moved on..


First Unreal Scene

The story evolves around a “deserted” planet outside our solar system where things like flying can be considered a basic skill. Two travelers that randomly met up on the planet after having to get transported there for unknown reasons. Their quest begins and strange and interesting things start to happen around them. They soon understand that they have enhanced abilities and the “real” quest begins. The main character will look more on the human side while the second character will be either an object like “human” or some form of dust that emits strange colors as it moves. No names have been assigned up to this point.


MoCap – Week 1

Lab: Calibration and Rigidbody Lab

This week we our first approach into using the MoCap studio and its software. We started by calibrating the cameras:

We wanted to make sure that we stay above or around 10,000 samples per camera.

Next, we assigned four rigid bodies and moved around to see if the tracking was accurate and consistent.


I was always fascinated on how the motion capture works and the possibilities it can offer in order to create something beautiful that can relate people with technology. During this course I’m envisioning of learning how to create such beautiful worlds and being able to expand my knowledge in what is possible and what not while creating experiences through motion capture.

Setting up my moodboard, I realized that I’m more keen in combining art and movement in order to create a semi real world where people could transform into other forms of existence. It would be nice if we could combine music and movement in order to transform into different “worlds” and “bodies”.



Is a project based on fabricating an enclosed box in the shape of a theatre which will consist of psychedelic and illusions elements.

The Box will be made out of wood and then painted in hippie, psychedelic colors. On the front there will be a big circular 3D printed circle which will consist of illusion patterns in the colors of black and white made out of acrylic. The circle will be mounted on to a motor that will continuously spin it. There will be a potentiometer attached in order to adjust the speed of the motor and thus the illusion circle. Next to the main circle on both sides there will be smaller circles that will be connected through gears and will as well turn simultaneously. On top of the box, a sign, carved in the lasercutter will read PsychoCircus and it will be painted accordingly to the theme. Lastly there will be a switch to turn on/off the motor. Everything is going to be controlled by an Arduino micro-controller.

  1. Designing the layout of the front view on illustrator:

2) Prototyping with Cardboard:

3) Testing to see how the gears will fall in place and how they will react.

4) Fabricating the enclosure for the spinning wheels.

5) Fabricating the spinning wheels made from acrylic and orienting them       in order to match up.

6) LaserCut “Psychocircus” lettering and assemble gears and spinning            wheels. Making sure to spray paint all wooden parts black.


Directing VR

Photo Roman:


Cut of another students’ 1 minute of footage:


“Recreate a Scene”:


Tiltbrush experiment:


Presentation with Ashley:


The presentation can be found on the below link:

Final Project:

Below is a presentation and first idea of the final project:





For our puzzle assignment Sejo and I teamed up and came up with the idea of making a “PuzzleSphere”. The concept is to create several puzzle pieces shaped into different interlocking styles and then have each one of them connect to their corresponding puzzle piece/pieces, while all of the assembly will take place inside a sphere. The correct order in which the pieces will interlock to one another is essential.

We tried to prototype early with some cardboard and see how the pieces will behave to one another, while also test different ways of interlocking.

Some of the pieces and their shapes we used are seen below:

We then tried to assemble each puzzle piece to their corresponding piece/pieces:

The rough idea of what we want to create can be seen by the 3D model created on Rhino. It doesn’t reflect the actual puzzles pieces seen here yet but its our first approach to developing the PuzzleSphere.

How the Pieces (Wood-Lasercut) and Sphere (3D Printed) came out + assembly + end result:




Solar Powered Charging Station

For my final project I would like to engage in a solar powered charging station that could provide an output of a usb slot made for devices to power up.

The initial idea is to be able to have a solar panel that could automatically position it self according to where the sun is facing at any given moment. Its rotation should be done on the Y-axis as well as the X-axis.

What will be needed at a first glance:

– Arduino Uno
– Solar panel
– Servo
– Light Detecting Resistors
– Wooden/Acrylic Box (Laser Cut)
– USB output

The first step was to determine its part that its going to be used individually in order to see if everything works as it should:

Some testing with the servo motor:

Some testing with the Light Detecting Sensors:

Combining the Servo with the Light Detecting Sensors:

Having successfully operated the sensors with the servos the next step is to start building the enclosure for the Arduino and the electrical components as well as the structure for the panel and servos to operate:

The initial testing is being done with cardboard in order to ensure that everything can work proportionally and mechanically correct before proceeding to wood and acrylic.

The next step is to finalize the design and make sure that everything fits together properly.

Lasercutting the necessary pieces to form the structure of the solar panel:

Checking various pieces to see how they fit together:

Testing for Voltage and Amps:

The problem is that the battery produced around 2V which is not enough to power the Arduino board and run it. The o.43 Amps that the motors and sensors with the Arduino produced where a positive sign.

Finally some testing was done to see how the sensors reacted to the light and how they could accurately track it. There is difference in the behavior of the sensors when there is more light around them rather than having them in a darker room with direct light focusing on the sensors only.


Draw Your Self in a Movie Poster Robot

Our group has had an incredible journey piecing together our robot together over the last 6 weeks. After building the CNC machine from scratch, we had to develop an idea that changed the nature of the CNC and used it in a completely new way than what was intended by it’s creators.
Concept: Create a robot that take a picture of the user, and then draw that user’s face as a character on a movie poster.

Our team had various design challenges we had to overcome. Some of the considerations we had to think about included:

  • Designing a method by which to hold a writing utensil. This is important as we needed the unit to flex just enough to provide a natural artistic stroke to the robotic gantry.
  • Designing the CNC bed to provide ample support, pressure and texture to the pen from above.
  • Determining the proper writing utensil
  • Converting an image from it’s original format to SVG, making it Black and White, then editing it so that the image is only composed of outlines.
  • Making sure the camera recognizes the user’s face
  • Determining where to place the cropped and converted image of a user’s face into the appropriate area on the movie poster

Method to Hold the Pen

We experimented with various types of ways to hold the pen using the original router holder. We ended up designing our own plate and 3D printing our pen holders for maximum flexibility and precision.

Designing the CNC Bed

We wanted to provide the proper surface for the pen to write on the bed. We created a bed out of acrylic, to make sure that the holes were covered. We then placed a thin sheet of foam and thicker poster paper on top to provide a firm, cushy and smooth surface to put paper on so the pen would easily glide while drawing.


Deciding the Proper Writing Utensil

We tested with various types of pens and markers. The way our machine is set up, it made the marker lines way too thick, so we opted to go with a ball-point pen, as it easily glides along the paper.



Computer Vision, Image Conversion and Process Flow

Our process flow is the following:


Select movie poster. Title it ‘poster.jpg’

Take image of user


Python script detects the user face on the movie posters

Select the face you want to swap with and swap faces


Convert File to Black and White & SVG


1) Refine and stabilize the pen plotter so that the pen is more secure

2) Draw a complex image and figure out file convesions from PNG to SVG

3) Experiment with various pens/markers
One thing we were impressed by was the level of precisions of the pen. Below you can see how precise fhe pen is.

We were impressed by the level of precision by the pen. If you can see below, the lines are incredily close together. We chose the dog image for it’s relative simplicity and then the following image of the girl to see if we could draw something thatbhad a few layers in the outline. The girl image took roughly 15-20 minutes to complete, so we can expect the movie poster to take that long.

We need to figure out if we can use the Gcode to speed upthe drawing process.


We got our robot drawing! We had to mess around with the wiring a bit, but we now have the robot drawing.

​​The Pen Plotter

We 3D printed the pen holder with 2 holes for the screw mounts.

As we tested this layout, it was way to flimsy. It kept turning and becoming misaligned.

We then decided to create a backplate to prevent the twisiting and turned due to the ACME screw. This is to make sure the pen is stable enough for drawing.

We took the measurements from the steel plate and laser cut a new one with various holes for adjustment purposes. This set up works ideally for what we want to do.


We also lser cut a board that matched up with the screw holes on the base. This was to make sure that the surface was completely flat for drawing. 4 out of 6 of our holes were off, but that does not affect the positioning of the base plate as it’s held in place pretty firmly.


Some of the successful attempts from our Robot as well as some attempts to transfer a self portrait into a movie poster and then into an Svg file for the CNC machine to draw: