Research, Design, Prototyping
Arduino, Processing, Rhino, fabrication tools
Myself
Feb 2015 - June 2015, Dec 2016
By spinning the wooden toys, the player correlates the physical and tangible space with virtual 3D models in the computer.
Although millennials first began learning by playing in the physical space before digital simulations, many of the "digital natives" nowadays are learning through the screen displays ever since they are toddlers: educational products nowadays are increasingly built as Apps and delivered through laptops and tablets, and children spending more time on mastering iPad games.
Adults gradually loose sight of their learning and understanding of physical space. For example, the study of shapes and volume is now relying largely on flat screens, touch pads, and computer mice, which are two-dimensional control devices that lack any meaningful tactile feedback. Therefore, children's understanding of geometry is hindered if they don't connect what's displayed on screen with what's happening physically.
As smartphones and tablets become more accessible, toy companies are increasingly migrating to digital platforms, creating a "virtual body" of their iconic physical products (Barbie, for example).
Software company also see the connected digital devices (smartphones, tablets, laptops, etc) as both fast and efficient medium to deliver their digital products, making digital games and apps seem like the ideal mode of "the future of education".
In the attempt to shift the singular mode of touch screen interaction, a number of products have emerged in the past few years. For example, LEGO Fusion allows the players to use iPad to record the front view of the house that they built with lego bricks, and turn it into a virtual 3D object. The virtual object can then be placed within the iPad app and facilitate story telling. Doodle3D is an application that works the other way around: it takes the 2D doodles of the kids as input, and digitally transform the drawing into a 3D model that can be printed through a 3D printer.
However, in both examples, the analog play and the digital creation are divided into separate stages: in LEGO fusion, the player has to exit the construction mode in order to engage in the digital story telling; in Doodle3D, the player draw and manipulate the sketch in a 2D interface, and then passively watch or wait for the 3D printer to complete the fabrication. Both example lack are short of meaningful connection between digital and analog interactions.
I was very inspired by the traditional wood toy blocks chained through curly wire, which the children can spin with finger tips. When the wooden blocks are spinning, they create the illusion of unique 3D volumes. What if, when the wood shapes are spinning, we can track their movement? What if we recreate this 3D volume in the digital space? Because the temporary silhouettes of spinning blocks become 3D models in real time, children can better correlate these 3D shapes with their tangible experience.
I brainstormed a few different designs for the technical hardware that could make the physical-to-digital interaction possible. I first thought of setting digital pins inside cylindrical spindles, but for the need of mechanical strength and limitation of manufacturing capability, I migrated to the idea of using (hacking) existing USB 3.0 ports as connectors.
The formal attributes of toy blocks - such as color, shape and orientation - will produce different computer-generated 3D models. Therefore, I created a series of 3D models in Rhino to visualize how these different geometries interact with space. Based on these 3D renderings and possibilities of user manipulations, I started to design the actually digital interface.
The hardware prototype includes two key components: the connectors that identify different ports of the wood toys, and the motion sensor that tracks the rotation after a wood toy is connected to the main device
I altered the USB 3.0 ports by connecting selected pins to ground, and leaving other pins to pull-up resistors, thus customizing an array of binary values. Those binary arrays informs the graphical interface which shapes and orientations to display. A gyroscope is attached to the main device and functions as motion sensor.