Skip to main content

Self-levitating displays: Mid-air virtual objects

An interactive swarm of flying 3D pixels (voxels) developed at Queen's University's Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levit






Queen's professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter -- materials capable of changing their 3D shape in a programmable fashion -- using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
"BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality," says Dr. Vertegaal. "It is a first step towards allowing people to interact with virtual 3D objects as real physical objects."
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. "PixelDrones" are equipped with one LED and a small dot matrix display. "ShapeDrones" are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. "DisplayDrones" are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user's hand motion and touch, allowing users to manipulate the voxels in space.
"We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset," says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder's associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.




Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user's head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user's actions.
While their system currently only supports dozens of comparatively large 2.5" -- 5" sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
Story Source:
The above post is reprinted from materials provided by Queen's University.




Comments

Popular posts from this blog

10 URLs to Find Out What Google Knows About You

Google is much more than just a search giant. It is also home to many of your favorite products: Gmail, YouTube, and Chrome, just to name a few. Apart from that, it also offers many products to help you  keep track of your data . Most of these are  hidden deep  inside the My Account dashboard, which many users don’t really know of. These hidden tools  may reveal interesting details  about your usage of Google’s many services. We’ve compiled a list of important Google URLs of some  hidden tools  that carry information of what you did with Google, mostly from the searches that you have made on their many products, the voice searches and typed out Google searches that you have made. Are you ready to  find out what how Google knows about you ? 1.  Google Dashboard Google Dashboard offers  transparency and control over the personal data stored with your Google Account. You can  view  and  manage the data gener...

Edible water balloons that could get rid of the need for plastic bottles

In case you didn’t know, bottled water is destroying the planet. We know that we need to be drinking plenty of water. It’s important. But the plastic bottles they’re sold in are terrible for the environment. One solution is using reusable bottles that you can fill from any nearby taps instead of buying a new bottle each time. Another solution is much more exciting. A group of engineers from Skipping Rocks Lab have developed a wonderful thing called The Ooho!. It’s a globe filled water that you can pop in your mouth whole. The outer shell is made of algae, so it’s edible and biodegradable. Meaning there’s no need for packaging or plastic – the globes of water are self-contained and ready to consume. Exciting, right? Plus they’re wobbly and they look cool, which is always a bonus. The team have now created a crowdfunding page to make their creation available to the public, with goals of selling The Ooho! at festival and marathons within the next 12 m...

Casio PicapiCamera iPhone app is the world's first to use visible light communication technology

PicapiCamera, developed by Casio, is the world's first iPhone app which uses visible light communication technology. To send and receive data via the app, the message to be sent is encoded using red, green and blue flashing lights and shown on the display. The receiver points their iPhone at the flashing lights and the data is transferred. "There are two approaches to communication using visible light. One is to embed data in the light from illumination sources, by turning it on and off at high speed, as a natural way of communicating information. With that approach, devices use photodiodes. The other approach involves image sensors. A device that captures light is a camera, so the idea is to relate light obtained by a camera to information. We're using the camera approach - visible light communication through image sensors." "When exchanging addresses, this system can send addresses to up to five people, rather than just one-to-one." "If yo...