Skip to main content

Self-levitating displays: Mid-air virtual objects

An interactive swarm of flying 3D pixels (voxels) developed at Queen's University's Human Media Lab is set to revolutionize the way people interact with virtual reality. The system, called BitDrones, allows users to explore virtual 3D information by interacting with physical self-levit






Queen's professor Roel Vertegaal and his students are unveiling the BitDrones system on Monday, Nov. 9 at the ACM Symposium on User Interface Software and Technology in Charlotte, North Carolina. BitDrones is the first step towards creating interactive self-levitating programmable matter -- materials capable of changing their 3D shape in a programmable fashion -- using swarms of nano quadcopters. The work highlights many possible applications for the new technology, including real-reality 3D modeling, gaming, molecular modeling, medical imaging, robotics and online information visualization.
"BitDrones brings flying programmable matter, such as featured in the futuristic Disney movie Big Hero 6, closer to reality," says Dr. Vertegaal. "It is a first step towards allowing people to interact with virtual 3D objects as real physical objects."
Dr. Vertegaal and his team at the Human Media Lab created three types of BitDrones, each representing self-levitating displays of distinct resolutions. "PixelDrones" are equipped with one LED and a small dot matrix display. "ShapeDrones" are augmented with a light-weight mesh and a 3D printed geometric frame, and serve as building blocks for complex 3D models. "DisplayDrones" are fitted with a curved flexible high resolution touchscreen, a forward-facing video camera and Android smartphone board. All three BitDrone types are equipped with reflective markers, allowing them to be individually tracked and positioned in real time via motion capture technology. The system also tracks the user's hand motion and touch, allowing users to manipulate the voxels in space.
"We call this a Real Reality interface rather than a Virtual Reality interface. This is what distinguishes it from technologies such as Microsoft HoloLens and the Oculus Rift: you can actually touch these pixels, and see them without a headset," says Dr. Vertegaal.
Dr. Vertegaal and his team describe a number of possible applications for this technology. In one scenario, users could physically explore a file folder by touching the folder's associated PixelDrone. When the folder opens, its contents are shown by other PixelDrones flying in a horizontal wheel below it. Files in this wheel are browsed by physically swiping drones to the left or right.




Users would also be able to manipulate ShapeDrones to serve as building blocks for a real-time 3D model. Finally, the BitDrone system will allow for remote telepresence by allowing users to appear locally through a DisplayDrone with Skype. The DisplayDrone would be capable of automatically tracking and replicating all of the remote user's head movements, allowing a remote user to virtually inspect a location and making it easier for the local user to understand the remote user's actions.
While their system currently only supports dozens of comparatively large 2.5" -- 5" sized drones, the team at the Human Media Lab are working to scale up their system to support thousands of drones. These future drones would measure no more than a half inch in size, allowing users to render more seamless, high resolution programmable matter.
Story Source:
The above post is reprinted from materials provided by Queen's University.




Comments

Popular posts from this blog

AQUA TEK S – the first waterproof, ruggedized, solar-powered battery case for iPhone

If you're hoping to attract investors to get yet another iPhone case to an already crowded market, it had better do more than just protect a phone from bumps and scrapes. Snow Lizard Products is giving itself the best possible chance of raising funds for its new AQUA TEK S case for  iPhone 4  and  4S  with an offering that not only boasts ruggedized protection, but also includes a solar panel, built in battery, and is waterproof up to 20 ft (6 m). Aimed at outdoorsy types who want to stay connected when heading off the beaten track, the case features a waterproof and dirt resistant poly-carbonate ruggedized casing that packs its own built-in battery to extend the life of the the iPhone. The company is still investigating the best battery to fit the form factor so the capacity of the unit hasn't yet been finalized, but it will be able to recharge from the power of the Sun via the solar panel built into the rear of the case. The encased iPhone can also be recharg...

DoubleBack adds a sliding pod to VW's Transporter van

It was over thirty years ago that Volkswagen first started offering "pop tops" on its camper vans. In the years since, the soft-sided interior height-extenders have become a common sight on VW vans parked in campgrounds all over the world. Now, Welsh company Overlander Motorhomes is offering what it sees as the logical compliment to the pop top - it's the DoubleBack, a sliding insulated pod that extends the interior length of Volkwagen's T5 Transporter van.    The company starts with a stock 2.0TDI 140PS Long Wheelbase T5 van, then adds its patented DoubleBack pod package. When on the road, the pod stays tucked up inside the back of the vehicle. Once the driver stops and decides they'd like to settle down someplace, however, it electrically extends out of the rear in under 45 seconds, adding approximately two meters (6.5 feet) of useable interior space. Two legs also fold out from the bottom of the pod, which allow it to support up 600 kilograms (1,323 l...

Nanogenerator that harnesses energy from tires friction

Engineers from the  University of Wisconsin-Madison  along with a collaborator from China have created a new nanogenerator that harnesses energy from the friction caused by rolling tires. Xudong Wang has developed a new way to harvest energy from rolling tires (Credit: The College of Engineering) As a novel energy reusing method, the nanogenerator could be potentially used by auto-mobile manufacturers to improve the efficiency of their vehicles. The first of its kind, nanogenerator was published in the Nano Energy journal. The research was carried out by Xudong Wang, the Harvey D. Spangler fellow and an associate professor of materials science and engineering at UW-Madison, and his PhD student Yanchao Mao for about one year. Based on the triboelectric effect, the nanogenerator can harness energy resulting from the electric potential created between a vehicle's wheels and the pavement. The triboelectric effect is the electric charge generated due to the rubbing...