Skip to main content

Hand-manipulated objects and transparent displays - the computer desktop of tomorrow




A see-through screen, digital 3D objects manipulated by hand, perspective adjustments according to the user's viewing angle - these are the core features of a prototype computer desktop user interface created by Microsoft's Applied Sciences Group. The prototype uses a "unique" Samsung transparent OLED display through which the user can see their own hands to manipulate 3D objects which appear to be behind the screen.
A demo video appears to show a working prototype of a computer markedly different from those we use today. Yes it includes a familiar keyboard and trackpad - but these are placed behind the OLED display. The user simply lifts their hands from these input devices to manipulate on-screen (or more accurately behind-screen) objects, such as selecting a file or window.
The video shows the interface in action with a series of program windows stacked behind one another, with the user selecting the desired program by hand, using the depth of the workspace.
Similar actions are shown to manipulate 3D objects - an exciting prospect not only for gamers, but perhaps also for architects, inventors and engineers working on 3D models. The cherry on the muffin in this respect is the inclusion of head-tracking technology - step to the side to shift your angle of view and your view of the 3D objects on screen will be altered accordingly.
The video certainly poses questions as to the future of human-computer interaction - not necessarily all intentional. Non-touch typists may balk at the idea of a keyboard positioned behind a busy screen (the display may be transparent - that's not to say the information it displays is). Similarly, objects arranged behind one another will necessarily impede view.
But to quibble at the details is rather to miss the point. "This project advances research in current display technologies hoping to provide a more interaction with everyday desktop computing of the future," said Cati Boulanger, a researcher at the Applied Sciences Group. Even with a working prototype, this is a technological what if, not a thou shalt.

Comments

Popular posts from this blog

Solar car hits U.S. in round-the-world jaunt

Last October, the SolarWorld GT solar-powered car set out from Darwin, Australia on a drive around the world. It has since driven 3,001 kilometers (1,865 miles) across Australia, logged 1,947 km (1,210 miles) crossing New Zealand and been shipped across the Pacific Ocean. This Friday, it will embark on the U.S. leg of its journey, as it sets out across America from the University of California, Santa Barbara.   The SolarWorld GT is the result of a collaboration between solar panel manufacturer SolarWorld, and Bochum University of Applied Sciences in Germany. The four-wheeled, two-door, two-seat car gathers solar energy through photovoltaic panels built into its roof, with its solar generator offering a peak performance of 823 watts. Custom hub motors are located in both of the front wheels. The vehicle manages an average speed of 50 km/h (31 mph), with a claimed top speed of 100 km/h (62 mph). In order to demonstrate that solar powered cars needn't be a radical...

Biocomputer, Alternative To Quantum Computers

A team of international scientists from Canada, the U.K., Germany, the Netherlands and Sweden announced Friday that they had developed a model biological supercomputer capable of solving complex mathematical problems using far less energy than standard electronic supercomputers. The model “biocomputer,” which is roughly the size of a book, is powered by Adenosine triphosphate (ATP) — dubbed the “molecular unit of currency.” According to description of the device, published in the  Proceedings of the National Academy of Sciences , the biocomputer uses proteins present in all living cells to function. It uses a strategy similar to that of quantum computers, which use qubits — the quantum computing equivalents of bits — to perform “parallel computation,” wherein  computers are able to process information quickly and accurately by performing several calculations simultaneously, rather than sequentially. In the case of the biocomputer, the qubits are replaced with ...

Qualcomm showcases the Snapdragon S4 ahead of Mobile World Congress

We’ve already heard about Qualcomm’s latest processor, the Snapdragon S4 , which will be quad-core and utilize LTE. Qualcomm took the time to give us some details ahead of Mobile World Congress. The new SoC now supports up to three cameras (two in the back for 3D and one front-facing), 20-megapixels, and recording video at 1080p (30fps). We can also expect zero shutter lag, 3A processing (autofocus, auto exposure and auto white balance), and improved blink/smile detection, gaze estimation, range finding and image stabilization. Last but not least, it supports gesture detection/control, augmented reality , and computer vision (via Qualcomm’s FastCV). Hit the break for a couple of videos featuring image stabilization and gestures.