Beyond Binary

Microsoft will give those at next week's Professional Developer Conference a chance to do more than just write software for the Surface. They'll also have the opportunity to buy a developer version of the machine.

The good news is that PDC attendees will get a 10 percent discount. However, the bad news is the machine will set them back $13,500 even with the discount.

Microsoft's Mark Bolger demonstrates the Surface's multitouch user interface.

(Credit: Ina Fried/CNET News.com)

The cost for developers is higher because it includes five software developer kit licenses. However, even commercial customers are paying $12,500 for the Surface. That's above the $5,000 to $10,000 initial cost that Microsoft said to expect when it announced the Surface back in May 2007.

"We're not far off from our initial target," Surface computing unit general manager Brad Carpenter said in an interview on Thursday, "but we would like to get the price down. Over time, with economies of scale and (higher sales volume), the prices will go down."

Its price tag was among the reasons that Robbie Bach, Microsoft's entertainment division president, thought about killing the Surface as a commercial product, although it survived with Bill Gates as a strong backer of the effort.

Still, even if they can't afford one, developers will get plenty of face time with the Surface at PDC. There's a session on developing for the Surface as well as three hands-on labs.

As first noted by CNET News, developers at the PDC will be the first to get their hands on a new software developer kit for the Surface. Microsoft had been limiting developer access to a handful of pre-selected partners.

Not all of the 6,000 developers at the show will be able to get the newly-available software developer kit, Carpenter said. Microsoft is capping things at about 1,200, but that should cover at least all those who attend one of the sessions, he said.

Microsoft is also planning a "scavenger hunt" at PDC, where developers can place a special tag on each of the 16 Surface units scattered throughout the show. Even though the number of Surface machines in commercial use is low, Carpenter said that now is the time to get a broader range of developers writing programs for the product.

"We believe the opportunities are endless," Carpenter said. "By reaching out to the developer community at PDC, we want to tap into their innovation, their creativity."

Microsoft also will talk at the show about the overlap between developing for Surface and developing multitouch applications for Windows. Windows 7 will support multitouch gestures, though there will be some divergence between the Windows 7 and Surface implementations.

The developer paths will converge more with Windows Presentation Foundation version 4, "which will be a little after Windows 7," Carpenter said.

Bill Gates may not be hanging around Microsoft's research labs 24/7, but his vision for going beyond the mouse and keyboard seems to be doing pretty well without his day-to-day oversight.

At a user interface conference this week, the software maker plans to present several research papers, including a number designed to take the multitouch interface used in Microsoft's Surface and expand it into new arenas.

Although Microsoft's tabletop computer is still in the midst of its earliest commercial deployments, the company is already hard at work trying to figure out where the technology can go next.

Andy Wilson, one of the Microsoft researchers who helped create the Surface, is among those presenting at the User Interface Software and Technology conference, which is being held in Monterey, Calif. He is set to talk about how the same kind of physics engines used in 3D games could help make surface computing much more realistic.

Although multitouch computing is a huge leap forward in making computer objects feel more tangible, the illusion is challenged because all touch is treated the same, unlike in the real world where we can touch lightly, or push, or grab an object.

While a child using Surface for the first time will tend to use his or her whole hand to interact with objects, adults learn to use just a fingertip because they quickly realize that essentially the computer is only recognizing a single point for each "touch."

"The problem with that is you are flushing away a lot of the subtlety," Wilson said.

But, if the physics engines were better, Wilson says, objects can be folded and twisted and even torn like a piece of paper.

"How can we enhance the interaction model so we don't fall into this trap of thinking of every contact as a discrete point?" Wilson said. In his paper, he suggests a few different interactions, showing how a user can grasp a solid object and interact with it (say rolling a ball), or fold or tear an on-screen piece of cloth.

Another team of researchers from Microsoft's Cambridge, England, lab is showing a technique called SecondLight that allows a surface computer to project two images, one on the computer's surface and the other at some other point in the air.

This one's a little harder to explain. Essentially, the surface of the computer is one that quickly alternates between a transparent display and one that catches an image. The projector is in sync with this alternating pattern and sends one image when the display is transparent and a second when it is not. The first image is projected above the device, while the second appears on its surface. Because the images can alternate faster than the eye can detect, both images appear to be constant.

Real-world applications
Among the potential applications for this would be gaming. Clear plastic pieces could sit on top of the game and become chess pieces or checkers or other game tokens as needed. Medical imaging could be another interesting use, where doctors could look at an entire X-ray on the main display and hold up a piece of paper to see a second image, perhaps a close-up or an earlier X-ray.

"We're actually bringing the display into the real world," said Steve Hodges, one of the researchers behind SecondLight.

Such a move also helps break one of the inherent limitations of current surface computing. "It's still bound to the surface," Hodges said. "You are interacting on the surface."

One of the nice things about the SecondLight approach is that although the technology is complex, the objects that interact with the computer can themselves be simple. "All the peripherals are very cheap, either bits of plastic or pieces of paper," said Sharam Izadi, another researcher on the project.

Microsoft is also presenting a round surface computer prototype known as Sphere, which CNET readers got a look at back in July.

Another touch research project is aimed at trying to record gestures without using the screen as the surface. Microsoft already explored one notion, dubbed LucidTouch, in which users could control a screen by moving their hand below the device. Microsoft tries a different approach in its latest project, dubbed SideSight. In this example, the device sits flat on a table, while infrared sensors on the side of the device can record gestures made on either side of the display.

Such alternatives are important for two reasons. One, on very small devices, there is often not enough screen real estate for a touch screen. Secondly, by their nature, the very thing being pointed at is blocked while someone is touching it, hampering the ability to be precise. Both LucidTouch and SideSight are aimed at, quite literally, getting around these issues.

"Across Microsoft Research, in different parts of the world, there's a strong theme of finding new ways of interacting," Hodges said. "These projects all relate and overlap at the edges."

Microsoft's Mark Bolger demonstrates the Surface's multitouch user interface.

(Credit: Ina Fried/CNET News.com)

The long-awaited software developer kit for the Surface tabletop computer will be made available to those attending Microsoft's Professional Developer Conference at the end of the month.

Microsoft made that pledge on its PDC Web site, as part of a listing for a session focused on writing Surface applications.

"Hear about the unique attributes of Microsoft Surface computing, dive into vision-based object recognition and core controls like ScatterView, and learn how the Surface SDK aligns with the multitouch developer roadmap for Windows 7," Microsoft said, in promoting the session. "Attendees will receive access to the Microsoft Surface SDK."

Microsoft has been promising for some time to open up Surface development beyond the select group of companies that have been working with early launch partners such as AT&T and Starwood hotels.

The company has also promised multitouch will be a part of the Windows 7 interface, but has yet to detail how that will work.

REDMOND, Wash.--When it comes down to it, Microsoft's Sphere really is kind of like taking the Surface computer notion and squishing it into a giant ball.

"The basic design is really quite simple," Microsoft researcher Andy Wilson told CNET News in an interview last week. Like the tabletop Surface computer introduced last year, Sphere uses a combination of infrared cameras for input and a projector for output to create a multitouch computer. "The camera and the projector share the same optical axis by virtue of mirrors."

Unlike the tabletop, though, Sphere is a ball-shaped display (either 18 inches or 2 feet in diameter) mounted on a pedestal. Its 360-degree display makes it ill-suited to some tasks, but perhaps even better for some types of gaming and mapping uses. At this point, though, it's just a research effort.

As noted Monday, an outside crowd will get its first look at Sphere later Tuesday as Microsoft shows it to academics attending the software maker's annual Faculty Summit here.

Microsoft had pursued the notion of a spherical computer on its own, but concluded that the hardware work was too difficult to do by itself. Instead, it chose to go with technology from another company--Global Imagination--which already had a spherical computer display on the market for things like museum exhibits and marketing displays. Its product, known as Magic Planet, comes in sizes ranging from 16 inches in diameter to one that is 6 feet tall. It's made of an acrylic, specially coated to allow projected images to display clearly.

Although it didn't have to reinvent the, well, sphere, Microsoft did have a lot of work to change the way the software both senses and renders content.

"For one thing there are no straight lines," Wilson said. You don't move an object in a straight line so much as you rotate it around a sphere."

Games, maps, and secret stuff
As for uses, Wilson said that while a sphere is impractical for many things, it does have some neat characteristics that make it well-suited to certain tasks. For one thing, many people can view and interact with a sphere-shaped computer, each having a different, but equally valid view.

"There is no privileged view of the Sphere," Wilson said. "If you think about it in terms of multiple simultaneous users, that is an interesting property."

It's also interesting from the perspective that any one person can only see just under half the screen. "You can imagine scenarios that involve gaming would be fun." (Just imagine the board game Battleship, for starters).

Beyond gaming, Wilson said that fact could allow a sphere display to be used for someone to have a public section that others can see, but also a second side, with a "personal stash of stuff."

Indeed, that property might be useful for Wilson himself. His studio is filled with different surface computer designs, only some of which he was really ready to talk about. Still, he was gracious enough to let me in, though he pointed to some interesting prototypes that he said were not quite ready for public consumption.

Other potential uses are videoconferencing and mapping. In one of the Sphere's canned demos, it shows the Sphere rendering a 3D street scene and a user touching the device to start driving through the scene. It's kind of the opposite of being inside a 3D world, since you are viewing it from the outside, but still a very interesting application--interesting enough that Wilson has started talking with the Virtual Earth team about some broader cooperation.

For videoconferencing, Microsoft already has a 360-degree camera, known as RingCam, so a Sphere could provide an interesting display for that as well.

The shape of things to come?
But while he can rattle off several potential uses for such a product, Wilson says it's not that he sees sphere-shaped computers as the next big thing.

"We are interested in this because it has some very unique properties and no one has really explored it at this level before," Wilson said. "There are not product plans for this, of course. This is just one of many efforts to explore different form factors that are sort of a play off the Surface."

And some of the learning Microsoft has done applies to more than just spheres, Wilson said.

"This has been a really fun project and it has got us thinking about other form factors as well," he said. "It's given us confidence in thinking about non-flat surfaces, and redoing the rendering pipeline was one good nugget of technical work that we did."

Sphere got its start, in earnest, about a year ago. Wilson had a demo unit from Global Imagination sitting in his lab when one of his direct reports, researcher Hrvoje Benko, saw it.

"When Benko started, he saw this sitting in the lab...He sort of picked it up and ran with it," Wilson said.

Update:Some folks asked for video, so below is a video from the Seattle Post-Intelligencer. Benko has also put some video up on his Sphere project site. In the latter video, check out the demo of what the infrared camera is seeing, as well as Sphere Pong.)

Microsoft's Andy Wilson shows off the technology behind Sphere, a globe-like surface computer developed by Microsoft Research. A group of academics gathered in Redmond this week will be among the first outside Microsoft to see the technology.

(Credit: Ina Fried/CNET News)

REDMOND, Wash.-- A group of academics will be among the first people outside Microsoft to see Sphere, a spherical surface computer developed by Microsoft Research.

The sphere-shaped, multitouch computer is similar to the tabletop Surface computer that Microsoft announced last year after years in development. This incarnation, however, remains a project within Microsoft Research and the company has no current plans to bring it to market.

The university researchers are at Microsoft as part of its yearly Faculty Summit. Also at the event, Microsoft announced a series of tools for researchers, including a plug-in for Office that lets people embed a Creative Commons license directly into their Word, Excel, and PowerPoint documents.

The software maker also announced a hosted e-Journal service to allow online academic publications and conference proceedings to more easily be published.

As for Sphere, attendees will get to see that starting Tuesday as part of an exhibit hall at the event. However, I had a chance on Friday to sit down with surface computing pioneer Andy Wilson, who showed me some of the technology powering Sphere, which was developed in large part by Wilson's colleague, Hrvoje Benko.

Sphere shares much in common with the tabletop Surface that is now being used in places like AT&T retail stores. At its core is a projector that beams the "screen" onto a globe-like display. As with Surface, infrared cameras are used to sense input, although the ones in Sphere are less precise than those used in the commercial Surface.

Sphere can run the same kinds of programs as Surface, such as a photo-sharing application in which multiple users can rotate, stretch, and move pictures. Its spherical shape though makes it more practical for some uses, such as gaming and mapping, and less useful for others.

Bill Gates has talked about a vision for surface computing that stretches far beyond the high-end commercial applications of Surface and in several years' time would have many, many of today's surfaces becoming computerized, both at home and at work.

I'll have quite a bit more on Sphere and my visit with Wilson in a follow-up post.

Microsoft user experience designer Russ Burtner tests out TouchWall ahead of Chairman Bill Gates' Wednesday keynote at the CEO Summit. The touch screen, which is approximately 4 feet by 6 feet, is a research prototype.

(Credit: Microsoft)

In his waning days as a full-time employee, Bill Gates is getting a little touchy-feely.

I'm not sure whether Gates is getting more emotional, but he is definitely big on the power of new user interfaces, especially touch-screen devices. On Wednesday, he is set to show off Microsoft's latest prototype, known as TouchWall.

The device to be shown Wednesday is something like a giant Surface unit turned on its side.

TouchWall is one of several multitouch prototypes Microsoft Research has created, in addition to the tabletop unit that Microsoft's Surface group has begun to sell commercially. Among the other devices the company is also reportedly working on is a sphere-shaped device.

Others also have multitouch walls. Multitouch pioneer Jeff Han has begun to sell one, while Hewlett-Packard showed one at last year's "D: All Things Digital" conference.

Han's unit was offered for $100,000 in Niemen Marcus' luxury holiday catalog last year, and CNN is using one in its election coverage.

Gates' demo comes as part of the company's CEO summit, an annual gathering of business leaders that runs through Thursday at Microsoft headquarters in Redmond, Wash.

A Microsoft representative declined to offer any details about whether or when TouchWall might be available commercially. The device is not being developed by the Surface unit, but rather is a collaboration between Microsoft Research and the company's newly formed Office Labs unit.

It's taken a little bit longer than expected, but Microsoft has its first customer ready to put Surface computers into public use.

Perhaps most interestingly, the first one out of the gate is not one of the company's earliest partners. Instead, it is cellular carrier AT&T that is ready to make use of the touch-screen computers.

An example of the Surface computer set-up that AT&T plans to use in its retail stores.

(Credit: Microsoft)

The company will use several counter-height units inside its cellular retail stores. The company is beginning with five stores on April 17: two in New York, one in San Francisco, one in San Antonio, and one in Atlanta. Each store will have a few of the Surface machines where customers can compare the features of different phones as well as check out service plans and view coverage maps. Currently AT&T uses laptops in the store to offer such features.

"We're in business now," said Pete Thompson, the general manager of Microsoft's surface computing unit.

Microsoft had talked about such a retail use for Surface, but in its demonstrations had featured AT&T rival T-Mobile. Thompson said that T-Mobile remains a partner, but he had no update as to when that carrier will be ready to use Surface in its stores.

And, although Microsoft CEO Steve Ballmer has said he wants the consumer version of Surface speeded up, Thompson said he also wants to make sure that the company doesn't disappoint its earliest customers, who are all large businesses.

Microsoft has said it is aiming to have the consumer version on shelves by 2011, as much as two years earlier than its initial plan.

"We are trying to do the right thing and accelerate where we can," Thompson said, but added, "I am very much focused on making this initial commercial plan a success without getting distracted."

As for those early buyers, Thompson said that Microsoft does have other unnanounced customers for the Surface, though he declined to name names. (One name we've heard mentioned is Disney, though Thompson would not comment on that.) He did say that we would start to see activity through partners in some additional areas, such as government, health care, and education.

At last year's partner conference, Microsoft talked about having a software development kit available by April.

Thompson said that the company has started offering a development kit for some software makers and partners, but that for the time being the kit will only be available to select developers.

"We're looking at more of a managed rollout of the SDK at this point," he said, adding that he would not characterize the software kit as being broadly available. "That's where we want to get to. I don't want to say this is a closed or managed system over time."

Although AT&T will be the first place the public can go to regularly see the Surface, Microsoft has permanently installed the machines in one other place: its own campus.

"You can just walk into most lobbies," Thompson said, adding that the company has about 15 to 20 buildings with the machines so far. "We're putting in three to five a week."

In targeting casinos, restaurants, and hotels, Microsoft knows it is barely scratching the surface of the demand for its tabletop computer.

The company is convinced there is a mass market for an interactive touch-screen computer, but perhaps not in its current $10,000 version. CEO Steve Ballmer told financial analysts last month that Microsoft had a plan to speed up the arrival of a consumer version of the tabletop computer Surface.

Mark Bolger, marketing director for Microsoft's surface computing unit, shows off the tabletop computer in May. Microsoft hopes to have a version for the home market by 2011.

(Credit: Ina Fried/CNET News.com)

Originally, Microsoft had said it could take up to five years for a home version of Surface, but Microsoft is now aiming to have that out in three years' time, according to an interview that Microsoft's Tom Gibbons did with Fortune magazine.

"In the three-year time window, we absolutely see how to get there," Gibbons told Fortune. "If we can beat that, we'll try to beat that."

But before it can focus on the home market, Microsoft still needs to work on satisfying the initial customers for the product. When it announced Surface in May, Microsoft was aiming to have its initial customers with products in hand by years' end. By the fall, though, CNET News.com reported that Microsoft was unlikely to meet its goal.

"We're running a couple of months later than I'd like with our deployments, Gibbons said in the Fortune interview. "While I was hoping we'd have something out now, we'll definitely have something out in the next couple of months."

Microsoft's Surface has yet to become a permanent act on the Vegas Strip, but the tabletop computer did play a one-night gig at Caesars Palace last week.

The it-list gadget was shown off at Caesars Pure nightclub at the drawing party for the National Heads-Up Poker Championship. Among the celebrity hands that got to touch the Surface were those belonging to Jason Alexander, Don Cheadle, and Shannon Elizabeth, along with the fingers of some pro poker players, including Howard Lederer.

But it will still take more than a good card on the river to get your hands on the thing. The first units should make their debut in the coming months at early customers like Starwood hotels and Harrah's, which plans to put a unit inside the Rio.

For those who aren't counting cards, that's later than Microsoft had originally planned. However, Microsoft is accelerating plans to try to get the technology behind Surface into the home.