• On MovieTome: Concept art of Iron Man's super-villain!
September 26, 2009 3:56 PM PDT

Microsoft gets cleverer with multitouch screen keyboard

by Jesus Diaz
  • Font size
  • Print
  • 75 comments

Oh, those smart rascals at Microsoft are on a roll. I love their Courier tablet concept, and now they may have found the way to make on-screen multitouch keyboards actually work great--even for touch typists like me.

The problem with screen keyboards is that you actually have to look at the screen to hit the keys correctly. With real keyboards, touch typists have a physical reference to position their hands. That's why they type blind. With a flat screen keyboard, however, you lose the physical reference frame.

The patent for this screen keyboard, however, uses multitouch technology to automatically align the keys to the position of the hand. Since the keys are always in the same relative position to your fingers, you will always have a physical point of reference: Your own hand. That way, you can blindingly hammer your keys against the screen, knowing that your fingers will always hit the keys they are aiming for.

The patent also details the way this virtual keyboard would appear anywhere on the screen: Just place your hands as you would normally do while typing, and the keyboard will pop up. [USPTO via WMPowerUser]

This story originally appeared on Gizmodo.

Recent posts from Crave
Four must-see Cyber Monday deals
Crave giveaway of the day: Vizio VOJ320F1A 1080p LCD HDTV
The Olympus EP-1: Modern features, retro look
Barnes & Noble Nook to hit stores later than expected
Searching for Cyber Monday laptop deals
Get a Brother HL-2140 laser printer for $49.98 shipped
iPhone officially lands in South Korea
How can Dell Netbook be 'perfect for tweeting'?
Add a Comment (Log in or register) Showing 1 of 2 pages (75 Comments)
by PandaSage1221 September 26, 2009 4:41 PM PDT
That only works for those of you who actually leave your fingers on the home keys. Still, it is pretty cool.
Reply to this comment
by Werkplace September 28, 2009 9:21 AM PDT
That's not necessarily true. Don't assume that the API on this is closed. This could also be augmented with OLED, Spimes, Claytronic tech, and the sensors we are playing with in the Natal platform.
by Werkplace September 28, 2009 9:23 AM PDT
Not to mention, some hardware moto-neuro learning aids from the movie Brazil that train your hand to stay in place.
by chabig83 September 26, 2009 4:44 PM PDT
When typing properly, the wrists shouldn't touch the keyboard, as the diagram depicts.
Reply to this comment
by CanadianKat September 26, 2009 5:11 PM PDT
Personally, I think the missing 'g' and extra 'b' are worse for the diagram than the palm of the hand touching the screen-keyboard.
by jaguar717 September 26, 2009 6:11 PM PDT
The extra B is probably intentional, and if so a great little detail that's hopefully indicative of how intuitive this will be. I believe the B is supposed to be typed with the left forefinger, and I've always used my right.

Despite using those little typing tutors, I've just never been able to switch over to the "correct" use for that key, and it is centered relative to your hands, so a duplicate is a nice addition. It would also make sense to duplicate the 6 key.

If you look, the artist simply has the whole keyboard shifted due to a too-short shift key. The A shouldn't be right of the Z but left of it, putting V right of F. Then the keyboard splits between TGB and YHN.
by CanadianKat September 26, 2009 7:52 PM PDT
I could see the B being intentional (kind of thought of your point after I posted)-- although I would much prefer being able to set my own preferred key setup in terms of where my hands are relative to the keys, since I do this odd thing where I don't put my fingers over the 'H' at all. I guess those typing classes never did me all that much good in terms of technical correctness, either.

But the missing 'G' cannot be intentional.
by Seaspray0 September 26, 2009 8:30 PM PDT
Nor should the right forefinger use the H key as home. It should use the J key. Lets hope all these bugs are worked out before final product or there will be alot of angry people.
by ScorpioKing1990 September 26, 2009 5:13 PM PDT
Okay now that is cool. Very clever. This could actualy work quite well with some calibration and fine tuning. My guess is they would let you adjust the size of the keys and other options, making it very versatile. Awesome idea, I'm not realy sure how you could have a better solution than this until the day when we have flexible OLED screens covering adaptable hardware with moving parts that can simulate the shape of a keyboard ; ) but, sadly, that's most likely atleast 15 years away. Keep it up MS!
Reply to this comment
by sting7k September 26, 2009 5:29 PM PDT
Pretty cool. Future here we come.
Reply to this comment
by jumpjetta September 26, 2009 8:05 PM PDT
Keyboards, touch or physical, aren't the future. Wake up.
by DarkHawke September 27, 2009 12:20 AM PDT
@jumpjetta: M'kay, so what's the alternative? Speech? Current voice recognition tech is pretty good, but it's not 100% and nowhere near as fast as a good touch-typist (which is still a very handy skill in this day and age). And with all the cell phone chatter these days, do you really want to hear folks dictating to their Couriers as well?
by solitare_pax September 27, 2009 3:31 AM PDT
Actually, I'd like a gadget that lets you think your words directly into the computer - and images too. Considering the work being done to assist people who are paralyzed or have lost limbs, such a device seems plausible.
by phuongnwade September 26, 2009 5:51 PM PDT
What would be even better is if you added in a predictive text editor so even if you got a key wrong, it would "know" which key you were trying to get to.
Reply to this comment
by jaguar717 September 26, 2009 6:13 PM PDT
Which would work for long words, but not short ones with multiple variations, non-standard terms, abbreviations, or symbols.

That's what makes iTap such a pain--it's great for about 3/4 of what you type, but all those exceptions really add up even for day-to-day messages.
by ballmerisanape September 26, 2009 8:07 PM PDT
Almost like what the iPhone virtual keyboard has now.....? Wait.... I thought every one thought virtual keyboards sucked?
by Urza9814 September 26, 2009 8:19 PM PDT
Oh god no! I _hate_ the iPod touch keyboard for just that reason. At _least_ 50% of what I type comes up wrong because of their damn predictive text - and they don't let you add new words to the dictionary either! I try to type up my homework for example and I type 'calc' and it gives me 'calf'. I try to type 'casa' (a server here) and get 'Vasa'. 'Wed' gives me 'We'd', 'hintz' (a building here) gives me 'hints'....and that's just a brief list of what's currently on my notepad. It takes twice as long as it should to type anything because I have to keep fixing it's 'corrections'. Ugh.
by ikramerica--2008 September 26, 2009 9:38 PM PDT
What are you talking about? My iPhone learns new words on it's own. Does the iPod touch not do that?
by EvanSei September 26, 2009 9:46 PM PDT
maybe Im just odd but I love the iPhone/iPod touch keyboard the words are usually correct and I can type faster on that thing than I can an actual keyboard.
by Vegaman_Dan September 26, 2009 10:31 PM PDT
@ikramerica--2008:

The iPhone / Touch do add words over time, but they all get wiped out with each OS update that is released so you have to start over from scratch.

The Palm Pilot had some neat featuers where it would learn from your style and adapt to it.
by sasquatch3 September 26, 2009 6:10 PM PDT
any of you notice the extra b and missing g?
Reply to this comment
by jumpjetta September 26, 2009 8:06 PM PDT
That's Microsoft for you. Their own version of a "standard."
by AndyCR512 September 27, 2009 7:14 AM PDT
That's so you can't type "Google", but have two ways to type "Bing".
by monkeyfun14 September 27, 2009 9:17 AM PDT
@AndyCR512

Hey mate if its missing a G how do you type Bing?
by AndyCR512 September 27, 2009 11:17 AM PDT
Doh. That's what I get for posting before I've had coffee. It would have been so perfect, too...
by Hunnter2k3 September 27, 2009 11:21 AM PDT
@monkeyfun14

[win+r]
"charmap"
[enter]
double click G at the end
Bingo.

At least it doesn't require you entering 2 Gs.
Damn Google and their 2 Gs, it should be Goole. Or Oogle. Oh yeah.
by viper396 September 27, 2009 7:59 PM PDT
Did you bother to notice that it was a *conceptual* drawing, all the characters were in caps and there were no number keys? Did it occur to you that maybe it's the touch technology and not the keyboard characters themselves that is the point of the patent?

But of course some will choose to be superficial and focus on the irrelevent.
by Jeremy Chappell September 26, 2009 6:33 PM PDT
So you have to rest the heal of your hand against the display - that doesn't sound like a good idea (and is not recommended for good typing posture).

No this looks naff. That said, I did like fold out double screen pen computer. Isn't a pen the way to go?
Reply to this comment
by U. Tripps September 26, 2009 8:32 PM PDT
No, a pen is not the way to go, except for point-and-click type work. The reason a keyboard is a must is because it is the fastest way to enter data, until they can hardwire sensors into your brain that understand what you're thinking. Voice is faster for composing text, but most likely not faster for selecting buttons, entering math & numbers, or anything for which you'd typically use hotkeys or a mouse.
by Vegaman_Dan September 26, 2009 10:32 PM PDT
The heel of the hand is not required. Starting your typing from the home keys is though.
by Jeremy Chappell September 27, 2009 10:38 AM PDT
@U. Tripps:

I agree a keyboard is always going to be faster, but this kind of system isn't for writing significant amounts of text on - is it? I can't imagine typing very much on dead glass - no matter how clever the software is. I'll be honest, given how few people can actually touch type and how many of those will fill find typing onto a dead glass surface appealing, I doubt this will ever make it onto a shipping product. As for voice, well it can be useful, but given the fact that this is probably going to be a portable system I doubt it will be very useful (some of the time it'll be too noisy, some of the time it'll be socially unacceptable). So I still like their pen/multitouch system more.
by DrtyDogg September 27, 2009 4:34 PM PDT
I have to agree, the onscreen keyboard will never completely replace a physical keyboard, but there are a couple of applications where it would suffice.
by kormiko September 26, 2009 6:53 PM PDT
Win one for the MS team for patents.

Apple's usually first with these types of patents.
Reply to this comment
by jumpjetta September 26, 2009 8:07 PM PDT
I'm sure Apple's got plenty of patents that look far beyond the keyboard.
by Vegaman_Dan September 26, 2009 10:33 PM PDT
@jumpjetta:

Okay, we get it. You're an Apple fanboy. That's fine. Not everything has to be about Apple.

Keyboards are around today and there isn't any thing in the offering currently for development that is likely to change this any time soon, no matter what you like to say... again and again and again. Somehow I don't think Apple is going to stop allowing keyboards to be used on their systems simply because you have decided that they are passe.
by Renegade Knight October 15, 2009 2:34 PM PDT
@jumpjetta

Yup, they have been trying to kill off buttons for years.
by AppleSuxLeo September 26, 2009 8:06 PM PDT
For months these Apple Kool-Aid drinkers kept saying Palm and MST would never have multitouch , because Apple invented it.
I turned out to be right. Apple only holds the patent to their own version of multitouch.
And the Zune HD does multitouch better than any Apple device...faster , smoother.
So I could see MSFT`s screen keyboard being truly excellent. ;)
Reply to this comment
by jumpjetta September 26, 2009 8:13 PM PDT
Problem is, a keyboard is what? technology from the 1800s? Leave it to MS to try to work with Nineteeth Century technology. If it hadn't been for Apple leading the death of floppy drives you'd still have one in your shiny little Dull. Apple's most likely looking well beyond the keyboard, little LeoSux.
by U. Tripps September 26, 2009 8:33 PM PDT
@ jumpjetta, what is your brilliant idea to replace the keyboard? Voice? Potentially great for composing text, slow for anything else. Any other input device? Much slower than a keyboard.
by September 26, 2009 9:17 PM PDT
So then, you don't use a keyboard on your computer?

I'm a Mac user, and my MacBook Pro has a keyboard... crap, I must have gotten the 1800s model.

Oh... you DO use a keyboard? Why are you still using technology from the 1800s.

At least for the next twenty years or so, the keyboard is here to stay. You can say whatever you want about voice being the next wave, but do you really want to be in a room full of people typing by talking to their computers? I can't even imagine the computer labs in my school's library which are supposed to be silent. Hopefully they still make computers that have keyboards so that I can do things like type quietly, have a conversation while using my computer, not have to say out loud what I'm writing. That would get pretty old.

Nah, I like keyboards. I think they're here to stay.
by myles taylor September 26, 2009 9:18 PM PDT
Leo, your whole life (at least on here) revolves around Apple. You have to bring up and bash Apple every chance you get. Even your screenname is built around them. You should find something positive to identify with.

I'd like to meet the people who said that Palm and MST wouldn't have multitouch. I never heard anyone say that.
by Vegaman_Dan September 26, 2009 10:35 PM PDT
JumpJetta doesn't have any solutions, only problems. Just let them rant and hop around like a little confused monkey with only one tired comment. It's funny to watch.

Here you go- have a banana... keyboard.
by solitare_pax September 27, 2009 3:37 AM PDT
Yep, we're still stuck with a keyboard devised in the 1800's - oh, look- all the letters for the word "typewriter" are on the same row (it was a sales gimmick, believe it or not...)

On the other hand, we are using an alpha-numeric system that was devised some two thousand years ago and upgraded over the centuries - so using something 'old' ain't so bad.
by Seaspray0 September 27, 2009 4:56 AM PDT
@jumpjetta. They led when it came to dropping the floppy but they are lagging when it comes to adopting the blue ray.
by Perry_Clease September 27, 2009 8:26 AM PDT
"by Seaspray0 September 27, 2009 4:56 AM PDT
@jumpjetta. They led when it came to dropping the floppy but they are lagging when it comes to adopting the blue ray."

There is no reason to adopt a dying technology such as Blue Ray
by myles taylor September 26, 2009 9:20 PM PDT
That's pretty cool. The only problem is that I type so fast that it's rare that my hands are just resting on enough keys to use as a reference point. They can probably use some kind of software to predict this. Either way it will be pretty cool. I also noticed while typing this on my laptop (I do it different on a desktop) that I don't even rest my hands on the keys but hover above them. What we need is fingerprint scanning technology that can make your fingers to the letters.....or something like that. hmmmm
Reply to this comment
by EvanSei September 26, 2009 9:53 PM PDT
I love on screen keyboards such as the one on the iPhone/iPod touch and this thing looks nice (as long as they add a G key) the only worry I have is that you would need to constantly touch the screen to keep the keyboard up, I like to type with my hands hovering over the keys rather than actually touching them. It needs to have an option to raise the keyboard like maybe having a triple tap to raise the keyboard. thats just me though.
Reply to this comment
by VanVlack September 26, 2009 10:48 PM PDT
This idea is not Microsoft. Actual the technology used in Microsoft surface is not even theres. Jeff Hans talked about this in a TED event. watch the video as he talks about keyboard just like this.

http://www.ted.com/talks/jeff_han_demos_his_breakthrough_touchscreen.html
Reply to this comment
by LLIB_SETAG September 27, 2009 12:13 AM PDT
Cleverer? Really! I think that would be " more clever ".

I guess that what happens when you use the " MSurface sorta multi-touch, sortaTED, sorta not, iPhone interface wanna be key board".

Just an IDEA not reality people.
Reply to this comment
by streaks September 27, 2009 12:32 AM PDT
If you are typing correctly as a touch typist, then your hands shouldn't rest on the bottom of the keyboard and you should always keep your hands at Home Row.

Only problem I have with it, is how in the heck will this impact me? .....not much....I suspect this is more for work environments really. I can't see this being useful for gamers for example.
Reply to this comment
by koderkev September 27, 2009 12:46 AM PDT
I had problems with the iPhone keyboard until I learned to just trust it and type. I still make typos sometimes, but then I do on my regular computer keyboard too, so that's just me. The auto-suggest on the iPhone works great for me, but I can see where it might foul someone up with odd words they have to use (like the guy that mentioned "hints" for "hintz"). But for most people, I think the iPhone keyboard works pretty well.
Reply to this comment
by canada1235 September 27, 2009 4:20 AM PDT
I don't give a damn about the keyboard what worries me is that CNET writers have minimum grasp on the English language.. CLEVERER give me a break geek heads. Try "more clever"....I guess it's the american education system which sucks just like their health care and civil rights.
Reply to this comment
by ChrisAubeck September 27, 2009 5:06 AM PDT
Cleverer is just as acceptable as clever. If you don't like how it sounds, don't use it.
by muskratboy September 27, 2009 11:17 AM PDT
yeah, again... "cleverer" WOULD be just as acceptable, IF you use it correctly .

CNET did NOT use it correctly.

the difference between an adjective and an adverb is like 2nd grade stuff. so 1) cnet writer kinda sucks. and 2) everyone defending his use of the word is also pretty stupid.

things ARE cleverer. things GET more clever.

basic english, people. seriously basic english.
by DeBollWeevil September 27, 2009 2:26 PM PDT
MuskratBoy, you must feel mighty smart, being wrong and calling others morons...
by Dalkorian September 28, 2009 12:14 PM PDT
I always have found it amusing that grammar nazi's never understand what they're talking about themselves.
by mjdunlap September 27, 2009 5:29 AM PDT
Looks like a very smart approach to a virtual keyboard, much like the approach they took their ergonomic physical keyboard, splitting it down the middle, forcing your hands to be in the correct position to type. The only issue I can see with this is that it would be very difficult to get by without a "G" key (see the drawing)
Reply to this comment
by Dalkorian September 28, 2009 12:16 PM PDT
To type the letter 'g', just press alt+ctl+B, but it only works at the end of a word. For example, you could still type "bung" but it won't work for "Google".
:D
by canada1235 September 27, 2009 6:50 AM PDT
Figures ... ChrisAubeck take a look at Webster's dictionary. No such word.
Look at it this way ... your adding code to your web page. You make an error but it still shows up on your page. Some browers will read it some won't. It is still the wrong code.
So...when you can't spell correctly or use proper grammar it may be readable but it's still not correct. Either a person is disciplined and does things right or their slackasses who don't give a rat's ass that someone may think they are idiots.
Reply to this comment
by wjsteele September 27, 2009 8:05 AM PDT
Hey canada1235, look here: http://dictionary.reference.com/browse/cleverer "Cleverer" is a perfectly valid adjective of "Clever."
by muskratboy September 27, 2009 11:14 AM PDT
hey word genius... "cleverer" is an ADJECTIVE.

Microsoft GETS cleverer ... that's an adverb. (see the "gets"?) ... MORE CLEVERLY is what they are looking for.

now if they said "micosoft IS cleverer" ... that would be correct.

so... it's a word. but it's used incorrectly here. different words are used in different situations.

so all you morons saying "that's a real" word.... you are right, but still a moron.
by DeBollWeevil September 27, 2009 2:27 PM PDT
MuskratBoy, you must feel awesome, being wrong and calling others morons for not knowing what they are talking about.
by wjsteele September 27, 2009 4:10 PM PDT
muskratboy, I did not comment on how it was used in the story's title, I just pointed out that "No such word" is not accurate in the posting from canada1235. My statement is accurate. Cleverer is a derivative of the root word clever, both being adjectives.

I also did not childishly attack anyone, as you did. So, who is the moron?
by jessiethe3rd September 27, 2009 7:30 AM PDT
The flippin commenters here are funny. If you read through people hate Microsoft so much they think that their patient isn't cool - they need to invent a new way of input... It's pretty creative.
Reply to this comment
by dccarino September 27, 2009 7:59 AM PDT
ASDF JKL; I was taught that these are supposed to be the home keys. the diagram above has the right hand home keys as HJKL. Am I wrong?
Reply to this comment
by Dalkorian September 28, 2009 12:18 PM PDT
Not at all. You've proven you understand computers better than M$ does.
Showing 1 of 2 pages (75 Comments)
advertisement

About Crave

The name says it all. Crave is our blog about gorgeous gadgets and other crushworthy stuff. If you would like to contact Crave with a tip or comment, please write to: crave@cnet.com

Add this feed to your online news reader

Crave topics

The browser battles go on and on

roundup From Firefox to IE and from Chrome to Opera and Safari, there's no sitting still for browser makers looking to keep their products fresh and competitive.

3G wireless still holds promise

The next generation of 4G wireless may get all the headlines, but advanced 3G technology will likely dominate services for the next few years.