Showing posts with label speech recognition. Show all posts
Showing posts with label speech recognition. Show all posts

10 January 2011

Assistive Technology: What The New York Times didn't tell you

It is nice that The New York Times occasionally publishes a positive story about technology in education amidst their standard "oh, we're distracted" fare. But it is unfortunate when that information is incomplete and inaccurate in presentation.

Lisa Guernsey works for the Early Education Initiative at the New America Foundation,
not directly for
The New York Times
High Tech Help, published on January 7, 2011, has some valid suggestions, but it is outdated, and leans toward that ugly realm of "brand advocacy."

So here is what The New York Times and Lisa Guernsey left out:

Speech Recognition - speech-to-text - doesn't only come from Dragon. It is available at no extra cost on every Windows computer running Windows 7 (or Windows Vista). The Windows Speech Recognition system has some significant advantages over Dragon, especially for "immature" voices and in terms of working across the widest range of web and software applications.


There is also VLingo, for just $20 lifetime, which offers Text-To-Speech and Speech Recognition for Android and BlackBerry.


WordTalk might be the best free Text-To-Speech system. Yes, it is limited to Windows and Microsoft Word, but within those common contexts WordTalk provides word-by-word highlighting with excellent settings control and instant conversion of text to mp3 files.

PowerTalk, which provides text-to-speech for Microsoft PowerPoint, is another free essential tool. And though, yes, we all love Prezi, Prezi is not accessible, and really has no place in public education at this time.

WYNN (from the JAWS people), much less expensive and appropriate for a wider range of ages than Kurzweil 3000, should have been included in the Text-To-Speech paragraph. We should be "brand agnostics" here, looking for whatever works for each student.

I love CLiCk-Speak, and I'm proud that my conversations with the brilliant Charles L. Chen at the CSUN Conference on Technology and People with Disabilities in 2005 contributed to its development from the FireVox platform, but, CLiCk-Speak development has halted and it does not work with all systems. So it is vital to link people to newer answers, notably FoxVox (for Windows) and Speaking Fox (for Mac OS).

There needed to be a deeper discussion of EduApps from RSC-Scotland North+East. Or you might look at our Michigan version, the Freedom Stick, whose new version - coming later this month - includes the screen reader Balabolka. These "carry anywhere" tools represent an exciting way around the bad rules of bad school districts which block access.

Going back to Firefox, there are so many add-ons for accessibility, which should have been discussed. In Michigan we've collected these into two collections - one for PCs, one for Mac OS. You may also want to look at the Bookshare Firefox DAISY Book Reader.

Anyway, I appreciate The New York Times discovering "Assistive Technology" but I wish they had done a bit more research, and written a slightly more useful article.

- Ira Socol

18 March 2009

CSUN 2009 - Writing Tools - Supporting All Writers

(As the CSUN 2009 - Technology and Persons with Disabilities Conference goes on I will post my three presentations and add short posts about what I see and hear. You may want to also follow the CSUN Twitter feed at #csun09)


If you could offer your students technologies which would support their writing skills, and could do it for free, would you?


Suppose your students could slip past small muscle control issues to begin getting their thoughts onto “paper?” Or that they could read and edit their words without struggling with decoding? Or could effectively spellcheck their own work no matter how much accent or first-languages impacted their initial spelling attempts?


What if you could watch – and support – your students as they wrote collaboratively, while tracking every change? Or if students could collaborate on homework without being in the same neighborhood? Or could track and record sources without the difficulty of writing complicated notes?



slideshare powerpoint has links if you download


When Englert, Manalo, and Zhao wrote I Can Do It Better on the Computer: The Effects of Technology-enabled Scaffolding on Young Writers' Composition, documenting the success of computer supports in 2004 most of the solutions studied had to be purchased by schools and students. Today free downloadable and online software allow us to offer every student technology which can improve the core elements of their writing: spelling, organization, editing, and understanding of authorial voice.


Text-To-Speech systems allow students to independently listen to their own writing while editing, even if they are weak readers. This not only helps them to identify wrong words, repeated words, and omitted words, it offers a way for them to compare their phrasing, descriptions, and explanations with their intentions and their aspirations.


Content-based spell-checking with word definitions allows struggling readers and writers of English to find the right word and the right spelling without losing their thoughts during long, frustrating trips to a print dictionary.


Online document software allows peer collaboration and teacher support of the writing process.


And online graphic organization tools and notebooking systems support writing organization.


Up to two years worth of functional research with WordTalk, Firefox with CLiCk-Speak (and other add-on tools), Ghotit, Google Docs, Google Notebook, Webspiration, and Microsoft Vista’s Speech Recognition in both educational and job training situations underlie this presentation which will look at best practices for using these free tools across student environments.


Particular emphasis will be placed on how to combine these tools to support the writing process, focusing on carrying students from engagement through persistence to editing and production for audience, all with software that is already on most school computers or which can be accessed at no cost.


These are the critical issues in creating and supporting emerging writers. Students must have ways to begin writing which do not generate massive frustration. They must have ways to complete writing which do not exceed their ability to persist in the task. They must have effect ways to edit even if their reading decoding skills are week. And they must discover that writing has a purpose beyond teacher-defined school success: without this feedback, engagement and persistence will inevitably wane.


In their 2004 article Englet, Manalo, and Zhao state, “Without access to these functions, the memory or cognition of a problem solver might be overwhelmed (Pea, 1993; Stone, 1998). In this manner, technology serves as a type of social actor or intellectual partner. Together the individual-operating-with-the-mediational-technology can participate in a process that, barring this support, might lie beyond his or her attainment. (Pea, 1993; Salomon, 1993; Wertsch, 1998).” Five years later we can provide this functional support on any internet-connected computer, and on many “smart” mobile phones. Offering our students the opportunity to use their cognitive efforts for the learning of writing skills, rather than overcoming capability differences.


- Ira Socol in Los Angeles


Englert, C.S., Manalo, M., Zhao, Y. (2004) I Can Do It Better on the Computer: The Effects of Technology-enabled Scaffolding on Young Writers' Composition. Journal of Special Education Technology. Volume 19 Number 1.

27 June 2008

Future Near: Universal Speech Recognition

In a discussion on Enda Guinan's blog what began as a conversation regarding trying to explain to people what we [those of us in AT-related jobs] actually do when we go to work transferred over to a conversation involving speech recognition, which is one of the things which provides the wow factor when we demonstrate. From there, we got into the question of universal speech recognition, as in the question we are always asked, "is there a way that I can listen to the professor and have that converted into text." The answer is, "no, not really." But there is another answer, "the future is almost here." Very soon now we might be able to start saying yes.

Actually, we have been able to convert what the prof, or lecturer, or teacher is saying into text. It has just been difficult. The Liberated Learning Consortium has been doing this for a decade, and five years ago at an American Community College I outfitted a few deaf students with laptops equipped with ViaVoice speech recognition software, and their instructors with wireless microphones linked to receivers on those laptops. We got the instructors to train their voices on ViaVoice, and then, whatever they said in class arrived in a Word doc on the students' laptops. The accuracy was great, but the words came unpunctuated, which drove half of the students crazy (this is part of what the complex Liberated Learning system has tried to solve). And anything any other student said was, of course, lost. And... yes, getting the faculty to participate was not easy.

The world, however, is changing. The first paragraph of this post was dictated through jott.com. I have "fixed" it, but I have shown you where I fixed it. Green means that jott added a (?) and got the word wrong. Purple means that jott added a (?) and got the word right. Red is punctuation which I had to add. It isn't perfect - it never will be. Enda's name came out "___ duh _______" which is not correct. And yet, it is mostly correct, and the punctuation is there.

So now you can see speech recognition accuracy without voice training. Now you know where we will be very soon.

This is important. It means that we are perhaps only a year or two away from truly being able to have almost everything said in a classroom transcribed and available to those with hearing, attention, and learning issues and differences. That will make everything different for a whole range of kids - but let me focus on how this will change education for everyone.

When I have taught online courses two differences appear. First, online teaching is really hard - you can never "wing it" - everything has to be prepared and it is much more work to monitor online discussions than real-life ones. But second, you have this extraordinary record of what was said and who said it, what was discussed, what was asked, what was misunderstood, what was very difficult. It is all there, and not just fragmented in memory. You can go back and say, "wow! that didn't work," or you can say, "look at this, I really need to mediate this better." Perhaps more importantly, students can go back and say, "did I hear that right?" "did she say what I thought she said?" "could I have said that better?"

One promise of universal speech recognition is that ability to bring one of the best features of online learning into face-to-face learning. And bringing that in will enable a teaching and studying revolution.

It is close. Very close. Try jott.com today. Get a bunch of your friends to try it. And then start imagining what you could do with this kind of power in your classroom.

* jott.com is North America only for the moment. SpinVox is available in the UK and Ireland, but it is not inexpensive.

- Ira Socol

Worth reading: Liz Kolb on the Mobile Web. Paul Hamilton on Awesome Highlighter and Firefox.

The Drool Room by Ira David Socol, a novel in stories that has - as at least one focus - life within "Special Education in America" - is now available from the River Foyle Press through lulu.com

US $16.00 on Amazon

New! Digital version available through lulu.com

Look Inside This Book

23 May 2008

Toolbelt Theory for Everyone

How will your students communicate when they leave school? How will they gather information? How will they say what they need to say?

How will they make phone calls? Leave messages? Read books? Do research? Tell their boss they are stuck in traffic coming back from that meeting? How will they get their news? Check their bank records? Pay their mortgage? Arrange their vacation? Sell their services? Sell possessions they no longer want? How will they learn the things they need to learn? How will they tell the stories that they need - or want - to tell?

Schools - in the old days - were interested in these kinds of skills. Schools taught things like how to read books, how to read newspapers, how to read stock tables. They taught how to find books in the library and how to write business letters. Even (sometimes) how to write cheques, read classified advertisements, compare prices in display ads, address envelopes, read maps, type, write legibly. Yes, maybe some of this training came to me because I wasn't always in those "top" classes, but I think most students received significant trainings in the communications technology of the age. At least the "apparent" technologies of the age.

But in the time when most of our teachers, school administrators, government officials, and legislators went to school, little changed on the "apparent" side of ICT. Newspapers and phone calls may have been produced in radically different ways in 1990 as opposed to 1960, but the end-user did not see much difference. So these people have been trained in complacence. They grew up in a world of little technological change (as it touched them) and they now resent change. They're often still angry that we want them to be able to program their VCRs, and VCRs are almost history.

So they don't want to teach about tools. The tools they know are gone, chucked to the curb with the card catalogues and 8-track players. The tools which are essential now - the tools which are essential everywhere outside of a school building - are outside of their realm of knowledge. This is why school today is so divorced from any reality.

Tools matter though. They are the most basic thing about being human.

We are many things - human beings - but above all we are tool users. Unlike most other species, and far more than any other species, we have defined ourselves by crafting tools which allow us to control our environment and overcome our limitations. Can't run as fast as a horse? Climb on the horse. Can't fight one-on-one with a Mammoth? Invent the spear. Can't remember everything you need? Create writing.

So tools matter. They matter most for those who lack the highest capabilities - a very old person and a very young person needs a car more often than a 20-year-old might - a short person needs a ladder more often than a tall person - a weak swimmer needs a boat when a great swimmer might not - but still, tools matter for everyone.

And everyone needs a properly equipped Toolbelt to get through life.

Toolbelt Theory


The thing about toolbelts though, is that no two people ever really need the same one. When I worked at one university and part of my job was being a cable stringing "tech monkey," three of us all began with the same toolbelt. Scissors, wire strippers, pliers, wire cutters, punch-down tool, screwdrivers. Within a week all three toolbelts were different. Within a month, very different. Screwdriver choices varied. Pliers were added and subtracted. I added a fish tool for dragging cables through walls, another added a device from Fluke that read network connections, and then I grabbed a quick-check tool that confirmed my wiring order because, you know, I'm not great with order. The belts changed as well. One was worn as a belt, mine was almost always slung across my shoulder. When I was a police officer, I watched a similar process operate on the gunbelts of cops coming out of the academy. They began all the same, and ended up as radically different collections of tools. Of course those tools changed as the world and technology changed. Drop pouches for revolver ammunition vanished and clip holders for automatics appeared, as one example. Then we needed to carry latex gloves. Flashlights changed. Radios changed. Mace came and went. Etc.

So the trick to tool use is to learn to evaluate tasks and environments and your skills and the tools themselves as they change and determine what works best for you. I call this the "TEST" - Task - Environment - Skills - Tools, a specifically ordered reframing of Joy Zabala's "SETT" protocol. A specifically ordered reframing designed for self-determination.

"Disability" has little or nothing to do with this. Everybody needs this skill set. Imagine your eyes getting weaker as you are faced with graduate school reading or long-distance truck driving - and you've never heard of eyeglasses and have no idea where to go for help. Imagine needing to rip up an old driveway and having never heard of a jackhammer, nor had any idea of how to get one. Imagine needing to get to your home's roof with nothing but a step ladder. Imagine needing a book but being unable to use a map in order to find the library.

In every case you need the TEST idea. Whether you are choosing the right saw to cut that piece of wood in that location or whether you are trying to find the map that will get you to the hospital you need in Paris or whether you are trying to find the academic article you need.

You need to know what you need to do (the specific task: cut 20 sheets of plywood or cut down a Christmas tree, find a book to buy or find a book to borrow). You need to know where you will be doing this (the specific environment: in a forest, in a workshop, in a town with a university library and four bookstores, in a place with neither). You need to know your own capabilities (your skill set: I am strong enough to cut down a tree with a hand saw, I am experienced enough that I can cut a straight line with a hand-held circular saw, I can walk to the bookstore, I know the Dewey Decimal System). And you need to know what is available to you to help you, and how to use those devices (your toolbelt: My neighbor has a chain saw, I can rent a table saw, a bus will get me to the bookstore, if I go online and reserve that library book it will be waiting for me at the counter).

This all sounds logical, but it is hardly automatic.

Choosing the right tool takes knowledge of yourself and the tools which are available. It takes practice in assessing the task and the environment. And in school we don't help students toward any of that. In school we prescribe methods and we require specific tools (the dreaded middle school planner, just as one particularly stupid example - the teacher-determined notebook style as another). In school we tell students what they can and can't do and we get very nervous when they really try to analyse their environment.

And on top of this, the tools most schools are devoted to are antiques which serve few functions anywhere outside of school. It is as if you were learning to build homes but were allowed to use only tools invented before 1940. You'd be close to unemployable when you finished that training.

Letting the world in

The only way to allow students to assemble this essential toolbelt for information and communication is to to throw open your classroom and let the world in. How will your students know which calendar works for them - the one on their phone, Google Calendar with SMS appointment texting, Microsoft Outlook, or any of a dozen paper systems unless you allow them to try them out? How will your students know whether they 'get' a novel better by listening to an audiobook, or reading it on paper, or using text-to-speech, if you don't let them experience all repeatedly and help them decide? Will their choice be the same when they are reading history texts? Math texts? Again, how will they know? How will they know which is the best way for them to write, by hand (either on paper or on a tablet system), by keyboard (and which keyboard), or by voice, if they do not get to try out all the kinds of writing they need to do with all these tools?

They won't know. And you - the school, the teacher, the education system - will have deprived them of these essential skills.

It matters for all students, of course, but- as always - if you are "rich, white, and normal" it matters a bit less. You will have fewer needs, your parents will buy you more supports, you will be surrounded in your daily life by sophisticated tool users. So not bringing Toolbelt Theory into your classroom just exacerbates inequity - yes, of course - as school does in most things.

Real differences in survival

This is not a matter of success in school. This is a matter of human survival. A couple of years ago I sat in a resource room in a suburban American high school and watched an 18-year-old high school senior try to fill out a job application. His writing was "not good." You might be able to make out most of the capital letters, but the small letters were just meaningless squiggles. I asked him, "Why don't you just print that all-caps?" But before he could answer the teacher interrupted. "We've been working on his small letters for four years now," she said, "we want him to keep trying."

Four years my friends. Well, surely longer. I bet they've been torturing this child since he was five-years-old.

I started to ask whether the teacher thought he'd get a job with an application that looked this way, but there was no real point. School is about school. It is hardly ever about anything else. So instead I grabbed a blank copy of the same application, I pulled my laptop and my Canon LiDE scanner out of my backpack. I scanned the application in, converted it to a "form fillable" Adobe Acrobat document, and told him to type his information in.

He was a slow typist. A painfully slow typist. And yet, his typing was about three times as fast as his handwriting, and, in the end there was a perfectly completed job application.

Might speech recognition help? Or typing on a smartphone keyboard with iTap word prediction? That would have been too much to suggest. The school district had just built a massive brand new high school. All the bells and whistles, yet, number of accessible computers in the district? Zero. Zero, despite three meeting I'd had with the school superintendent, two days spent with district's large tech staff, and meetings with special education teachers and school psychologists and social workers. Zero. They simply do not care.

So their students graduate not knowing how to fill out a job application. They graduate not knowing how to access library resources online. They graduate not knowing how to stay on schedule, or how to listen to their own writing if no one is around to help them edit, or how to send an appropriate text from their phone to an employer or professor if they are running late, or how to collaborate with other writers on a Google Document, or how to most effectively use spellcheck and auto-correct in Microsoft Word, or even - and I see this every day - how to search online for a job or a university course.

They simply do not know how to function in the 21st Century. They will not understand the tools that they need to function. And unless they are lucky, they will be doomed to a life on the margins.

When I wrote "Not Getting to Universal Design" a number of people objected to my thought that encouraging students to fail was a deliberate thing. I don't think that I really suggested that individual teachers deliberately sought student failure. It happens - I can think of a number of university faculty I have known - but that is rare. It is the system - the system which includes the training of teachers and the design of schools - which has, in my opinion, made the decision to encourage the failure of the majority of students. If they have not done that consciously, my only other thought is that they are unbelievably stupid, because they do the "wrong" things continuously. But, I don't think they are stupid because, well, somehow, their kids seem to do OK. Of course their kids have their laptops and iPhones and Blackberries and Wii. Their parents listen to audiobooks and dictate messages for others to type, and get emails on their phones all day long. They see Google Maps and GPS in use every day. Hell, daddy can even talk to their new Lincoln and tell it what to do.

Now all those education leaders can probably quote that old saying, "Give a man a fish and he'll eat for day. Teach a man to fish and he'll eat for the rest of his life." So I wonder, why won't we teach our students how to fish? And why won't we help them to learn the best way for each of them to fish?

- Ira Socol

The Drool Room by Ira David Socol, a novel in stories that has - as at least one focus - life within "Special Education in America" - is now available from the River Foyle Press through lulu.com

US $16.00 on Amazon

New! Digital version available through lulu.com

Look Inside This Book


31 March 2008

Free Speech Recognition


Yes, right now your students can have free high quality speech recognition working for them.

Consider, without paying for Dragon - or before deciding to pay for Dragon, or without struggling with all the problems of Microsoft Vista - or while waiting for the eventual "Service Pack 2" which will make Vista stable, usable, and much less annoying, or without waiting for MacSpeech Dictate to finally appear, your students who struggle with the physical acts of writing or keyboarding can be doing their own writing and doing it (probably) for free.

You just have to let them have their mobile phone in the school, and you have to let them use it.

I re-discovered Jott via Karen Janowski's EdTech Solutions blog. I had heard of it, played with a very early version, then forgotten, until thankfully - through the wonders of social networking - Karen commented here, I went back to look at her site, and - voila!

Jott works very simply.
1. You sign up with Jott.
2. You register your mobile phone number and email with Jott.
3. You add other contacts into Jott - your teacher, your parents, your boss.
4. You call Jott.
5. You say "Send to me," or "Send to x."
6. You speak.
7. Jott writes it down for you.

8. Jott stores what you've written in folders you create on their website. ("Homework Assignments," or "My Second Novel.")
9. Jott emails the text to you or to whoever you wanted it sent to, or texts it to another phone.

A lifespan solution. And a real solution to myriad problems in school, from dexterity issues to dysgraphia to attention-spectrum issues to memory problems. And... yes, a high-tech solution which requires the school - in most cases - to spend absolutely nothing and requires none of that "precious" tech support time either (If a student did not have a phone a school could buy a mobile and minutes for far less than a computer and Dragon Naturally Speaking and a "strong enough for school" headset, etc, etc.).

Like most great Universal Design solutions Jott was not designed for people with "disabilities," nor is its impact limited to that group. Hands-free writing in your car just became easy, for example. So a student using this technology is not "marked" by their obvious accommodation - an important issue for children and adolescents, if not all of us.

I'd encourage you to read Karen's blog entry on this for a great list of real-school solutions, using Jott.

And consider all the other ways your students' mobiles can support them, especially if tied in with a Google Calendar at least partially shared with the teacher (with text-message reminders), and with the ScanR website which converts a 2 megapixel camera phone into a scanner capable of producing accessible text.

So I signed up. It is free. And I put Jott's number both into my phone ["call Jott"] and into my free calling circle. And now that is free. And now I'm ready to write, no matter how awful my handwriting is (and it is completely illegible), or how slow my one-fingered keyboarding is, or even if I am driving to campus.

- Ira Socol

The Drool Room by Ira David Socol, a novel in stories that has - as at least one focus - life within "Special Education in America" - is now available from the River Foyle Press through lulu.com

US $16.00 on Amazon

US $16.00 direct via lulu.com

Look Inside This Book