Sharky is sharing his favorite keyboard shortcuts! Did you know? The keyboard shortcut INSERT+SPACE, then F1 opens FSCompanion, the new AI tool in JAWS! What is your favorite Sharkvember Shortcut? freedomscientific.com/sharkvem…

#Sharkvember #JAWS #KeyboardShortcuts

A Day with JAWS 2035: When Your Screen Reader Scripts Itself

The morning light filters through your smart windows, casting a warm glow across the room. Your ambient AI assistant hums gently, “Good morning, Lottie. Would you like to prepare your workspace for the day?”

“Yes, please,” you say, stretching as the AI readies your home office. The blinds adjust automatically, leaving just enough sunlight to boost your energy without causing glare on your neuro-linked glasses. You smile, reflecting on the advances in technology since the days of fiddling with manual screen reader settings and customized scripts. Those days feel like a distant memory, thanks to JAWS’ AI-powered self-scripting feature—your personal assistant that knows exactly how to handle your work routine.

“Let’s get started,” you say, and JAWS springs to life, adjusting the audio tone to your preferred voice—smooth, confident, efficient. As your desktop computer powers on, JAWS begins analysing the applications you’ve opened, sensing your usual email, project management software, and a new program you’ve recently started exploring.

JAWS’ Real-Time Autonomous Scripting: A Custom Fit

“Good morning, Lottie. I’ve detected a new application in use: ResearchHub. Would you like me to generate an initial script for it?” JAWS asks in a gentle tone, its voice coming through the bone conduction implant in your ear.

You nod. “Yes, go ahead and script it.” This isn’t just any regular software; ResearchHub is dense, designed for researchers and developers with an intricate layout. In the past, navigating such software would have required hours of manually creating scripts or waiting for accessibility support. But today, JAWS’ AI-driven self-scripting feature allows it to analyse this program’s unique design and build custom commands as you go.

“Noted. I’ll adapt based on your usage patterns,” JAWS replies, instantly highlighting an unlabelled menu item. “I’ve labelled this as ‘Data Analysis.’ Would you like a shortcut assigned for quick access?”

“Absolutely,” you reply. Moments later, JAWS has created a keystroke, Control-Shift-D, which will take you directly to the Data Analysis section.

As you dive into your tasks, JAWS continues observing your interactions, quietly scripting shortcuts and macros that save you time with each click. You switch over to an email thread about your latest project, and JAWS dynamically adjusts, making sure to read each new message aloud with just the right level of detail. It’s responsive, intuitive, and seems to understand the flow of your work better than ever.

### Adaptive Behaviour Learning: Anticipating Your Needs

JAWS has learned over time what works best for you—like knowing when you prefer concise summaries over detailed descriptions or when to read full email threads aloud. Today, though, as you work through complex calculations in ResearchHub, JAWS picks up on repeated actions, noting your frequent need to access specific data fields.

Without you having to prompt it, JAWS speaks up, “Lottie, I’ve noticed you’re navigating back and forth to the Analysis Settings panel. Would you like me to create a macro for this?”

“Yes, that’d be great,” you reply, surprised at how quickly JAWS anticipates these needs. It assigns a simple command, Control-Alt-S, making it even easier for you to access the settings. With each task, JAWS quietly observes, creating personalized shortcuts and learning how to refine your workflow without interrupting your focus.

Your screen reader feels less like a tool and more like an assistant that adapts to your habits, reducing unnecessary actions and helping you move seamlessly between applications. You take a moment to appreciate the leap from manually scripting these shortcuts to having them generated in real-time, tailored perfectly to your unique style.

Dynamic Accessibility Adjustment: Visual Recognition on the Fly

Halfway through the day, you open a report in a new format. The document is packed with complex graphics, diagrams, and untagged elements—historically a nightmare for accessibility. But JAWS, equipped with advanced AI-powered visual recognition capabilities, is ready.

“Diagram detected: This appears to be a bar graph comparing quarterly performance,” JAWS announces, automatically analysing the content. “Would you like a detailed audio description, or should I just provide the key values?”

“Let’s go with the key values,” you respond, eager to save time. In seconds, JAWS summarizes the data, translating it into accessible content without needing additional third-party support. When you encounter z buttons in another application, JAWS instantly identifies them and provides real-time labels, adjusting the accessibility on the fly.

The thought crosses your mind how revolutionary this is. You’ve moved past needing someone else to make documents or software accessible for you. Instead, your screen reader adapts and scripts the solution independently, as if it’s actively learning how best to support you.

A Collaborative Community of Scripts

As the day wraps up, JAWS asks, “Lottie, would you like to share the custom scripts I created for ResearchHub with the community repository? Other users might find them useful.”

“Yes, please,” you reply. Knowing that the scripts you and JAWS have tailored today could now benefit others brings a sense of community to your day. In the past, each user’s customization stayed personal, but today, JAWS’ community sharing feature allows anonymized scripts to be uploaded to a shared repository, where other users can download them for similar applications. This feature isn’t just a convenience—it’s a small way to contribute to something larger than yourself.

You smile, thinking about the ripple effect of this community effort. As JAWS users across industries contribute their self-generated scripts, the database grows, improving access for everyone.

Reflecting on Progress: A New Kind of Independence

As you finish your work, JAWS reads aloud your notifications, wrapping up your day with a recap. You reflect on how far technology has come since those early days of assistive devices. Back then, using a screen reader required you to work around its limitations, painstakingly scripting or finding ways to access inaccessible software. Today, your screen reader does the heavy lifting, allowing you to focus on your work without the constant barrier of inaccessible content.

Looking back, you remember those initial frustrations, the hours spent tinkering with manual scripts, and the reliance on tech support for inaccessible programs. Now, JAWS’ AI-powered self-scripting has not only given you more control but also reinforced your independence. It’s not just a tool—it’s a partner in productivity.

As you power down, you realize that technology has not replaced your determination; it has amplified it. JAWS has become a proactive assistant, predicting your needs, adjusting to your habits, and making the inaccessible accessible. With the day’s tasks complete, you feel a renewed sense of autonomy—knowing that the tools at your fingertips truly work for you, enhancing not just your productivity but your entire work experience.

The screen fades to black, and the AI’s voice recedes, leaving you with a quiet appreciation for a world where technology supports your strengths, not your limitations.

#Accessibility #AccessAssistive #AI #AssistiveTechnology #Blind #Disability #JAWS #ScreenReader

Hey fellow #BlindMastodon users! I'm looking for recommendations on two types of writing tools for Windows:

1. Accessible text expanders
2. Word prediction software

I use both #JAWS and #NVDA screen readers. I tried Espanso (an open-source text expander), but it didn't work well with NVDA. I also tested Lightkey for word prediction, but it didn't seem accessible.

As an #ActuallyAutistic person, word prediction would really help with my autism-related communication challenges.

Have you found any text expanders or word prediction tools that work well with screen readers? What has your experience been like? I'd love to hear your recommendations and thoughts!

#Accessibility #AssistiveTechnology #TextExpander #WordPrediction #ScreenReader #Windows #AutismAccommodations #autism #blind @mastoblind @main

It’s no secret that many of us in the blind community have embraced the rapid advances in Artificial Intelligence over the past two years. We've witnessed firsthand how these technologies can be a powerful force for good, especially within our community. AI-generated image descriptions have revolutionized how we navigate the online world, offering a perspective previously unimaginable. This impact is now undeniable, transforming how we interact with the world.”

I’ve declared the kingdom of the blind a republic—perhaps prematurely, but only by a small margin. With AI empowering us to perceive the digital world in new ways, we are no longer ruled by limitations, but actively shaping our future. Anthropic’s recent launch of ‘computer use’ marks the first steps into a new phase of AI evolution—one where AI agents begin to act independently on our behalf, initiating a shift in how we interact with technology.

As AI continues to evolve, so too will the Assistive Technology that many of us depend on. I envision a future where this intelligence becomes a true companion, guiding us seamlessly through both digital landscapes and real-world challenges. We may be just two years away from seeing JAWS, NVDA, or SuperNova transform into true Assistive Intelligence 1.0—or perhaps it will take a little longer. If AI has taught us anything, it’s that progress comes both more slowly than we expect and faster than we can possibly imagine.

What follows is my first attempt at describing how a screen reader of today could take the first steps towards becoming an Assistive Intelligence. If anyone wants to build it, I’d love to help if I can. Whatever you think, let me know what you think:

“Proposed AI-Powered Self-Scripting Feature for JAWS Screen Reader

Objective
The suggested feature seeks to integrate advanced AI-driven "computer use" capabilities, like those developed by Claude (Anthropic), into the JAWS screen reader. This functionality would enable JAWS to autonomously create and refine custom scripts in response to real-time user interactions and application environments. The aim is to enhance accessibility and productivity for visually impaired users, especially when navigating non-standard or otherwise inaccessible software interfaces.

Feature Description
The self-scripting capability would empower JAWS to analyse user interactions with applications, identify recurring actions or inaccessible elements, and generate scripts that optimize these processes. By enabling JAWS to perform this autonomously, users gain seamless and personalized access to applications without manual intervention, allowing for an enhanced, efficient experience.

The self-scripting feature will be powered by the following core functions:

1. Real-Time Autonomous Scripting: JAWS would use AI to observe user interactions with applications, especially non-accessible ones, and automatically generate scripts that improve navigation, label untagged elements, and streamline frequent tasks. For example, if a user frequently navigates to a particular form field, JAWS could create a shortcut to this area.

2. Adaptive Behaviour Learning: This feature would allow JAWS to recognize patterns in a user’s interactions, such as repeated actions or commonly accessed elements. JAWS would adapt its behaviour by creating custom macros, enabling faster navigation and interaction with complex workflows.

3. Dynamic Accessibility Adjustment: Leveraging Claude’s approach to visual recognition, JAWS could interpret visual elements (like buttons or icons) and provide instant labelling or feedback. This would be valuable in software with minimal accessibility features, as it enables JAWS to make live adjustments and effectively “teach itself” how to navigate new environments.

4. Community Script Sharing: Self-generated scripts, once verified, could be anonymized, and made available to other users via a shared repository. This would foster a collaborative environment, empowering users to contribute to a broader database of accessibility scripts for applications across various industries.

Value Proposition
This feature will address key challenges for visually impaired users, including the complexity of navigating inaccessible interfaces and the time-consuming nature of repetitive tasks. The ability for JAWS to generate its own scripts autonomously would mean:
1. Increased Accessibility: Improved interaction with non-accessible software interfaces.
2. Higher Productivity: Reduced need for external support or manual scripting, allowing users to accomplish tasks more independently.
3. Enhanced User Experience: Scripting and macro creation based on personal usage patterns -- leads to a more intuitive and personalized experience.

Technical Considerations
1. Performance: Processing real-time visual and user interaction data requires substantial computing power. A cloud-based model may be optimal, offloading some processing requirements and ensuring smooth, responsive performance.
2. Safety: Automated scripting must be closely monitored to prevent unintended interactions or conflicts within applications. Integration of safeguard protocols and user settings to enable/disable autonomous scripting will be essential.
3. Privacy: To ensure user data is protected, anonymization protocols and data privacy standards will be implemented. Data collected from user interactions would be handled in compliance with rigorous privacy standards, safeguarding user preferences and behaviour.

Conclusion
Integrating AI-powered self-scripting capabilities into JAWS would represent a significant leap in screen reader technology. By allowing JAWS to, when requested, autonomously learn, adapt, and script in response to user needs, this feature could provide visually impaired users with unprecedented control and flexibility in navigating digital environments, fostering both independence and productivity. The anticipated benefits underscore the feature’s potential to redefine accessible technology, turning screen reader into Assistive Intelligence.“

About the Author:

Lottie is a passionate advocate for the transformative potential of AI, especially within the blind and visually impaired community. She blends technical insights with a keen awareness of lived experiences, envisioning a future where AI doesn’t just assist but truly empowers. Her thoughtful reflections explore the shift from a "kingdom of the blind" to a republic, where emerging technologies like AI create new opportunities for autonomy and inclusion.

With a balance of optimism and critical realism, Lottie acknowledges the game-changing impact of AI tools like image descriptions while recognizing that more progress is needed. Her vision extends to the idea of "Assistive Intelligence," where screen readers like JAWS evolve into proactive companions, adapting to users' needs in real-time.

Known for turning complex ideas into actionable blueprints, Lottie is not just an observer of technological trends but a catalyst for innovation. Her proposals reflect a desire to elevate independence and productivity for blind users, pushing the boundaries of what's possible in assistive technology. Her insights continue to inspire conversations and shape the future of accessible tech.

I am the Blind AI, relying on AI every day to enrich my life. While my posts may occasionally benefit from AI assistance, the thoughts, perspectives, and final edits are entirely my own. AI is my tool, much like a calculator or spell-check, refining my expression but never replacing my voice.

#Accessibility #AI #AIsoftheBlind #Blind #ComputerVision #Disability #Innovation #JAWS #NVDA #ScreenReader #SuperNov

Sensitive content Click to open/close

Sensitive content Click to open/close

Tune into ACB Radio on 10/24 at 3 PM ET for the Vispero Presentation: Manage Bookmarks and Lists in Google Chrome with JAWS. We’ll show you how to bookmark a site, manage and access bookmarks, plus add an article to a reading list. Request an invitation at community@acb.org

#FreedomScientificTraining #JAWS

Tune into ACB Radio on 10/17 at 3 PM ET for the Vispero Presentation: Personalize JAWS Commands with Keyboard Manager. We’ll show you how to use Keyboard Manager to assign and manage keystrokes for commands in JAWS. Due to Hurricane Helene, we are repeating this event so everyone who would like to attend can be there. Request an invitation at community@acb.org

#FreedomScientificTraining #JAWS

Did you catch Ron's recent Freedom Scientific Training Podcast? Listeners will explore how the F6 key simplifies navigation across Word, Outlook, Excel, and PowerPoint, offering practical tips for quickly moving between different panes and boosting efficiency. The Power of the F6 Key in MS Office Products: freedomscientifictraining.libs…

#TechTips #Podcast #JAWS #FreedomScientificTraining

🌟 #Sharkvember excitement is in full swing with Freedom Scientific's **Next Big Thing** contest! Last year, the winning idea was all about AI-generated image descriptions—a game-changer for accessibility! 🎉🤖 This year, the competition's fierce, and it's anyone's guess what brilliant idea will take the crown. Will it be another AI marvel, or perhaps something totally unexpected? 🤔✨

Submissions are in soon, and on November 19th, finalists will showcase their visionary ideas for JAWS and ZoomText. I can't wait to see the creativity and innovation at play this year! 😍💡 The thrill of seeing our accessibility tools evolve is so inspiring. We might just see new features that transform how blind and low-vision users interact with the world! 🌐👀

Catch the live event and let’s cheer for these pioneers pushing the boundaries of tech! #NextBigThing #Accessibility #JAWS #ZoomText #Sharkvember2024 🦈💙

Did you catch the recent ACB Vispero Presentation - Use Text Processing Settings to Customize How JAWS Reads Text? In case you missed it, the archive is now available: acb-community.pinecast.co/epis…

#FreedomScientificTraining #JAWS

Tune into ACB Radio on 9/26 at 3 PM ET for the Vispero Presentation: Personalize JAWS Commands with Keyboard Manager. We’ll show you how to use Keyboard Manager to assign and manage keystrokes for commands in JAWS. Request an invitation at community@acb.org

#FreedomScientificTraining #JAWS

Tune into ACB Radio on 9/12 at 3 PM ET for the Vispero Presentation: Use Text Processing Settings to Customize How JAWS Reads Text. We’ll show you how to use Text Processing in Settings Center to determine how JAWS reads text. This includes how to announce capitalization, identify the beginning and end of tables, announce list items, numbers, and dates, plus indicate new lines. Request an invitation at community@acb.org

#FreedomScientificTraining #JAWS

Okay just, like right off the cuff here. But why does Vispero, a company making blindness software/hardware want videos for there Big Thing thing? Why not just text? Emails? Like, what? Why? Meh, whatever. I'll submit mine I guess. I'm sure some of you know what I'm gonna suggest. Feel free to submit your own ideas, goodness knows we need more grand ideas for screen readers.

#accessibility #blind #Braille #JAWS #FreedomScientific #ScreenReader

freedomscientific.com/nextbigt…

Did you catch the recent Sight and Sound Technology webinar "Demystifying the web with JAWS?" In case you missed it, check it out now: youtu.be/d4_C6CTLr38?si=nfc0gi…

#JAWS #FreedomScientificTraining

Webinar Wednesday: Demystifying the web with JAWS

Whether you are studying, working, shopping, answering email, using social media and a whole lot of other activities, chances are that you are spending a lot...

^YouTube

Did you catch the recent ACB Vispero Presentation - Manage Messages in Gmail with JAWS? In case you missed it, the archive is now available: acb-community.pinecast.co/epis…

#FreedomScientificTraining #JAWS

20240808 Vispero–Manage Messages in Gmail with JAWS

Originally Broadcasted August 8, 2024, on ACB Media 5

^{ACB Community}

Did you catch the "20 Minute Tech Tips" episode with Elizabeth Whitaker when she demonstrated some powerful tips for searching in Gmail? Listen to the episode now: freedomscientifictraining.libs…

#FreedomScientificTraining #JAWS #20MinuteTechTips

Freedom Scientific Training Podcast: 20 Minute Tech Tips: Searching in Gmail

Listen in to our new series, 20 Minute Tech Tips. Hear Elizabeth Whitaker as she demonstrates a few powerful tips for Searching in Gmail. For more tips for transitioning from Basic HTML to Standard view in Gmail, check out our previous training:    

^{freedomscientifictraining.libsyn.com}

Did you catch the recent ACB Vispero Presentation - Five Outlook Tips for increasing Productivity? In case you missed it, the archive is now available: acb-community.pinecast.co/epis…

#FreedomScientificTraining #JAWS

20240425 Vispero Presentation–Five Outlook Tips for increasing Productivity

Originally Broadcasted April 25, 2024, on ACB Media 5

^{ACB Community}

The third edition of David Kingsbury’s popular free digital book, “The Windows Screen Reader Primer: All the Basics and More,” is coming soon! Author David Kingsbury, an Assistive Technology Instructor here at the Carroll Center, wrote this comprehensive resource to help JAWS, NVDA, and Windows Narrator users work more effectively with the most important PC applications—like Microsoft Office, email clients, and web browsers.

Join author David Kingsbury via Zoom on Thursday, April 4 at 7:30 pm ET to find out what’s new in this edition, hear a few tips and tricks, and ask your questions. Save your seat here: lnkd.in/e7ct_C8B

#Windows #Jaws #NVDA #Narrator #blind

I wrote an article about how to make hastags accessible. Did some #ScreenReader testing with #JAWS, #NVDA, #VoiceOver and #Narrator, which was fun!

Pretty long one though, contains a bunch of tables for comparison. Enjoy the ride!

stevefrenzel.dev/posts/easy-we…

#accessibility #a11y #html #JavaScript #WebDev #frontend

Easy web accessibility wins: Hashtags

Is there a way to create hashtags that work for everyone? I did some screen reader testing and was surprised by the outcome!

^{Steve Frenzel}