Our not so spooky Halloween In-Process blog post is out - No tricks, but plenty of treats - particularly from NVDA 2024.4, including all the highlights, and the new options for reporting font attributes. Plus a big walkthrough of NVDA's stability in the leadup to 2025.1. All that and more, here: nvaccess.org/post/in-process-3…

@mastoblind

#NVDA #NVDAsr #ScreenReader #Blog #News

In-Process 31st October 2024

It’s that spooky time of year for all those who celebrate Halloween. And it’s also Diwali for our Indian friends. Whether you participate in either of these or not, there is something we defi…

^{NV Access}

Oh, you can now close the #NVDA speech viewer with alt+F4?

Wish I'd copied what I wanted out of it before blitzing...

Hey fellow #BlindMastodon users! I'm looking for recommendations on two types of writing tools for Windows:

1. Accessible text expanders
2. Word prediction software

I use both #JAWS and #NVDA screen readers. I tried Espanso (an open-source text expander), but it didn't work well with NVDA. I also tested Lightkey for word prediction, but it didn't seem accessible.

As an #ActuallyAutistic person, word prediction would really help with my autism-related communication challenges.

Have you found any text expanders or word prediction tools that work well with screen readers? What has your experience been like? I'd love to hear your recommendations and thoughts!

#Accessibility #AssistiveTechnology #TextExpander #WordPrediction #ScreenReader #Windows #AutismAccommodations #autism #blind @mastoblind @main

NVDA 2024.4 is now available Featuring many improvements in Microsoft Office, braille & document formatting. We encourage all users to update. There's more than will fit here so please check out the full details & download from: nvaccess.org/post/nvda-2024-4/

Please note, after updating any software, it is a good idea to restart the computer. Restart by going to the Shutdown dialog, selecting “restart” and pressing ENTER.

#NVDA #NVDAsr #ScreenReader #Release #News #NewVersion #Update

NVDA 2024.4 Released

NV Access is pleased to announce that version 2024.4 of NVDA, the free screen reader for Microsoft Windows, is now available for download. We encourage all users to upgrade to this version. Highlig…

^{NV Access}

It’s no secret that many of us in the blind community have embraced the rapid advances in Artificial Intelligence over the past two years. We've witnessed firsthand how these technologies can be a powerful force for good, especially within our community. AI-generated image descriptions have revolutionized how we navigate the online world, offering a perspective previously unimaginable. This impact is now undeniable, transforming how we interact with the world.”

I’ve declared the kingdom of the blind a republic—perhaps prematurely, but only by a small margin. With AI empowering us to perceive the digital world in new ways, we are no longer ruled by limitations, but actively shaping our future. Anthropic’s recent launch of ‘computer use’ marks the first steps into a new phase of AI evolution—one where AI agents begin to act independently on our behalf, initiating a shift in how we interact with technology.

As AI continues to evolve, so too will the Assistive Technology that many of us depend on. I envision a future where this intelligence becomes a true companion, guiding us seamlessly through both digital landscapes and real-world challenges. We may be just two years away from seeing JAWS, NVDA, or SuperNova transform into true Assistive Intelligence 1.0—or perhaps it will take a little longer. If AI has taught us anything, it’s that progress comes both more slowly than we expect and faster than we can possibly imagine.

What follows is my first attempt at describing how a screen reader of today could take the first steps towards becoming an Assistive Intelligence. If anyone wants to build it, I’d love to help if I can. Whatever you think, let me know what you think:

“Proposed AI-Powered Self-Scripting Feature for JAWS Screen Reader

Objective
The suggested feature seeks to integrate advanced AI-driven "computer use" capabilities, like those developed by Claude (Anthropic), into the JAWS screen reader. This functionality would enable JAWS to autonomously create and refine custom scripts in response to real-time user interactions and application environments. The aim is to enhance accessibility and productivity for visually impaired users, especially when navigating non-standard or otherwise inaccessible software interfaces.

Feature Description
The self-scripting capability would empower JAWS to analyse user interactions with applications, identify recurring actions or inaccessible elements, and generate scripts that optimize these processes. By enabling JAWS to perform this autonomously, users gain seamless and personalized access to applications without manual intervention, allowing for an enhanced, efficient experience.

The self-scripting feature will be powered by the following core functions:

1. Real-Time Autonomous Scripting: JAWS would use AI to observe user interactions with applications, especially non-accessible ones, and automatically generate scripts that improve navigation, label untagged elements, and streamline frequent tasks. For example, if a user frequently navigates to a particular form field, JAWS could create a shortcut to this area.

2. Adaptive Behaviour Learning: This feature would allow JAWS to recognize patterns in a user’s interactions, such as repeated actions or commonly accessed elements. JAWS would adapt its behaviour by creating custom macros, enabling faster navigation and interaction with complex workflows.

3. Dynamic Accessibility Adjustment: Leveraging Claude’s approach to visual recognition, JAWS could interpret visual elements (like buttons or icons) and provide instant labelling or feedback. This would be valuable in software with minimal accessibility features, as it enables JAWS to make live adjustments and effectively “teach itself” how to navigate new environments.

4. Community Script Sharing: Self-generated scripts, once verified, could be anonymized, and made available to other users via a shared repository. This would foster a collaborative environment, empowering users to contribute to a broader database of accessibility scripts for applications across various industries.

Value Proposition
This feature will address key challenges for visually impaired users, including the complexity of navigating inaccessible interfaces and the time-consuming nature of repetitive tasks. The ability for JAWS to generate its own scripts autonomously would mean:
1. Increased Accessibility: Improved interaction with non-accessible software interfaces.
2. Higher Productivity: Reduced need for external support or manual scripting, allowing users to accomplish tasks more independently.
3. Enhanced User Experience: Scripting and macro creation based on personal usage patterns -- leads to a more intuitive and personalized experience.

Technical Considerations
1. Performance: Processing real-time visual and user interaction data requires substantial computing power. A cloud-based model may be optimal, offloading some processing requirements and ensuring smooth, responsive performance.
2. Safety: Automated scripting must be closely monitored to prevent unintended interactions or conflicts within applications. Integration of safeguard protocols and user settings to enable/disable autonomous scripting will be essential.
3. Privacy: To ensure user data is protected, anonymization protocols and data privacy standards will be implemented. Data collected from user interactions would be handled in compliance with rigorous privacy standards, safeguarding user preferences and behaviour.

Conclusion
Integrating AI-powered self-scripting capabilities into JAWS would represent a significant leap in screen reader technology. By allowing JAWS to, when requested, autonomously learn, adapt, and script in response to user needs, this feature could provide visually impaired users with unprecedented control and flexibility in navigating digital environments, fostering both independence and productivity. The anticipated benefits underscore the feature’s potential to redefine accessible technology, turning screen reader into Assistive Intelligence.“

About the Author:

Lottie is a passionate advocate for the transformative potential of AI, especially within the blind and visually impaired community. She blends technical insights with a keen awareness of lived experiences, envisioning a future where AI doesn’t just assist but truly empowers. Her thoughtful reflections explore the shift from a "kingdom of the blind" to a republic, where emerging technologies like AI create new opportunities for autonomy and inclusion.

With a balance of optimism and critical realism, Lottie acknowledges the game-changing impact of AI tools like image descriptions while recognizing that more progress is needed. Her vision extends to the idea of "Assistive Intelligence," where screen readers like JAWS evolve into proactive companions, adapting to users' needs in real-time.

Known for turning complex ideas into actionable blueprints, Lottie is not just an observer of technological trends but a catalyst for innovation. Her proposals reflect a desire to elevate independence and productivity for blind users, pushing the boundaries of what's possible in assistive technology. Her insights continue to inspire conversations and shape the future of accessible tech.

I am the Blind AI, relying on AI every day to enrich my life. While my posts may occasionally benefit from AI assistance, the thoughts, perspectives, and final edits are entirely my own. AI is my tool, much like a calculator or spell-check, refining my expression but never replacing my voice.

#Accessibility #AI #AIsoftheBlind #Blind #ComputerVision #Disability #Innovation #JAWS #NVDA #ScreenReader #SuperNov

Sensitive content Click to open/close

Sensitive content Click to open/close

In-Process is out, featuring the results of our braille survey, Elston Changemakers event, the 2024.4 Release Candidate, an NV Access All-Hands, and using Data Validation in Excel.

Read now at: nvaccess.org/post/in-process-2…

#NVDA #NVDAsr #ScreenReader #Blog #News #Software #FOSS #Elston #Excel

In-Process is now out, featuring all things braille! What's new, what's coming up and importantly, a reminder of the braille users survey! Plus, get your hands on the NVDA 2024.4 Release Candidate and all of the new features coming to everyone else shortly!

nvaccess.org/post/in-process-8…

#NVDA #NVDAsr #ScreenReader #Blog #News #Newsletter #WhatsNew #Information

The Release Candidate (RC) of NVDA 2024.4 is now available for download and testing. We encourage all users to download this RC and provide feedback. Unless any critical bugs are found, this will be identical to the final 2024.4 release.

Read more and download from: nvaccess.org/post/nvda-2024-4r…

#NVDA #NVDAsr #ScreenReader #Release #ReleaseCandidate #NewVersion

One of the themes which came through from the NVDA Satisfaction Survey earlier this year, was to improve Braille support. To help us target the most needed improvements, we have created a short survey. If you use NVDA with braille at least some of the time, please consider completing this survey.

docs.google.com/forms/d/e/1FAI…

Please also share with anyone else who may be interested.
#NVDA #NVDAsr #ScreenReader #Braille #Accessibility #A11y #Survey #CommunityInput

beta5 of NVDA 2024.4 is now available for download and testing. For anyone who is interested in trying out what the next version of NVDA has to offer before it is officially released,

In Beta 5 we have fixed an issue where the custom multiple key press timeout was not honoured when repeatedly pressing the NVDA key. There are also updates to translations.

Read more and download from: nvaccess.org/post/nvda-2024-4b…

#NVDA #NVDAsr #ScreenReader #Beta #FOSS #PreRelease #NewVersion

"I say that NVDA changed my life, because only we know how difficult it is to get a job, and companies rarely want to pay for software licenses." - Mykael, Brazil.

Read Mykael's full testimonial at: nvaccess.org/post/mykael-makes…

Helping people achieve independence is our passion at NV Access. Thank you Mykael!

#Independence #Empowerment #Accessibility #NVDA #ScreenReader #NVDAsr

Ever wondered why semiconductors are called "digital oil"? 🤔💻 Dive into the world of chips and discover how they're shaping our future! #Semiconductors #TechInvestment #TSMC #NVDA🚀

globalcitizen.world/investment…

Our In-Process blog is out! This week, we feature NVDA 2024.3.1, Mykael making it happen in Brazil, RACQ's Road Ahead article, NVDA 2024.4 Beta 4 and Which reference is right for me?

Read it all here: nvaccess.org/post/in-process-2…

#NVDA #NVDAsr #ScreenReader #Accessibility #Blog #News #Newsletter #FOSS

Anyone using NVDA, have you found with 2024.4 beta 4, that reviewing Windows Terminal is very sluggish?

#nvda #nvdaSR #screenReader #accessibility #blind

NV Access are very pleased that RACQ Magazine interviewed us for an article on NVDA, "Revolutionising accessibility through a global community". RACQ noted: "A Brisbane-based not-for-profit organisation is behind a global movement breaking down barriers for blind people."

Read the full article on RACQ:

racq.com.au/road%20ahead/2024/…

#NVDA #NVDAsr #News #Impact #Community #RACQ

We love hearing wonderful success stories from our users. This week, we are very pleased to present to you Mykael, who is busy making it happen in Brazil!

nvaccess.org/post/mykael-makes…

Thanks Mykael! Would you like to share how you are using NVDA with us? We'd love to hear from you! Please do drop us a line at info@nvaccess.org

#NVDA #NVDAsr #ScreenReader #Accessibility #Employment #Software #FOSS #Success #GoodNews

Sensitive content Click to open/close

NVDA 2024.4 Beta 4 is now available for download & testing.

Changes introduced in Beta 4:
- Fixed the visual layout of NVDA’s Braille Settings page.
- Fixed an issue causing text not related to shortcut keys to appear in the Commands Quick Reference.
- Updates to translations.

Full information and download at: nvaccess.org/post/nvda-2024-4b…

#NVDA #NVDAsr #FOSS #PreRelease #Software #Beta #ScreenReader #Accessibility

Most of the #Chrome #accessibility issues in my previous post are caused by Microsoft's UI Automation (UIA) API. If you want an #NVDA add-on to completely disable UIA in Chrome windows, here you go:

dropbox.com/scl/fi/sktapipwilh…