11

macOS has a variety of apps like Homerow, Shortcat, and KindaVim (watch the videos in those links if u can) that allow for navigation of apps using just the keyboard. Homerow allows for pressing a hotkey and then showing letters over UI elements which can be entered to move the mouse to said element, similar to the Vim easymotion plugin. KindaVim attempts to implement vim modal navigation inside GUI apps, so you can enter normal or visual mode and use j and k to move up or down. They all work using macOS' accessibility API which exposes UI elements for programmatic interaction.

I did a bunch of searches for Linux equivalent of such apps and Mac's accessibility API, and didn't find anything as comprehensive. Can you navigate a wide variety of Linux apps using mostly or only the keyboard (apps made with GTK, Electron, etc.)? Is it currently possible to develop an equivalent of the apps listed above?

top 2 comments
sorted by: hot top controversial new old
[-] azertyfun@sh.itjust.works 3 points 1 week ago* (last edited 1 week ago)

My gut feeling was that a standard accessibility protocol doesn't exist yet, but that a Wayland extension is probably the solution.

Looks like I was right: https://blogs.gnome.org/a11y/2024/06/18/update-on-newton-the-wayland-native-accessibility-project/

However that's a recent proof-of-concept, so nothing generally available at this stage. Details would have to be ironed out, changes upstreamed, the protocol extension accepted, and every graphics toolkit would have to be updated to support the protocol. Seems like a very worthy goal to pursue though and it's great to see funds allocated for a11y.

I don't know how that would work with XWayland apps, but given how clunky that gets with stuff like fractional scaling I wouldn't get my hopes up. The sooner we can native Wayland all the things, the better. X11 must die, regardless of the feeling of the graybeards on the matter.

[-] lancalot@discuss.online 2 points 1 week ago

Thanks OP; now I need this 😜.

For the last year or so, I've been using Vimium and mouseless. For the latter, I'd probably use warpd or wl-kbptr instead if I could get them to work on Fedora Silverblue.

this post was submitted on 09 Nov 2024
11 points (100.0% liked)

Linux

2354 readers
2 users here now

Shit, just linux.

Use this community for anything related to linux for now, if it gets too huge maybe there will be some sort of meme/gaming/shitpost spinoff. Currently though… go nuts

founded 1 year ago
MODERATORS