Then why not just read the summary of the plot on Wikipedia? It's not about the nuances or the details, it's about actually taking the book versus knowing what the plot is about. The voice of the author matters, and if you're not getting that through a rewrite you're not getting the book as written.

Additionally, literature is one of the most effective ways we have of bettering our feel for a language, and expanding our comprehension and ability. This is even more true for second language acquisition.

There was a famous Hungarian interpreter in the 20th Century who claimed reading books was almost all she did to acquire languages. You just skip over the words you don't know, until after seeing it many times you get an "aha!" moment and work out what it means (and if it doesn't come up again then maybe it's just not that important?). She wrote about it in this book.

If you were to rewrite the text to remove the words completely you're depriving yourself from ever being able to improve your language, all the while sapping the colour and joy out from the words.

As for dyslexia, I don't have much experience with that but I do have with ADHD and getting distracted while reading, and have found audiobooks to be indispensable. I find them harder in foreign languages than my native, but that usually means I end up listening at 1x the speed rather than 2,5x the speed. I used to struggle getting through many books since leaving school until I could listen to them.