The Comprehension Curve

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve

Tl;Dr: You might comprehend and learn more quickly by *slowing down *your reading, rather than by *speeding it up. *This post is mainly about laying down some terminology that I think is conceptually clarifying in thinking about learning, comprehension and reading speed. Speed Reading According to Google Trends, interest in speed reading has been on a pretty steady decline since 2004. It briefly became more popular in March 2014, perhaps due to an Atlantic article published that month, on the speed reading app Spritz. Nevertheless, when a person starts thinking about "learning how to learn," speed reading is one of the natural things to investigate. Am I reading fast enough? What’s the maximum possible words per minute at which I could still comprehend the material? Couldn’t I compensate for low comprehension just by reading much, much faster? So they Google "speed reading," and resurrect the conversation. The fundamental idea of speed reading is that by reducing wasted motion in the physical eye movements involved in reading, people can dramatically increase the number of words per minute (WPM) that they can read, without sacrificing comprehension. Speed reading advocates point to evidence that speed readers show no statistically significant difference from normal readers in performance on comprehension tests. For such research to be meaningful, it needs to be executed with care. This care is generally lacking, as I describe below. Speed reading is most obviously helpful under a narrow set of conditions:

Comment

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=SGWipjYai56LdySyh

One friend of mine decided to, as an experiment, read with a 1-minute interval timer (dings every minute), and force themselves to turn the page at every ding. Depending on the book, this is very fast—quick googling suggests 500 words per minute. They didn’t expect to keep reading at such a pace; it was an experiment. But after the experiment, they decided that they much preferred reading this way, and kept it up. The lowered comprehension was greatly compensated for by the ability to get content from many many books quickly. A different friend of mine reads very slowly and thoroughly. This friend learned that many people have the experience of reading a paragraph and then realizing that they haven’t understood it, and re-reading. They were quite surprised at this, and compared it to learning that lots of people just aren’t conscious—how can you read something without comprehending it?? How can you be in the process of reading a paragraph without comprehending it, without realizing that you’re not comprehending it, for so long that you get to the end of a paragraph before you notice?? If the first friend wrote a book on reading, it might look similar to other books on speed reading (although I’d expect it to be many times better than the usual). If the second friend wrote a book on reading, it would be a book on slow reading. It might involve stopping after every paragraph and seeing if you agree with the author’s conclusions. It might involve looking up a lot of reference material in other books, before you’ve even gotten very far in the book you’re trying to read. It might involve taking copious notes. By the time you finish a book, you might be able to re-write it yourself, but better. I think I could very roughly put friends on a spectrum from speed reading to slow reading. The speed readers would generally have the characteristic of a broad knowledge base. They would bring in impressive amounts of knowledge to any conversation. However, if you want detail on subjects, you’ll often stump them. Their knowledge is shallow. They’ll often have to send you to read some paper or other to answer the questions they can’t answer themselves. And the papers often won’t back up their summaries because they read the paper only shallowly, and more or less trusted the abstract—which, often, aren’t an accurate summary of what’s in the paper. The slow readers would be the careful thinkers. They have a deep knowledge base, with fractal detail. If they read a paper, they can tell you what’s wrong with the abstract, and what they think the real conclusions are. They won’t settle for outside-view knowledge of anything; they require a gears-level understanding before they consider themselves to have learned something. There’s almost no ceiling to what you can understand from a given text. It’s just a question of how far you care to go. So, in addition to raw comprehension rate, there’s also what kind of knowledge you want to foster. This probably varies from text to text. In some cases it’s best to absorb a broad base of material rapidly. In other cases it’s more useful to get a really detailed understanding, questioning all of the author’s conclusions, working through everything yourself.

Comment

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=rqRqJM4gFQng9czcg

So, in addition to raw comprehension rate, there’s also what kind of knowledge you want to foster. This probably varies from text to text. In some cases it’s best to absorb a broad base of material rapidly. In other cases it’s more useful to get a really detailed understanding, questioning all of the author’s conclusions, working through everything yourself. I tried to take a stab at when to do which model in this post.

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=CvnmJ4aqEdT3eBkTS

I am a slow reader compared to most people I know, and have occasionally looked into speed reading to try to remedy this. I was surprised about your description of speed reading as "eye technique", because although I’ve seen this sort of thing, I’ve also seen mental processing advice. If someone asked me to quickly summarize what I know about speed reading, I would have said "Speed reading guides usually say that you have to stop turning the words into imaginary auditory signals in a mental voice; this forces you to slow down, as you first convert the letters to mental sounds, and then convert the sounds to meaning. Instead, you should interpret the letters directly into words and meaning, without involving the auditory cortex." (I’ve never succeeded in doing this, but it’s led me to practice EG repeating nonsense words in my head while I read, to try and force myself not to use auditory processing.) Anyway. I think it’s important to point out the difference between optimal comprehension per character vs optimal comprehension per second. A natural hypothesis to me (alternate to your natural pace hypothesis) is that people intuitively optimize comprehension per character, because it’s more salient (they’re not watching the clock as they read, after all). On this hypothesis, most people will be a bit too low on the comprehension curve, because they aren’t automatically optimizing for that. Either way, I find it *a priori *very plausible that people aren’t at max reading skill automatically, and can benefit from focused practice. Although I haven’t noticed marked improvements, myself. I definitely endorse your re-framing in terms of optimizing comprehension rate rather than raw reading speed. One of the most subjectively helpful frames (which I got from someone at a LessWrong meetup) was that speed reading is about optimizing information absorbtion. Notice when you already get what the author is trying to say. If you have a guess about what argument the next paragraph is going to make, spot-check your guess by reading a few phrases; if they’re consistent with your expectations, you can probably skip ahead. Lots of people sort of "cargo cult" reading books, by reading the whole thing in order. It’s often more efficient to skip around and find the information you actually want. I think part of what’s going on is that speed-reading advocates know this, and are really advocating techniques which encourage people to skip over things. For example, you mention:

  • Regressions: how often the eye travels to an earlier point in the text. Avoiding regressions means you avoid re-reading stuff you just passed over. I re-read all the time, when I didn’t really get what was said. Someone who advocates avoiding regressions is implicitly telling me: "Oh, you know what they said. You’re probably re-reading just to check. Even if you misunderstood something, you’ll probably be able to figure out what’s really going on based on the next paragraph." Which is not necessarily true. Or, even if true, is not necessarily optimal information absorbtion (because the risk of misunderstanding is pretty high with this sort of skimming). In other words, I reject the idea that "eye technique" is really what it purports to be—better general eye technique for reading. I think it’s actually implicit advice to skim more and fill in details by inference, cashed out as details about eye movements which sorta force you to do this.

Comment

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=Zurg2HwStW6ZJ5GLq

I take it as a big compliment that you wrote such a long and thoughtful reply to my post! Thank you! The distinction you draw between broad vs. deep readers is the reason I didn’t operationalize comprehension. "Comprehension" is just the type of understanding you want to extract from the text on your particular read-through, defined as you please. Maybe let’s think of them in terms of abstract units called *Comprehendalons, *analogous to a Utilon. You could define a Deep-Comprehendalon as knowing "wrong with the abstract, and what they think the real conclusions are," in which case a very slow reading speed is ideal. An ideal reading speed for Deep-Comprehendalons might be 10 wpm, or even slower, and it might take you several hours to acquire just one. A Shallow-Comprehendalon might be picking up an single atomic fact. An ideal reading speed for Shallow-Comprehendalons might be 500 wpm, or even faster, and you might be able to pick up a huge number of them in a short period of time. One thing I infer from this framework is that Shallow-Comprehendalons don’t add up to Deep-Comprehendalons. They are not fungible, not the same type of good. Optimizing for one may mean sacrificing the other. However, that seems debatable. Even if it’s true, the Comprehension Curve would still hold. You’d just have a different ideal reading speed and maximum comprehension rate for each type. Interestingly, for me, fully engaging my auditory cortex has, I believe, really helped me to move closer to my maximum comprehension rate. I’ll describe this in a future post. One of my motivations for writing this is that I think that speed reading advocates are doing something fundamentally good—experimenting—but doing it in a screwy way, where they invent a whole theory of why their method is the best, without exploring contrasting hypotheses. And then when sober scientists get to studying it, they approach the field by testing the claims of speed readers, rather than by reflecting a priori on what approach to learning ought to enhance comprehension. The latter is what I’ve tried to advance toward here. I appreciate you bringing up the point that much of speed reading advice revolves not around eye technique, but around mental technique—the bypassing of the auditory cortex. That’s true, and I just entirely left that out for no good reason. I’m going to edit the OP to include a reference to it, along with a credit to you for reminding me of it. One of my future posts will discuss what I’ve noticed in regards to skimming. I’ll sum it up for you, as practice and since you brought it up. Let’s consider the following sentence from a biochemistry textbook: "Oxidative reactions of the citric acid cycle generate reduced electron carriers that are then reoxidized to drive the synthesis of ATP." For someone like myself who’s familiar with biochemistry, many of the individual words and phrases refer to concepts that I already understand well. But there are particular keywords within the sentence that "focalize" a new concept, build out of the others. Let me break down my experience reading it:

  • "Oxidative reactions"—the word oxidative is key, and "contains" the concept of a reaction within it.

  • "of the citric acid cycle"—*citric *is key, and automatically refers to "citric acid cycle"

  • "generate reduced electron carriers"—*reduced *is key, and "generate" is implied by the connection between "citric [acid cycle]" and "reduced"

  • "that are then reoxidized"—*reoxidized *is key

  • "to drive the synthesis of ATP."—ATP is key, because I already know that the end result is to synthesize, rather than consume ATP. So as I read this sentence, the words "oxidative," "citric," "reduced," and "ATP" get lodged in my working memory, repeated in my auditory cortex in a sort of earworm-like jingle. While they repeat, my eyes scan the rest of the words to observe how they link up. So I read with a two-layered awareness: the working memory jingle-words that isolate and relate the key concepts, and the non-auditory connecting words that give them meaning and relate them together. This is just the approach to reading that I’m playing with right now, and I make no claim that it’s useful or ideal for myself or anybody else. But it’s an interesting riff on skimming and speed reading. Instead of divorcing myself from my auditory cortex, I use it for keywords only, while relying on non-auditory reading for connecting words, which I can largely skim through. The only way to develop ideas like this is to experiment openly, with a goal not of reading quickly, but of being experimental with your approach and trying to intuitively feel your way toward a method that is satisfying and feels like you’ve comprehended the material well. I find that this approach makes it far easier to pay nuanced attention to the material, read for long stretches of time without fatigue, and relate concepts.

Comment

Imagine for the sake of argument that we’re happy to just absorb information, with no topic prioritization; we just want our map to get closer to the territory. There’s still the question of exactly what our loss function is: how much do we like being a specific distance from the truth? Our loss function could be more like Bayes loss, which punishes overconfidence highly (assigning probability close to zero for an event which actually is true gets us an arbitrarily bad score); or, it could be more like Brier score (which caps the amount you can lose for any particular wrong idea). I think deep readers are more like Bayes-score maximizers: skimming the abstract and getting wrong information feels like a big risk. No quantity of improved beliefs can necessarily compensate for one mistake, because mistakes can be arbitrarily bad. A bayes-score maximizer skimming something is conscious of exactly how many grains of salt go with each thing learned, because getting that wrong can be very costly—so they would feel a need to remember "I was speed-reading this, so I should doubt all my conclusions about it a little bit more". Broad readers are more like Brier-score maximizers: skimming the abstract and getting a wrong conclusion is only a bounded risk, so it’s easily balanced by the benefit of lots of knowledge. They don’t feel an overwhelming need to count grains of salt, because 95% wrong is not that different from 100% wrong; so they happily accept a bunch of noisy information in, without worrying too much about careful tabulation of the noise. I don’t have too many intuitions about when Bayes score or Brier score will be closer to our true utility-of-knowledge functions. But I suspect deep reading is more useful for the kind of research where you’re trying to generate really new things, like totally new hypotheses or new areas of mathematics. Whereas broad reading may be more useful for "applied" type research, where you’re taking existing knowledge and using it in new areas.

Comment

If we assume that the accuracy improvements to researching a given question are logarithmic, then it would make sense to read broadly on unimportant questions and read deeply on crucial questions. Signaling also seems relevant here. It might be advantageous to be widely informed, or to be seen as the kind of person who only speaks on their domain of expertise. There could also be times when you just need to be conversant in the subject enough to know who to delegate the deeper research to. So in general, I would expect the value of broad vs. deep research to be highly contextual. But I wonder if the same habits that may lead people to anchor on an inappropriate reading speed also lead them to anchor on a sometimes inappropriate reading depth. It’s plausible to me that people who tend to read broadly by habit could reap significant gains by practicing deep reading on even an arbitrary subject, and vice versa. It would be interesting if there was an equivalent to the DSM, but for reading habits. Could we imagine a test or a set of diagnostic criterion that could classify people both according to their level of reading proficiency, and also according to their habitual level of depth/​breadth? So for example, a low-skill but deep reader might be a religious fundamentalist who has their text of choice practically memorized, yet who has very little familiarity with the nuances of interpretation. By contrast, we can imagine low-skill broad readers, who read all kinds of novels and newspapers but remember very little of it. And high-skill broad or deep readers, of course. I think this is related to one of my perennial topics of interest, which is the path toward a specialization. A science student in undergrad or earlier reads broadly about science. At some point, if they continue on a scientific path, they eventually focus on a much narrower area, and their whole reading program focuses on acquiring knowledge that they perceive as directly useful to a specific research project. As I’ve graduated into this phase, I’ve found that the deep, related, specialized, purposeful reading is vastly more satisfying than the broad, shallow, disconnected reading that came before. It makes me suspect that one reason people get turned off of science early is that they never get the experience of "cocooning" in a specialty in which all the articles you read are riffing off each other, interrelated, and building toward a goal. It’s the closest thing that I’ve found to programming, which also entails building an interrelated construct to make predictions and do useful work. I’m also interested in whether and how "broad reading" can be done with an equivalent sense of purpose. There’s an article on Applied Divinity Studies, Beware the Casual Polymath, which I think can be characterized as a criticism of superficially high-skilled, but in fact low-skilled broad readers. It’s pointing out that just because you’re reading all kinds of Smart People Stuff doesn’t mean that you’re actually learning effectively. I would imagine that a high-skilled broad reader would be somebody who has a role that involves lots of delegation and decision-making. The fictional example that comes to mind is a member of the Bartlett senior staff in the West Wing, who have to understand a huge number of issues of national significance, but only just enough to know who to delegate to or what positions are at least not-insane. For them, making reasonable, if not necessarily perfectly optimized, choices, but making a decision, is much more important than getting the exact right answer. So I would describe them as a depiction of a high-skilled, broad reader.

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=mAfHzPd8FubiYafq7

When I was a child learning to read, most of the things I was reading were pretty easy to understand. I was clever and a good learner, and my natural way of reading is very quick, about 1000wpm for reasonably straightforward material. But I am no longer a child, and many of the things I want to read are not nearly so easy to understand (mostly because I want to read textbooks and technical papers and dense novels and so forth; probably also because at 50 I am less clever than I was at, say, 20). The techniques I acquired naturally when learning to read are a bad match for much of my actual reading, and if I want to understand things I need to go out of my way to slow things down. I suspect the story in the paragraph above could be told with equal truth by many people around here. As well as providing some confirmation for what AAB says about comprehension rate versus reading rate, I think this suggests that the idea of thinking of speed-reading techniques as "eye technique" that are likely to be helpful to everyone might be too optimistic. I would guess that the way I read quickly is similar to the way in which "speed readers" read quickly, mechanically at least, but unfortunately it gives me not only the ability to read quickly but also the habit of reading quickly. If I sit down to read something, the pattern in which my eyes naturally move is one that works well for stuff I can assimilate easily, and doesn’t work so well for stuff I have to think harder about as I read. I suspect that in order for "eye technique" to be useful it has to become habitual, and I suspect that "eye technique" that’s useful for reading quickly is systematically anti-helpful for reading slowly and deliberately. (But, for the avoidance of doubt, all of this is conjecture. I haven’t studied "speed reading" techniques, I haven’t compared them with how I read, I don’t know whether if I went about it the right way I could make my fast-reading habits more optional, I don’t know whether other people using similar techniques would form the same habits as mine, etc., etc., etc.)

Comment

https://www.lesswrong.com/posts/bxkEshxKnRde97bmW/the-comprehension-curve?commentId=onBtHJhnZsbsGT3TH

The part about habitual speed rings true to me. I am slowly working my way through the Bermúdez textbook on cognitive science and find that my brain "wants" to read at a customary pace, which is too fast for comprehension of a subject I’m relatively unfamiliar with (haven’t touched a science textbook since high school).

Forcing myself to slow down gut-feels like going under the speed limit in the far-left lane on the interstate, like wasting time, even though I conscious-know it’s approximately infinity times more important to understand the text than it is to be able to truthfully say that I did "reading" on all the words in it.