Curiosity: A Greedy Feeling

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling

> But what does the phrase "scientifically explicable" mean? It means that someone else knows how the light bulb works. - Eliezar Yudkowsky> In principle, I agree with the notion that it is unforgivable to not want to know, and not want to improve your map to match the territory. However, even the most curious person in the world cannot maintain equal curiosity about all things, and even if they could there are limits on time and energy. - Elizabeth> Rarely am I pulled by a specific desire to know. And most of my learning happens at those rare times. - Anna SalamonWhich question immediately sparks your specific desire to know?

  1. Which enzymes are directly involved in the human transcription of lactase?
  2. How do cells manufacture proteins?
  3. Which theory is the best account of abiogenesis?
  4. Is life inherently valuable?
  5. If we could grow artificial human organs, would it be possible to cure aging by periodically replacing the worn-out parts of our bodies? Without some research, I could not supply more than a rudimentary answer for any of these questions. But for me personally, #5 is the only one that sparks my curiosity. Why? The first three questions represent different strata in the lake of systematized knowledge. If I ever needed an answer, I could look up fine-grained information on each of them. The fourth question is bottomless, and I know in advance that there will be no definitive answer. None of them suggest a pressing reason I’d want to know. The last question is different. I can immediately see its practical and scholarly significance. Breaking it down into an array of tractable research questions, then determining what is known and unknown, would be an adventure. In pursuing my inquiry to the limits of scientific knowledge, I would eventually arrive at strange questions, with a void where the answers should be. I’d never normally think to ask these strange questions, nor care particularly about the answers. Now they would be imbued with the significance of my original purpose. Curiosity must have been a useful sensation for our ancestors, but a costly one. It motivates action, sometimes patterns of action that are tiring, dangerous, and require the efforts of the whole tribe. Learning is costly. So evolution shaped our curiosity into a getting feeling, a greedy feeling. What is intrinsic motivation? That makes curiosity sound like it’s fueled by extrinsic motivations, which seems counterintuitive. One definition of intrinsic motivation is:

Intrinsic work motivation is a cognitive state reflecting the extent to which the worker attributes the force of his or her task behaviors to outcomes derived from the task per se; that is, from outcomes which are not mediated by a source external to the task-person situation. Such a state of motivation can be characterized as a self-fulfilling experience. OK, this needs some unpacking. Here are two different scenarios:

  1. Imagine an ability or set of knowledge or invention or experience that would absolutely delight and amaze you *right now *if you could access it. I can think of lots of examples for myself:
  1. Pick one, and write down some ideas for how we could potentially achieve that goal, based on what you know right now. For being immortal or very long-lived, I’d write:
  1. Now start researching the efforts that are underway for #2 (almost certainly, there are some) and try to figure out which seems most practical. Keep a sense of all the sub-questions you might have about your original imagination. Do you need to investigate deeper into one of them, or transition to fleshing out your knowledge on a different sub-question? Always be motivated in your research by the desire to know how to do the impossible, by your desire to turn a fantasy into reality. These have a strong relationship with lukeprog’s three steps for getting curious:
  2. Feel that you don’t already know the answer.
  3. Want to know the answer.
  4. Sprint headlong into reality. But lukeprog’s writing is predicated on the idea that you feel as if you know the answer, don’t really want to know, and feel no drive to discover it. And this is all because you’ve selected an arbitrary topic—perhaps a topic life forced on you, or one your peers think is important, or one you feel you ought to be concerned with—and tried to make yourself get curious about it. If instead, you start with an imaginative vision that you’d genuinely, immediately feel very excited about if it were realized, the basic circumstances are changed. I know right from the start that I’ve got no idea how to be immortal and have no idea whether or not progressive organ transplants might accomplish this. I do want to know the answer—that would be fascinating—and I can already think of the first questions I would look up. Googling "could organ transplants make us immortal" would be my first step. This is the sprinting headlong into reality. Curiosity is not a cure-all: deliberate practice is still hard What if I am trying to learn calculus, though, and want that hit of curiosity to drive me to study? I already know that it will be helpful for my studies in grad school. But that’s a fairly extrinsic motivation. Oh sure, I believe in an abstract way that calculus will eventually be directly useful for my intended course of study in computational biology. But I also have no ability to imagine how. I know I don’t know enough to figure out how to apply it right now. Games are generally a good way to get your brain activated for an arbitrary goal. So are stories. But part of what makes a game or a story good is that they make the challenges or the language interesting. Shoehorning in the solving of equations is a massive design challenge. You end up with a game that doesn’t entertain and a homework assignment that’s inefficient. The best I’ve ever been able to do is to relate to my studies a little bit like it’s a sport. I get into the zone. I see how quickly, how effortlessly, how accurately I can answer problems. How fast can I read this chapter? What’s the craziest organic molecule I can draw and then name? I try to invent my own problems. I rewrite passages in my own words. I don’t just try to answer the exercises and remember the concepts. I try to remember what the exercise questions were, or even to make up my own exercise questions. It’s the next best thing to tutoring someone else. I’m not being guided by curiosity. I’m being motivated by competitiveness and restlessness and the desire to test myself, to push the limits*.* When I’m at my best in my studies, I’m acting more like a fiercely competitive soccer player, or maybe like the stereotype of a hot-shot fighter pilot. So what keeps a soccer player or a fighter pilot focused on their practice? One of my skills is playing classical piano music. Some of the most challenging pieces I ever played are J’eux D’eau, by Ravel, and the Ballades of Chopin. I remember what motivated me there.

Comment

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling?commentId=CjGaoj4tf5pc2rBKq

Great post!

The first thing worth noting is that, as you mentioned, school is sort of an artificial environment which often penalizes following your intrinsic curiosity. Taking that into account, I’m still quite uncertain about the degree to which I’m able to develop expertise purely through intrinsic motivation.

On the one hand, I’ve seen some comments /​ posts on LessWrong /​ Twitter arguing some subset of:

  • For intellectual activities like math & programming, if you’re not motivated by curiosity you’re doing it wrong.

  • Children naturally master things they’re curious about but then school ruins that drive by forcing you to do things you don’t want to do.

On the other hand, if you read the "expertise literature" (Ericsson on Deliberate Practice, The Mundanity of Excellence), there’s a big focus on consistently doing uncomfortable things that you’re not going to be intrinsically motivated to do in the moment. Now, this literature tends to focus on more skill-based, often physical, "rote" activities like swimming, violin, etc. Chess is probably the closest thing to an intellectual pursuit that’s been studied by academics through the lens of deliberate practice. That said, Cal Newport (a Computer Science professor and sort of pop science writer), has written extensively about his belief and experience applying deliberate practice to knowledge work and I think he makes good arguments that fit with my personal experience.

Finally, my personal experience has also provided mixed evidence for the two conflicting hypotheses. I do learn much better when I’m intrinsically curious about what I’m learning and as a result spend time idly thinking about it. But, I also find that in order to really learn something challenging well, especially early on, I sometimes need to force myself to sit my butt down at the chair and practice.

As a concrete example, I used to not be that intrinsically interested in algorithms as an area beyond the basic ones that everyone knows about (BFS, DFS, LRU cache, etc.). As a result, when I decided I wanted to prepare for interviews before looking for a new job, I mostly forced myself to sit down and grind through a bunch of algorithms-y problems. This was not that fun at first because it was quite hard and even when I was curious about the answers to, in particular, the harder problems, I wouldn’t be able to get them or would take a long time to. Also, it was originally driven by extrinsic motivation. However things changed as time went on. Once I reached a certain level of proficiency, I grew to like practicing and learning about algorithms more because I worried less about constantly failing. My two take-aways from this experience were:

  • A sense of inadequacy is a big obstacle to intrinsic motivation.

  • It’s much easier to be curious when you’re already somewhat competent.

In the end, I think both the "perfect practice makes perfect" and "harness the desire to know" perspectives have something to contribute towards developing expertise, but I personally am not yet at a stage where I can learn really hard things without doing some amount of "forcing" myself.

Comment

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling?commentId=JTu24wdB56SaEFihN

I just re-read your post one more time and want to comment that I can strongly relate to this section in particular:

The best I’ve ever been able to do is to relate to my studies a little bit like it’s a sport.

I get into the zone. I see how quickly, how effortlessly, how accurately I can answer problems. How fast can I read this chapter? What’s the craziest organic molecule I can draw and then name?

I try to invent my own problems. I rewrite passages in my own words. I don’t just try to answer the exercises and remember the concepts. I try to remember what the exercise questions were, or even to make up my own exercise questions. It’s the next best thing to tutoring someone else.

I’m not being guided by curiosity. I’m being motivated by competitiveness and restlessness and the desire to test myself, to push the limits. When I’m at my best in my studies, I’m acting more like a fiercely competitive soccer player, or maybe like the stereotype of a hot-shot fighter pilot.

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling?commentId=5S3ELYpNFuoscEpmg

They’re in the habit of defining small but meaningful projects for themselves, breaking those projects down into steps, and practicing the steps until the whole project attains a smooth and satisfying flow.> They’re looking not just for goal-oriented success but for little, intuitive, hard-to-explain ways of finding a thrill in the practice itself. They make little games for themselves that would seem utterly neurotic and silly to other people. And those self-imposed, idiosyncratic games are actually an important part of the lived experience of practicing for these people.> They look for opportunities to teach and show off their skills.I feel like these are all kind of true, but also slightly askew of my reality. Sometimes it feels like it was overdetermined that I would become a programmer. I started when I was 8, kept coming back to it, and had this persistent drive to make computers do things and to build things out of computers. Looking back it didn’t make a lot of sense; I had some unjustified belief that COMPUTERS!!! were the answer to all my problems. And then there was the reality of becoming a programmer. The long trail of abandoned projects, the procrastination, the vast difficulty of getting the computer to do what I wanted it to do, the constant failure. It was like getting punched in the face over and over, and yet I kept coming back for more until I finally learned one day after decades of effort how to punch back. If you had looked at me from the inside you would have not seen what looked like a healthy way to become an expert at something. So I don’t know, I feel like there are a lot of pieces to the puzzle, and sometimes things work out in spite of conditions that seem like they should lead to failure, or that combine in weird ways to work despite lots of forces working against mastery.

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling?commentId=sNGHzddSGXcaDLYbD

I’m in a calculus course right now, and boy, it would be a lot easier to master that body of knowledge if I was > hungry to know it. If only there was a way to make myself feel charged up to learn calculus every single day.I recommend an intro physics class. Calculus and mechanics are subjects best learned side-by-side; that’s mainly why calculus was invented in the first place. (Personally, I took a physics class before calculus, and when I learned calculus I had this perfect calculus-shaped hole in my head just waiting to be filled in.)

Comment

https://www.lesswrong.com/posts/tTD8fbctGhH26Jahp/curiosity-a-greedy-feeling?commentId=BNqPw88BbdBygNRmZ

A little trickier because it tends to require more pre-requisites like linear algebra but I feel similarly about the optimization-focused aspects of Machine Learning.