Category Archives: Uncategorized

Gaps, Goals, and Questions

If you have followed my advice, the introduction of your draft paper consists of three paragraphs that tell us (1) what kind of world we’re living in, (2) what kind of science you do, and (3) what you have found by doing it. If we don’t also understand why you went looking for it there by such means, then my first suggestion is to make your paragraphs better.

But sometimes even the best prose won’t satisfy an editor’s (or supervisor’s) demands for clarity. You may be asked to make your “research aims” and/or “research question” explicit and to identify your “contributions” to the literature or the “gap” in it that you are proposing to fill. I’ve never been a big fan of these demands (and I’m not alone in this) but they do come up (and sometimes for good reason), so I thought I’d write a few words about how to satisfy them should you run into them.

Like I say, ideally, the solution is already implicit in the three paragraphs you have written. You are just going to make it explicit. Presumably, your paper is based on a study, and that study was trying to answer a question. If you must distinguish between you research “aims” and your your research “question”, it might be worth thinking of the aim as more theoretical and the question as more empirical. What is the general problem you are interested in? Solving it might have been your aim. What is the specific context that you studied? That’s where you’ll be looking for answers to your question.

As a first approximation, try writing a paragraph that will appear between the second and third paragraphs of my standard introduction. That is, it will come after you have (1) evoked a world and (2) invoked a science but before you have (3) proposed a thesis. Paragraph 3 will now become paragraph 4, and in the new third paragraph will bring us from the science, through your research aim and and your research question, to your thesis. You will probably end up with two paragraphs that are in a sense about your “paper”: first (3), it’s problem statement (made by formulating your research aim and your research question) and, second, the study you are presenting (stating it’s thesis and summarizing its method, analysis, and implication, i.e., outlining your paper).

Standard
Modified
  1. World
  2. Science
  3. Paper
  1. World
  2. Science
  3. Problem (aim/question)
  4. Study (thesis, outline)

And what about the (in)famous “gap” that you might have been asked to identify as part of your literature review? Well, my advice is to make it part of your description of the science you are invoking. Ideally, the lack of prior research on your topic will not be the only thing that defines your field — there will be still be some consensus or controversy to speak of, and you should (in my opinion) presume that your reader will fill in the gap intuitively on the basis of what is already known. That will still put you in a good position to engage with the current commitments of your field.

It may be necessary (that is, your editor or supervisor may require you) to write a whole paragraph delineating this gap in your introduction. You will now have a five-paragraph introduction:

  1. World – the state of the world that interests you
  2. Science – the state of your discipline (consensus, controversy)
  3. Problem – your research aims and research question
  4. Gap – the outlines of the hole in the literature you are filling (contribution)
  5. Study – what your study shows and how it shows it

I personally think this is overly elaborate, and if I were your editor or supervisor I would try to get you do all this, some of it implicitly, in three paragraphs and under 600 words. But if you are being asked to be more explicit, there is a way.

Update on further reading: In the comments, Sébastien reminds me that, in addition to their paper arguing against gap-spotting, Mats Alvesson and Jürgen Sandberg have also written about problem statements and research questions.

The Finishing Touches

I’m holding the last talk in the Craft of Research series on Friday. It will be devoted to the utterly mundane business of formatting and referencing properly. I should emphasize, however, that this business is normally conducted under the auspices of a “style guide”; that is, there is in fact something stylish about it. It’s a tough sell, I know; it is something that many students and scholars leave to the end as “chores”, thinking that only a very superficial person would care about margins, typography, and consistency in referencing. Surely it’s the ideas that matter! Perhaps they should remember that papers are not made of ideas. They are made of words — deliberately chosen and arranged for maximum effect. In any case, I have my work cut out for me.

Here’s something to keep in mind. It’s a well known fact about many examiners and reviewers that after reading the abstract and perhaps the introduction, they skip straight to the reference list to see if the authors that they would expect to find there, and the classic works they have written, are in fact listed there. You want to make sure this first impression is a good one. If you have in fact cited the texts they are looking for, you want to make sure they’re on the list; and you want to make sure that the list is in alphabetical order so that the reader can find what they’re looking for. But you also want to make sure that the reference list itself looks like the orderly bibliography it is supposed to be. You want to give the reader a sense of the orderliness of your study at a glance.

By a similar token, this should be an easy source of a particular kind of aesthetic satisfaction. Spending a few hours making sure that your reference list is complete and orderly is worth the effort if you give yourself enough time to actually enjoy it. Looking over a neat list of books and papers that you have spent the foregoing many weeks engaging with should feel good.

The same goes for the visual impression that any individual page of your paper gives off. You should be able to spend an hour or so just flipping through your paper and enjoying the way it looks. Reading random sentences (even out loud) should be a pleasant experience. And the text should “work” at the level of the references; a quote or fact should have a source, and the source should be easy to locate, first in the reference list, then in the library. Try this out on a few different pages.

Make sure that the effect of putting a source next to your own text is to increase your credibility. These days it is often quite easy to find a source while reading a text (especially if you have referenced it properly) and this ease is part of the authority of your text. You can check how well this works by picking some pages at random and finding the source (either by Googling or in the library’s databases).

Does spelling count? Yes. But that’s not all. A nice clean title page suggests an orderly mind that is confident about what is to follow. (I’ll leave it to you to decide whether a generic cartoon does the same; maybe your supervisor has an opinion to share.) Page numbers and section headings are useful to the reader. The table of contents should match, yes, the contents. Figures and diagrams should be easy to decipher and look good on the page. (Learning how to do these things takes time but it is worth it. Don’t think the easy “automatic” solution is the only possible one and therefore the right one.) And they should be easily related to what you have written about them.

All in all, try to make your paper or thesis look like something that was carefully and deliberately made. You made it carefully and deliberately and there is no reason to give your reader any other impression. The few hours this takes are well spent, in part for the simple pleasure it affords. Enjoy it!

How to Appreciate Your Finitude

You read what you have written and, as you always stop when you know what is going to happen next, you go on from there. You write until you come to a place where you still have your juice and know what will happen next and you stop and try to live through until the next day when you hit it again.

Ernest Hemingway

Begin in the present, today. No matter how big your project is, you must admit that today, at least, will come to an end. Will you be finished with your project? Probably not, unless today is the last day of your plan and you stuck to your plan. Maybe the deadline is today and you’ll hand in whatever you’ve got; that too, is a way to finish. But on most days you will not finish; you will put your books and papers away and you will go to bed knowing there is more to be done. Tomorrow is another day.

This basic idea — that today will end and tomorrow will come — may sound banal but it is enormously powerful. Given a deadline, you can count how many times you will have this experience — of stopping your work even though it is not finished. Once you understand that this will be a famliar, everyday (indeed, daily) experience, you can begin to get comfortable with it, and with the incremental progress that it implies. At the end of every day, you can survey what you have accomplished and look ahead to what you will be working on tomorrow. Get used to it.

I recommend you do this a few hours before you go to bed. Late afternoon or early evening is a perfectly reasonable time to call it a day. I understand that many students think they need to stay up late but, since you do have to get your sleep, that really just means shifting the day by a few hours. (What was it Hemingway said? “In Spain there is no nightlife. They go to bed late but they get up late. That is not nightlife. That is delaying the day.” Something like that.) The important thing is to make sure that you have some time after you have finished doing your work to relax. Don’t study until you sleep and then get up and study all day again. You’re a human being.

If you’re following my rules even a little, you are taking a moment at the end of the day to make a plan for the morning. I normally focus on the writing tasks, which shouldn’t occupy more than three hours of a day, but it’s a good idea to have a clear idea of how you will spend at least six hours of the next day before you stop for today. Now, divide those six hours of deliberate, predictable work into half hours. And put some breaks in between. Decide what you can accomplish in each half hour. If you’ve been working your discipline you can probably write about 200 words every half hour. And you can probably read about 5000 words if you put your mind to it. Try to consider your other tasks (searching a database, analyzing your data, etc.) in similar terms. Get a realistic sense of what you’re capable of and plan to make use of that capacity.

Now, I’m by no means saying you have to spend six hours every day on your research project. I’m saying that’s the maximum, and that if you are working at the maximum you’ve got time to do roughly twelve specific, deliberate things. It’s fine if you’ve got other things to do on some days and will only do five or six, or even one or two, things related to your research project. Just make it a plan rather than a hope. Try to have a list of those things ready for every day already the day before.

Don’t just stop once at the end of every day when you are too tired to continue. Make a plan to stop a discrete number of times every day, roughly every half hour. Give yourself some tasks to fill those moments. Give yourself a realistic amount of time to do it. Stop when you run out of time, not when you run out of juice.

Hemingway stopped when he knew how the story would continue. I recommend you stop simply because it is time. You will side with him or with me or find your own reasons to stop. But my advice, in any case, is to learn how to stop working, every day, very deliberately, long before you reach the deadline. Every time you stop, knowing that you are not yet finished and there is more work to be done, you appreciate the finitude of the problem. Don’t worry for the rest the day, you will get there. You will get it done. Worrying will not.

NOTE: I wrote this while preparing for my “How to Finish Your Project” talk in the Craft of Research Series.

A Little Daily Exercise

An exercise occurred to me the other day. It’s not as demanding as following my rules for eight weeks, but it might give you a little taste of (and for?) Writing Process Reengineering, before deciding whether to take my course.

Here’s the exercise in a nutshell: Every evening, write a true sentence that is a little hard to believe, understand, or agree with. Every morning, take ten minutes to write six more about the same thing that are a little easier to believe, understand, or agree with. Maybe the value of doing this every day (or, let’s say, 160 days a year) is obvious to you. But let me try to explain what I’m getting at with it.

The exercise is deliberately couched in the language I use to describe the problem of writing a paragraph. A paragraph always has a key sentence that poses some difficulty for the reader. The rest of the paragraph then helps the reader overcome this difficulty. The key sentence may be hard to believe, requiring five or more sentences of support. Or it may may hard to understand, requiring elaboration. Or it may be hard to agree with, requiring a defense. In each case, the problem is to make the key sentence more believable, understandable, or agreeable using no more than 200 words. I normally suggest you learn how to compose such a paragraph in under half an hour. Indeed, I suggest learning how to make effective use of exactly 27 minutes to that end, devoting at least one half and at most three hours a day, 32 weeks of the year.

Some people, however, don’t want to compose every paragraph in such an explicitly crafty way. They produce their prose in a more intuitive (and they might say a more “natural” way), moving from paragraph to paragraph when it seem appropriate, not when the clock runs out. Some people compose perfectly good paragraphs this way because they have good grasp of how prose works, of what is supposed to happen to the reader while they are reading. My exercise is intended to subtly strengthen your intuitions in this regard.

Without demanding that you actually produce a paragraph, it forces you to notice what makes a sentences hard or easy to believe. My favorite example of this difference can be found in ethnographic prose, based on either interviews or observation. Here the key sentence will tell us what a person, or a group of people, thinks or feels, wants or fears, needs or hopes. Since such states are not directly observable, they’re a little hard to believe for the academic reader, naturally skeptical. It’s not that the reader is outright unwilling to believe such statements; it’s just that they want to know how you know. Give them a little evidence and they’re good. So you write a paragraph that presents an account of what you heard them say (in interviews) or what you saw them do (in the field). The fact that they said and did these these things is simply easier to believe than the fact that they felt or thought something. That’s especially true in light of the altogether credible methodology you have described before you present this data. Knowing how you collected it, the data can be taken for given. It’s easier to believe.

So one way to do this exercise is to write a key sentence about a fact that is not directly observable at the end of one day and then write six sentences about directly observable facts that support your claim. Another way is to write a statement of theory, invoking concepts from the literature, and then write six sentences that cite this literature in elaboration of their meaning. Since this literature will be familiar to reader, these sentences will be easier to understand than your interpretation of it, which requires the reader to get inside your head, just as you ask them to get inside the heads of your research subjects in the analysis. Another way is to write a sentence about the implications that follow from your research and then, assuming that the reader objects to your reasoning, you defend the rationality of your normative stance, proposing changes to theory or practice that the reader may not want to make the effort to implement, acknowledging their objections and countering them politely. Whatever you do, the important thing is to give yourself an opportunity to compare the difficulties that your sentences present the reader with.

When doing this exercise, remember that you’re only spending a couple of minutes at the end of one day to set up ten minutes of writing the next. Don’t make it a bigger deal than it is. It’s just a little exercise. Try it for a week and see what you get out of it. And do, please, tell me about it if you feel the urge. I always like to hear whether and how my suggestions help my readers. Comments are open.

Editors, Reviewers, Graders, Readers

This came up on Twitter the other day. A researcher had been desk-rejected by a major journal less than four hours after submitting. An efficient editorial process is normally a good thing, of course, but this seemed a little too fast in some quarters of academic Twitter. Is it really possible, asked Paul Hünermund, to evaluate the quality of a paper in such a short time? I think that’s an excellent question, not merely a rhetorical one, and I’d like to take a few moments to offer an answer to it, mostly in the affirmative.

To be fair to the journal, we’re not here talking about the full review process, just the editor’s decision about whether to send the article our for review. A journal with many submissions (as a top journal will be) will need to make short work of this decision. Someone probably has to look at several papers every day (at least at times) and decide whether the paper is on the face of it a good candidate for review. A positive assessment here will result in work for (usually) three other scholars (the reviewers) and waiting time for the researchers who submitted the paper, so this decision is important. But it should also take considerably less effort than the full review process.

Also, we should keep in mind that underlying our response to the time it takes to review a paper is our intuition about how long it takes to simply read and understand one. We expect reviewers and (post-publication) critics of our work to actually read it, usually the whole thing, before passing any sort of judgment on it. We might perhaps discuss whether the editors in this case owe the writers a full read of the paper, but let’s try to get a sense of what a reasonable effort at understanding a paper involves.

As always, we will try to appreciate the finitude of the problem. A standard journal article in the social sciences might consist of roughly 40 paragraphs. Each paragraph, I usually say, should be written so that it can be read and understood by a peer reader (a scholar in the same discipline as the writer) in about one minute. So let’s say it takes about 45 minutes, and no more than an hour, to read a paper all the way through once, with comprehension. That is, a good paper presents about 40 claims of various kinds along with the support, elaboration, or defense that the reader needs in order to believe, understand, or agree with them. After an hour or so with your paper it should be clear to the reader what you are trying to tell them and why you think you’re right about it.

If that is not possible — that is, if after an hour the point of the paper is not yet clear — that strikes me in itself as a reason to desk-reject the paper. But if the paper is good, so that that first hour of effort on the part of the editor produced an understanding of the paper’s purpose and, not incidentally, a favorable assessment of the quality of the prose, then it should not take the editor another three hours to decide whether the paper is within the scope of the journal, or whether the conclusions are interesting enough, or whether the data is substantial enough to support them.

I guess I’m trying to say that a good paper is easy to read, given the right reader. That also means that readers can quickly decide that either the paper is not good or they are not the right reader. If the reader is an editor, this can guide the desk decision. If the reader is a teacher, this can guide the grade. If the reader is a scholar, it can simply guide the decision about whether or not to keep reading, i.e., whether they have an obligation, as a peer, to see what a fellow scholar has to say here. Giving an hour to a 20- or 30-page paper to this end seems reasonable to me, even somewhat charitable.

Being kind to your reader is the best way to get your paper through the various hoops that academic life presents us with. Whether you’re trying to get published or to pass a course, write your paper with the aim of making it easy, not hard, to evaluate. Write it in the spirit of exposing your ideas to the criticism of a qualified, competent peer, whose opinion you respect. Don’t expect your reader to struggle for hours to decide what you are trying to say and whether or not it is correct. Give your reader an occasion to respond naturally and intuitively to your prose. (It should, as Orwell said, be like window on your mind. Your ideas, not your words, should be at the center of the reader’s attention.)

The quality of a good paper is immediately apparent. If it takes a long time to assess the quality or relevance of a paper — when, e.g., applying a journal’s editorial standards — then that assessment has actually already been made. And this should also help us enjoy the work of reading more, whether as scholars, editors, reviewers, or teachers. Don’t get frustrated by bad writing. Just put it down for a moment and take stock of the situation. Your frustration is already a sign that there is something wrong with the paper in your hand. It may be that you’re not the intended reader or it may be that it’s not very good. It’s certainly not obviously your obligation to spend the rest of the day struggling with it. Decide how much time to give to it, make the relevant decision or assign the appropriate grade, and move on to the next paper.

Most of us are able to distinguish necessarily difficult ideas from needlessly difficult writing. Read charitably. Write generously. But remember that there must be limits to our kindness, and to the kindness our readers show us. Like being good, reading well means “finding ourselves correctly attuned in the apportionment of the moment,” as Heidegger put it. Much of this is just about planning your time and following your plan. Give every paper the attention it deserves.