Monday, October 31, 2005

Objectivity in Coffee Tasting

Gee and I had an interesting conversation on Friday about coffee evaluation. The basic topic was: how does one know what a great coffee is, besides one's own preference? And what is important in coffee tasting, anyway?

This is a perennial topic among coffee tasters, and I have been thinking about it in a different way lately. Of course, the whole deal about cupping professionally is an attempt to take the inherently subjective experience of tasting coffee and putting it into a quasi-objective format. Coffee cuppers spend a tremendous amount of time trying to "calibrate" against other cuppers, making sure that they score coffees highly that are generally recognized as great (and give generally recognized inferior coffees low scores). This behavior is, of course, maximized at cupping events like the Cup of Excellence, where cuppers are actually evaluated on their ability to conform to the group's taste, and also their willingness to reward or punish coffees if they feel such a thing is warranted. This pattern revolves around whichever cupping form is being used, which usually produces a score between 0 and 100.

I have been feeling an urge to simplify lately, and streamline the documentation of the tasting experience. Conversations with Trish, Geoff Watts and George Howell have driven me along this path. The following are the categories I keep in mind when I am tasting coffee, and are be the basis of my own tasting paradigm. They are divided into two basic categories: evaluating green coffee quality (say, for coffee buying or for a contest) and evaluating roasted coffee (for quality control and reviews). This is also the closest I can get to objectivity in coffee evaluation.

Green Coffee Evaluation:


Sweetness: This is the basic sensation of sweetness in coffee, and it is directly related to the ripeness of the cherry when the coffee was picked. The sweeter the coffee, the better; I would say that is universal. This is, of course, related to various mono- and polysaccharides present in coffee, and may also be the result of "fantasia" sweetness from other substances.

Cleanness: Cleanliness is a hugely important part of great coffee, and is related to the skill of the processor at origin. To me, this is similar to “clarity” in the cup, where the sweetness and other flavors of the coffee are unobscured by any dirtiness, funkiness, or off-flavors. This value, of course, favors washed coffees.

Character:
This is the most subjective of the three categories. It comprises concepts like body, aftertaste, aroma, balance, etc. To me, any combination of these kinds of categories ultimately falls short, because we have different expectations of different coffees. For example, we expect Indonesian coffees to present a certain character, and expect washed Ethiopians to present a wildly different character. Both can be great, though they will frequently fall short on one category or another. However, a Yirgacheffe that has an amazing amount of Yirgacheffe-ness will score very highly on this value. Freak coffees, like strange varietals with unexpected characteristics, might also have a ton of character. The concept of "Terroir" would also come into play here. Coffees which would score low on this would be coffees that are insipid, anonymous, bland, or common-tasting.

Roasted Coffee Evaluation:


Skilled Roast: I almost called this "Absence of Roast Defect". The goal here is for the roasted coffee to be without any of the flavors normally associated with roast problems: fishiness from dark roast, scorched flavors, sourness, roast bitterness (trigonellene) etc. etc. Since both dark and light roasts can be done skillfully, there would not be a built in bias towards either.

Transparency of Coffee Character:
Do the coffees taste like what they are? Was the roaster paying tribute to the coffee, and bringing out the best parts and salient aspects of the coffee? Was the beauty inherent in the coffee (or component coffees) brought out?

Achievement of Intention: This is an assessment of whether the coffee was able to achieve what it was intended to achieve. If it was an espresso, was it successful at producing the elements of good espresso? If it was a single-origin sold by farm name, was it successful at communicating the specificity of that coffee? Does the flavor profile meet the description proposed by the roaster?

These six categories, for me, build the elements of what come closest to what I am actually evaluating when I am tasting coffee.

-Peter

7 comments:

  1. I know I'm probably in the minority, but I worry (a lot) about what I'm seeing as a push for "Objectivity" in cupping.

    First and foremost - taste is simply not objective. It is profoundly subjective. This is not just a "preference" issue and not just a "cultural" one, but is actually in many cases a physiological issue. I appreciate the human desire to quantify and structure, and understand the lack of comfort that comes with total subjectivity. But this is reality - and it's best to accept it.

    Second - there is a history in the coffee industry of "insiders" trying to control the knowledge of coffee. I am, personally, very opposed to the hegomonic elitism that I've seen within the coffee industry. Now... People like you Peter are, in my experience, different. But I still worry - a lot - about knowledge being seen as power. I'd hate to see a return to the old guard style of apprenticeship, journeyman, blah blah arcane and almost masonic cult like structures. I feel like this has been, at least in part, weakened over the last decade and would hate to see a return to "you must use the correct and only correct terms."

    Third - in that same ten year period, I feel like we've started to see a shift from cupping in order to identify defect and classify/codify coffee towards cupping purely for flavour and quality. This is something that I strongly support. I fear that what you're talking about is, in some ways, a coded way of reversing the trend. I'd hate to see this.


    What can I say? I was a post-structuralist critical theory major.

    ReplyDelete
  2. Thanks for your comments, man.

    Despite the title of this post, I completely agree with you on the subjectivity of matters of taste. I refer to this early in the peice ("cupping professonally is an attempt to take an inherently subjective experience and put it into a quasi-objective format").

    You can never objectively assess most of what we talk about when we taste coffee. What is "good"? What is "pineapple"? What if you have never tasted pineapple? What is it then? We are clear about this in most cupping protocols: in the COE form, for example, you are measuring your subjective experience.

    The problem is that it is of little use to anyone, other than as entertainment. How can these kinds of subjective evaluations lead to better coffee? They cannot. It is inherently unfair to coffee producers, if we reward coffees for being "sublime, with subtle raspberry and myrrh overtones". A coffee producer has no idea what to do with this kind of information. However, if you can focus on sweetness, cleanliness, and character, you can at least be somewhat objective in their evaluation (even if you don't happen to like the character). I do believe in the existence of sweetness and cleanliness, and I believe that you can objectively measure them in coffee. They do have a subjective component, but the existence of polysaccharides in coffee is real and quantifiable, whether by taste or other instrument.

    I agree that a "dictatorship of good taste" is to be avoided, by all means. But, on the other hand, by surrenduring to absolute subjectivity you lose the concepts of "better" and "worse". I do believe that a foul, unripe Robusta is inherently worse than a fully ripe, clean, jasmine-lemon Yirgacheffe.

    I truly believe that the ability to taste and to appreciate taste can be learned and shared. Despite your distaste for "masonic" structures, there is value to teaching others how to taste consciously and skillfully. Remember that the role of the coffee taster is not to glorify oneself, but to be a better servant of those who want to enjoy coffee.

    Last, I belive that a codified vocabulary is very important. Communication is impossible if each taster is encouraged to indulge their personal poetic license every time they taste coffee. This is alienating and infuriating to others in the coffee trade who are trying to satisfy the requirements of the demanding buyer, if all they are getting is flowery subjective descriptors.

    I am interested in your last paragraph, where you say that you strongly support cupping "purely for quality and flavour". Could you please define "quality and flavour" for me? (btw; my post was my attempt to do just that).

    Peter

    ReplyDelete
  3. In terms of rewarding growers and "guiding" them towards higher quality - I think we have emerging models.

    First - we have what you, Duane et al have done in Kenya (enlightened self interest).

    Second - we have the CoE where quality is rewarded by increased profits (capitalism).

    I can absolutely define quality and flavour... for me. Would I argue that they are correct for you? Never. This is a discussion I've had often with Peter from Terroir. He and I differ dramatically on what "good" coffee is. I will taste a central that he loves and find it "boring." He will taste an African I love and find it "dirty." We are both right.

    In discussion over these attributes and differences of opinion we can learn a huge amount - as long as we respect that we are both right.

    End of the day - I'll buy what I love, he'll buy what he loves. And that is the way it should be.

    ReplyDelete
  4. "End of the day - I'll buy what I love, he'll buy what he loves. And that is the way it should be."

    i don't think anyone would be so brazen as to suggest that it should be any other way, chris.

    but defining what it is that you love about a coffee is what we're looking to discover.

    it's important not to get hung up on connotations of words and take them as all negative. just because a coffee is dirty does not mean that it is bad. countless people love the dirty/earthiness in indonesians, yemenis, and harrars. other people can't stand it. the important thing is that both sides agree that the sensation is one of dirty/earthiness.

    and that's what peter g and i were talking about. when it comes down to identifying flavors in coffee, people's tastes will be subjective based on their own personal experiences. but we need to be able to put those things together, to see the common threads. make this acceptable and accessible to the producers.

    now of course what drives producers nuts is the fact that people will rant and rave about how incredible a harrar is, and call their perfectly sweet and clean pure bourbon "lackluster". that is not beneficial feedback at all...whereas if you can say "we look to get X, Y, and Z out of this type of coffee" (part of what peter g refers to as "character") then they can go back and make adjustments to their processes in an attempt to provide X, Y, and Z in the cup.

    without a clear, concise, and simple vocabulary communicating what we love abotu a coffee, we're doing no one any good

    ReplyDelete
  5. Peter and Gee,

    Your roast evaluation is particularly interesting to me. Thanks so much for that. If we could have a little of that kind of thinking in every roasting room, we not only could avoid a lot of bad coffee, but we would open up the ever underappreciated and misunderstood roaster mind.
    A roaster's mind is a terrible thing to waste.

    Your post is really great ...as I re-read it over and over. I can honestly say that I agree with every danged thing you're saying there.
    I don't beleive that a coffee enthusiast needs to get into these evaluations like we do. Not at all. I agree with Gee's point (and CCC's open cupping Friday deal) that sheets and wheels can muck up valuable moments at the table.

    But I'm all for changing the "unfrozen Caveman Lawyer" approach to cupping in professional circles. We NEED to make the evaluation more transparent and quantify quality as much as we can.
    It's the reality of the business and it's best just to accept it.
    ; )
    I believe evaluation is far less subjective than Tacy wants it to be....but that's fine. Really a coffee lover never needs to go there if he/she doesn't want or need to.

    And I can't agree that there has been a culture of the elite trtyng to keep information from the people. I have seen quite the opposite in my years in the Specialty coffee world....I think Peter and I have about the same number under our belts....going on 19 years. I have always been able to learn just practically through osmosis - no kidding! It's taken no effort at all to get the info I wanted. I saw you quoted in Barista Magazine as well, Chris. Have to say it bummed me out, but I'm glad you feel there is a shift in any case.

    Bless...

    ReplyDelete
  6. Caring is sharing.

    The personal and the private... I guess it’s the difference between subjectivity and objectivity. Certainly taste is subjective, but the words that we use to describe those taste sensations are part of linguistic system that exists only in a community. I think there may be a temptation here to conflate personal likes and public descriptors. Without language we can hardly communicate, and what I think the flavor wheel people are saying is we need to codify a language of coffee if we are going to move coffee forward, and this is a good thing, in my opinion.

    I mean, people can disagree on what they like, but wouldn’t it be nice if they could discuss their differences in taste in a way that makes sense to each? And I guess I may be begging the question here. The question may indeed be: can people with different taste buds come to a common language of coffee?

    Just a quick jot from an enthusiastic coffee amateur who is anxious to gain an understanding of the “secret insider” coffee talk…

    ReplyDelete