Dear Zagat A hearty thanks for your 30 years of service. Now go away.

Page 1 of 2

The Zagat guide turned 30 years old this year, and in honor of the occasion, I’d like to give founders Tim and Nina Zagat a hearty thanks for all their years of service to the restaurant industry. And, if I may, I’d like to offer some friendly advice, too: You can go away now.

Ten years ago, back before everyone had access to a world of opinion via some device tucked into purse or pocket, diners relied on your slim red eponymous guide, which compiled restaurant ratings based on public opinion. It was your slap against the imperial voice of the critic. The Zagat book would be the voice of the people, guiding diners by the collective wisdom of the people, even if you would never tell us how many people actually voted for any one restaurant.

But now, nearly a decade into the 21st century, the people no longer need Zagat to compile data, crunch it, and cough it up in cute little numbers of dubious quality. They can compile their own dining information of dubious quality without all the opaque, Wizard of Oz, man-behind-the-curtain nonsense that you have insisted on for three decades.

The truth is, the Zagat guide belongs to a time when tourists and urban newcomers, looking for some guidance on restaurants, had nowhere else to turn. For these folks, the Zagat guide was like asking 1,000 random strangers, “What’s your favorite restaurant?” and then tabulating the results.

Except it wasn’t. The Zagat survey has never been random. Its respondents are, in the language of pollsters, self-selected. Or perhaps mostly self-selected. That’s the problem: Few people outside of Zagat’s New York offices know who actually votes and how those voters are selected.

advertisement

Nina and Tim Zagat, a pair of former lawyers, have indicated in the past that they’d send out hundreds of thousands of surveys to law firms, medical offices, and other white-collar institutions where people, presumably, have the disposable income to eat out often enough to provide the Zagats with the free data they need to sustain their empire. But Zagat also solicits online reviews. Are those included in the final ratings? That would seem to be the case, but one restaurateur complained to me that some never appear on the site.

The Zagats are like a couple living in a walled compound, sealed off from some of the major developments of the past decade. The generation that willingly accepted unverified pronouncements from established authorities has moved into retirement homes. The younger generation is far more interested in its own opinion, which it shares in virtual communities like Yelp, MySpace, and Facebook. It values transparency among peers (if not in the comments sections of blogs), and its members are strung out on the 24-hour news cycle, which has them addicted to the latest 140-character information bomb from Twitter.

We do not live in a Zagat World anymore.

This epiphany came to me via the 2010 edition of the Washington D.C./Baltimore Zagat guide. There, on page 10, are the 40 highest-rated restaurants in the D.C. area in terms of food. At the top, for the second year in a row, is Makoto, a 25-seat Japanese restaurant in Palisades that prepares a pristine, multicourse omakase menu based on the seasons and the chef’s whims. The place earned 29 out of 30 points for food from Zagat raters, just barely beating out the Inn at Little Washington, which is rather impressive given the latter’s bona fides. In 1994, the International Herald Tribune named the Inn one of the 10 best restaurants in the world, and it has remained a darling of critics. Celebrities and politicians hop in helicopters to dine at the Inn at Little Washington. Washingtonians consult their GPS to figure out how to find Makoto.

You might be wondering how a niche restaurant like Makoto, with such a minuscule seating capacity, could generate enough votes to win the top spot two years running in the D.C. Zagat guide. There’s an easy answer: It didn’t. Makoto won the 2009 Zagat survey for food. The ratings in the 2010 book merely repeat those from last year’s survey, although the casual reader would be hard-pressed to know this important fact.

The only way I learned about the duplicate ratings was through Michael Birchenall, editor and publisher of the local trade magazine Foodservice Monthly. After reading a blog item that I wrote about Makoto’s strange stranglehold on Zagat, Birchenall combed through his old guides and discovered an interesting trend: Those restaurants that topped the Zagat ratings in the odd years were the same ones that topped them in the even years. A spokesperson for Zagat confirmed his findings.

“As Michael Birchenall pointed out to you, we compile new survey results and prepare a new guide for Washington, DC/Baltimore every other year,” e-mailed Tiffany Barbalato, director of communications for Zagat. “This is why the winning restaurants and top lists you refer to in the 2010 guide are the same as last year’s.”

Barbalato, in the same e-mail, alerted me to this line in the latest guide: “This 2010 Washington, DC/Baltimore Restaurants Survey is an update reflecting significant developments since our last Survey was published.” (Those significant developments, incidentally, are mostly the addition of new, unrated restaurants with an editor-written description.) Barbalato offered up this lone, coyly worded sentence as evidence that Zagat doesn’t try to dupe its customers about the duplicate nature of the even-year guides.

I had my doubts that this anemic sentence was pulling its weight, so I called a few restaurateurs and asked them if they knew about Zagat’s duplicate ratings. “I did not know that,” says Jeff Black, 46, the owner of four restaurants, including BlackSalt and Addie’s, who’s been working in the hospitality business since age 13. “That’s kind of lame.”

“Oh, really?” says Barton Seaver, chef at the new Blue Ridge in Glover Park. “OK, that’s a dinosaur.…We’re living in an era where Todd Kliman [of the Washingtonian] reviews a restaurant as it happens” via Twitter.

Their alarm at this news is understandable. Many restaurants have shorter life spans than the average prime-time program, which means that these places grow, mature, and gray quickly. A Zagat rating based on a year-old survey—or older—is the equivalent of judging this season’s Mad Men by the episodes of the previous season. Take, for example, the rating in the 2010 Zagat guide for Black’s Bar & Kitchen. Jeff Black’s Bethesda operation scores a respectable 24 for food, but that rating is based on a survey likely tabulated when Mallory Buford was executive chef in mid-2009. Black’s is now on its third different executive chef since Buford left. “Things do change [at restaurants],” Black says, “and they change quickly.”

Makoto may be one of the few exceptions to that rule. Time doesn’t stand still here—but it actually seems to expand, as if you get two minutes for every 60 ticks around the clock. Part of the sensation can be traced to a pair of unyielding policies at Makoto: You must take off your shoes in the anteroom and don slippers, and you must silence your cell phones. These house customs leave your toes swaddled in pillowy comfort and leave you to contemplate the finer things about the restaurant experience: your food, your dining companions, and your deepest, most neurotic thoughts.

Depending on the quality of the latter two, it’s often best to focus on the food. Yoshi Itoh, chef and co-owner of Makoto, has developed a disciplined kitchen that can quickly produce a small banquet of plates, some so good you’ll wonder why there’s not a line snaking around this restaurant every night. Deep-fried soft-shell crabs breaded with pebble-sized crumbles of rice cracker. Strips of medium-rare tenderloin so rich and tender they practically slide down your throat with the soy-based sauce. Wasabi-smeared slivers of fresh fish perched atop the fluffiest sushi rice you’ve ever seen, each piece of nigiri expertly balancing its heat with its sweet.

And yet for all its devotion to the fine art and technique of Japanese cooking, Makoto is not one point away from perfection, at least not according to my own internal guide. The tuna served as part of my sashimi course during a recent visit was mealy and gummy, while the flounder was flavorless. The dessert of shaved ice, flavored with fruit and Grand Marnier, was refreshing enough but, frankly, has worn out its welcome after countless appearances on Makoto’s omakase menu. Then there’s the squadron of female servers, who balance the gentility of a geisha girl with the fastidiousness of an English nanny. I can’t tell if they want to sit with me or tell me to clean up my room.

So how does a place like Makoto reach the pinnacle of the Zagat food ratings? If you research the published literature on Zagat, you’ll come across stories of restaurateurs trying to game the voting system. They’ll blast e-mails to the diners in their database, reminding them to cast their votes before the Zagat survey period ends. Their message is implied but clear: Stuff the Zagat ballot box for their restaurant. Some restaurateurs might even offer discounts, or other gifts, to those diners who cast ballots, despite the fact that this kind of tit-for-tat vote solicitation can get you banned from the Zagat book.

Jeffrey Buben, owner of Bistro Bis and Vidalia, knows for certain that some restaurateurs try to outsmart the Zagat system. He’s one of them (though without the promise of any kitchen bribe). In the past, he’s placed little promotional tents on the tables or slipped cards into the checks, asking diners to vote in the next Zagat survey. His goal is to land a Top 5 ranking in Zagat’s food category. He doesn’t apologize for it, either. “That’s what grass-roots PR is all about,” Buben says. He leaves it up to the Zagat data-crunchers to weed out the questionable ballots, which they claim they can do.

Makoto has accomplished exactly what Buben was aiming for. The restaurant opened either in 1992 or 1993 (neither Makoto manager Michiko Lecuyer nor anyone at the restaurant could remember), and for its first few years, it never even appeared in the Zagat guide. But then in 1997, it suddenly scored 28 out of 30 points for food, tying it for second place with L’Auberge Chez Francois in the entire D.C.market. Makoto has never slipped lower than third place since then, a run of more than 12 years.

Our Readers Say

Nice piece. Agree about Zagat's time being passed, but have to question your upholding Yelp as the future of dining reviews. Have a look at the top rated DC restaurants on Yelp. No 1. is that hot new place all the foodies and critics are buzzing about: Obelisk (all the way down at #24 on Washingtonian's 2009 list), and at No 2 is, you guessed it, good ol' Makoto. As The Minutemen once titled a song, "The Roar of the Masses Could be Farts".
Did anyone else smirk after reading this article in the printed paper, only to find yet another rehashed list of stale restaurant reviews on the following pages? Perhaps City Paper should take its own advice and can this practice, or limit printing reviews to those created in the past 60 days.
Foodie Frank,

I think that's a fair point, but I would say this in defense of those reprinted blurb reviews: They are months old at the moldiest, since a number were drawn from the 2009 Dining Guide, which was completed in June. Also remember this: We eat our own meals and pay for them ourselves. Zagat constantly gets free data supplied by people whom you don't know if they pay for their meals -- or even eat them.
"Zagat constantly gets free data supplied by people whom you don't know if they pay for their meals -- or even eat them." That's making an assumption about Zagat's sample pool. And who says on-line sources aren't vulnerable to "ballot-stuffing"?
Zagat's reviewers are self-selected? Well, isn't signing on to a website to submit a review also self-selection? Self-selection could be weeded out by doing a random exit-polling of customers coming out of the restaurant - but how likely is that.
First of all great article.

We are now coming to a time where the uneducated masses from Yelp are actually influencing food consumers for localities. This is a step backwards, because many yelp types rate average restaurants as a "5". Having no basis for discrimination, and unsophisticated palates trained by McDonalds, they overrate mediocrity, and reward slavish old themes.

We need guides more democratic than Zagat, but having at least written by those having a modicum of culinary knowledge, unlike Yelp.
Please, let Zagat stay. I get visitors from all over the world and without Zagat, I'd be so stressed out trying to make restaurant recommendations to them. So far, none of my visitors have complained about Zagat.

Thank you, Zagat, for keeping me sane!
Does anyone else find it ironic and borderline asinine that an author from a bankrupt local weekly is trying to cheerlead the end of a print publication? The old City Paper, you know before they went BANKRUPT, had much better writing, more writers, deeper coverage, cut fewer corners, etc... but unless you're on a vendetta who has the time to do the deep dive and show the comparisons of WCP's downfall. By even going after Zagat (really? what is it 1995?) in a day when Yelp and Citysearch are the big players and with juicy stories involving payola for advertising restaurants, current ballot-stuffing, strong arming tactics, etc going on with those sites it shows that WCP is a real print dinosaur. This story would have been great 10 years ago.
This article brings back so many memories. Shortly after my husband and I moved into our co-op I was returning from lunch with my friend Slim and right in front of our building was a small person handing out booklets. My doorman Benny was trying to shoo him away but Slim put a halt to that and urged me to accept a copy. Apparently one of her children had been given one the week before. "Oh take one" Slim demanded. "It's very funny. I think the Harvard Lampoon is behind it." Reluctantly I took one-it turned out to be a Zagat Guide (or, as they would have it, "Guide") "Read what they say about where we just had lunch" Slim told me, turning to the page where our restaurant was listed. I first noticed the hieroglyphics next to the name (Slim and I both assumed Masonic origins) and then I read that our restaurant "serves" "good" "food". I thught that very insulting, since the restaurant was indeed very good, at least it was then, and those irony quotes (like "luxury" Disney cruises) put me off. But as I kept reading I saw there "was" "a" "kind" "of" "poetry", albeit crude, behind the efforts of "Tim" and "Nina" "Zagat". (Slim, to her dying day,swore that "Nina Zagat" was a pseudonym of Thomas Pynchon's).

Thank you again for bringing back that lovely afternoon with Slim and the "Zagat" "Guide",

Valda
Zagat's reviews are way more useful than Citypaper's. Actually, Zagat, the Post, Washingtonian, and even AOL Cityguide all have more useful restaurant reviews than Citypaper.

Zagat isn't some wizard of oz mystery...it's a survey. I've participated...I've been quoted in print, and I've even won a random $100 gift certificate for participating. All you need to do is provide ratings from 0-3 for three categories, do this for three restaurants, and you get a free copy of their print guide for that city. What's so fucking erudite about that?

Seriously...Zagat has some uber-foodsnobs, and some others who wouldn't know a steak from a Big Mac. But for the most part it's a very accurate, focused, and comprehensive survey with lots of great restaurant info.

If you want to take them down, Citypaper, maybe have your editors and readers focus on nightlife or something...but simply bitching and whining for Zagat to go away doesn't make your paper any better.
Zagat also promotes illegal votes by offering a free guide for anyone who submits at least 1 vote for that area. In essence someone can submit fraudulent votes and still receive a free guide when it publishes. Also, the editor will remove the restaurants info if they had a bad experience or alter the votes if it is their favorite in the area. The websitte is impossible to cancel once you pay for the monthly service apparently this is intentional to maintain a high subscriber and voting pool which Zagat sells the listing to other companies with your eating habits and personla info.
Why isn't there a link to the SmartMoney story? It reveals in depth, the methodology and problems with the Zagat system. It also reveals that this article hewed very closely in methodology to a story written two years ago. Here's the link: http://www.smartmoney.com/spending/rip-offs/zagat-math-20819/
By the way, to get an average of 28.8495 by averaging integer votes, you need at least 93 votes (if 28.8495 is a correctly-rounded version of the true average) or at least 113 votes (if 28.8495 is a truncated version of the true average).

To get 28.9024, you need at least 41 votes.

Leave a Comment

Note: HTML tags are not allowed in comments.
Comments Shown. Turn Comments Off.
...