October 1996

How the Tortise Benchmarked the Hare

and other tales of best practices

It takes time and money. It doesn't generate revenue, at least not at first and not directly. It demands that you unbundle your presumptions about how your organization works and take apart each process, step by step: Logistics. Finance. Sales. Promotion. Operations. Compensation.

Who does this process better? That's what you need to figure out. Then, dream up a reason why they should confide their successful ways to you, free of charge. Now, take their secrets, bring them back to your organization and do it even better.

Welcome to benchmarking, one corporate buzzword you probably can't afford to overlook.

A product of the Quality movement, benchmarking emerged a decade ago on the manufacturing floors, human resource offices and engineering conference rooms of such Fortune 500 stalwarts as AT&T, General Motors and Xerox. Aware that foreign competition was eroding their market shares, the blue chips began to adopt a major attitude shift. Humbly, they began with the assumption that their competitors were not lucky, but smart. They assumed those competitors were doing something right. They began by realizing that if they didn't continually reevaluate their processes and make changes -- often revolutionary changes -- they would be eaten for lunch in the not-too-distant future.

They began by shifting the focus away from results and toward processes. That shifted the emphasis, temporarily, away from numbers and toward tougher how-and-why questions. Questions that insiders have traditionally skirted: "How satisfied are our customers?" Or, "What do they complain about?"

Then someone asked, "Can we categorize and rank customer complaints?"

"How many people talk to a customer who calls with a complaint?"

"How many calls came in before the problem was solved?"

"How much did each glitch cost us?"

With the questions came brainstorming. Rather than looking within company traditions and culture to solve the problems, benchmarking teams set out to determine who else might be dealing with the same issues. They turned, not surprisingly, to companies who were not competitors but who had developed reputations as being The Best in particular areas. Federal Express for logistics. Motorola for creating a learning culture. McDonald's for customer satisfaction and standardization.

A race on the tarmac
Creativity created breakthroughs. One airline, perpetually near the bottom in customer satisfaction surveys, delved deeper to discover that it was their departure-and-arrival record that had passengers steamed. Excuses abounded: Union rules! Weather patterns! Biased regulators!

The benchmark team did the unprecedented and began meeting arriving flights on the tarmac. Armed with stopwatches and ledger pads, they found that it was the process of emptying the cargo belly that slowed things down.

Then they asked, "How do we speed it up?" To find the answer, they looked for an analogous process. Who else removes a lot of objects and replaces them in a hurry, over and over? One joking reply: the pit crews at the Indianapolis 500. No one laughed. Pit crews help the driver exit a tight space, assess hundreds of complex mechanical parts, make replacements and slide the driver back in, fast.

Networking their way into the racing industry, the airline's benchmarking team brought their stopwatches and ledger pads to the pit stops. What they learned they applied to the tarmacs of airports around the world. On-time departures improved exponentially. The tortoise had successfully benchmarked the hare.

Epicurean barbecue
Such transformations do not come without effort and the stress caused by massive cultural change. Success stories tell of challenging an industry's conventional wisdom and turning corporate cultures inside out. Advocates talk up the ways companies cut costs and increase profits, learn to do more with less, and work faster with fewer errors and better quality. It's easy to get caught up in the euphoria.

So why is benchmarking as rare in the exposition industry as an epicurean at a barbecue?

"The first time word gets around that a successful trade show completed a benchmarking process, everyone will be doing it," says Michael Hunter, Chair and CEO of Atlanta-based Hunter-Wells International, a sales and marketing consultancy. "Benchmarking is a way to take a giant leap forward, as opposed to making continuous small improvements," explains Hunter, who also chaired the Society of Competitive Intelligence Professionals' First Annual Competitive Intelligence and Benchmarking Conference last spring. "Successful producers understand that what they are selling is a product. And products get stale if they don't evolve -- if they fail to change with the market. If your product development process isn't fast enough to keep up with those changes, your product starts to look old. The market looks elsewhere."

So far the exposition industry has been able to remain innocent of a practice that, in other industries, has become Motherhood and Apple Pie. "How can I put this diplomatically?" muses Alan Konopacki, President of Chicago-based INCOMM International, specializing in exhibition research and sales training. "The trade show industry is not as sophisticated as some others."

Given the text-book definition of benchmarking, show managers agree: It's not done. But if you take a broader definition -- one that encompasses the internal process of evolution and change, then show managers benchmark their events every day. "There are a whole host of things that we take a look at to measure the success of a show," says Fred Favata, President of Fairfield, CT-based independent show organizer Expocon Management Associates Inc.

"In the exhibit area, we look at the number of bellwether organizations -- do you have them in your show? Do they use your show for new product announcements? We look at renewal rates of both large and small exhibitors -- do they upsize? In the attendance area, we identify a profile and set targets for the types of individuals and organizations we need to attract -- are you attracting these types of individuals?" The list goes on. Near the top: profit margins. "We set goals for ourselves and measure against them," he says.

Recognizing that benchmarking is a whole lot more than taking a baseline and setting goals, Favata concedes, "There is some being done, but we need to do a lot more." Expocon uses data from outside the exposition industry, for example, to look at the ratio of sales people to overall employees, and at the revenue per employee. "That goes to overhead -- are you building up your organization through revenue-type people?" He notes that setting up a benchmarking program through an industry association would make benchmark data available for members to share.

One impediment to the process is the show manager mindset: the exposition industry is truly unique. Favata cautions: "I think, when you go across industries, you need to be very careful that you're comparing apples to apples. You need to be fair to yourself. Whether you're looking at advertising, or manufacturing or publishing, be sure that their processes are truly comparable."

Through the looking glass
Benchmarking is not a panacea as much as it is a reflection of how an organization values information and is willing to share it. The show organizers who will succeed at benchmarking are open to change, encourage employees to challenge orthodoxies, listen to customers and respect competitors. They recognize excellence in other organizations and have the imagination to perceive applications for approaches extracted from industries rarely connected to their own.

Start with an honest look in the mirror.

"What business are you in? If you say 'trade shows,' I'd suggest you might be on the wrong track," says Roger Dow, Vice President and General Sales Manager of Marriott Lodging and co-author of Turned On: Eight Proven Principles for Energizing Your Customers, People and Profits. "The real question is: What business do your customers think you're in? They couldn't care less about the inner workings of trade shows, but they're deeply interested in getting information out about their companies and products. In their eyes, you're in the information distribution business."

Now what? Rafael Aguayo, Managing Partner of Islandia, NY-based Millennia Management Associates, would direct you to study your processes. "How do things get done? Who does what? How long does each step take? You'll be doing quite a bit of measuring to obtain this knowledge," says Aguayo, who is a disciple of legendary quality expert W. Edwards Deming and author of Dr. Deming: The American Who Taught The Japanese About Quality.

You'll see how costs, previously hidden in a maze of departments, functions and purchase orders, begin to emerge with chilling clarity. You'll see, for example, the true price tag of landing a new exhibitor versus retaining an existing one; the actual profit margin of that direct mail campaign; and whether your new sales incentive plan increases or lowers profits.

Invariably, you'll begin to see process duplication and outright waste. Cutting the obvious fat will be the easy part. What comes next makes the science begin to look a bit like art. You'll need both creativity and a broad knowledge base (absent that, to be handy with a database search). You'll begin to brainstorm. What other organizations operate using processes similar to yours? Especially, which ones thrive doing those processes that are the heart, soul and nerve center of your operation?

"I would begin with the question: Who's superb at information distribution?" suggests Marriot's Dow. "Perhaps CNN is the place to start." Not unlike an exposition, CNN collects and distributes information to a broad customer base, and maintains and grows that base to appeal to advertisers. "I would also ask: Who's superb at employee motivation and recognition? Take a look at Mary Kay."

Once you stop looking for your own image -- association, independent show producer, or event management company -- you'll go through the looking glass into a fascinating realm of possibility:

  • Supermarkets move tons of merchandise, much of it irregularly shaped or with a short shelf life, from multiple distributors. They create brand loyalty among customers.
  • Retailers from flea markets to Gallerias create a buzz for their selling environments, where boutique stores and independent retailers pay rent and share revenues.
  • Online service providers bring together large numbers of qualified people for information sharing that leads to purchases.

Any and every industry is fair game.

Making first contact
Where do you look for stand-outs? Much benchmarking is done through participation in such organizations as the American Society of Quality Control's International Benchmarking Alliance, which has compiled a voluminous archive of information on the subject and a growing body of benchmarking candidates. Many are Fortune 1000 firms and often maintain formal benchmarking departments.

Some you already know through reputation (often bolstered by big-dollar corporate image campaigns). Invariably, companies that win national and international quality awards, like the Malcolm Baldrige National Quality Award, are besieged with appeals from companies eager to clone their success. Articles in prestigious business journals, such as Harvard Business Review, often feature companies (or individuals) seeking recognition and ego-stroking, which you can profitably supply.

Alternatively, you can locate your own benchmarking ideals by finding excellence close to home. Identify candidates based on personal experience: they're your exhibitors, suppliers or former employers of your employees.

"There are so many good ideas in the heads of the people we hire, who bring them from other companies and other industries, if we're only able to recognize it," contends Favata at Expocon.

After identifying your paragons, what then? Many would-be benchmarkers get stopped at the gate, because of what could best be described as grubby networking manners -- the benchmarking equivalent of eating with your fingers and slurping your soup.

"Don't be a bloodsucking leech!" warns Sarah Olberding, a pleasant tone taking the chill off of the admonition. Olberding, Information Center Manager for the Cincinnati-based Association for Quality & Participation, points out that benchmarking has its own clearly defined protocol and culture. "You don't call someone else demanding information. It's a two-way street. You need to focus not on what they can offer you, but how you can reciprocate. Whether you use terms like benchmarking, competitive intelligence, best in class -- what it really is, is sharing. It's an extension of networking. And you'll be amazed at how much people will share if you approach it in that spirit."

Be prepared to sell yourself to your prospective benchmarking partner with the same professionalism you'd use if going tête-à-tête with a prospective exhibitor or sponsor. They've likely been approached before and want to hear why they ought to work with you. Make the most of the usual sales tools: warm leads, solid professional or personal references and evidence of a stable track record. Be persistent.

Successful benchmarkers are people who read widely, keep up with developments in other industries, strike up and maintain friendships with a diverse array of people, are curious in their outlooks and worldly in their tastes. Their frame of reference far exceeds the boundaries of their industry. They're good at asking questions, so people are flattered by their interest. They're also good at answering questions, providing relevant information as well as citing other useful sources. They're skillful networkers, able to get information and insight by phone calls rather than hiring a team of consultants to undertake a research project (although sometimes that's necessary too).

Benchmarking is an ongoing process, not a done deal. Those who participate are always on the lookout for a partner with whom they can benchmark next. If you do this right, you'll one day be hearing from other organizations eager to benchmark you.


Sidebar: How many definitions are there?

The buzzword has been around for a decade or more, and in that time it's taken on a life of its own. "It's one of those terms you might hear at a Monday-morning staff meeting: 'We've got to benchmark the market criteria this week.' What does that mean? We've got to know what we're doing," says Ken Kanter, Show Manager for Douglas Trade Shows Management in Kailua, HI.

If you ask show managers how they use benchmarking, you get widely divergent examples. One common denominator: bringing about change.

The Hawaii Chapter of the International Association for Exposition Management (IAEM) recently applied the term in the process of communicating their needs for a new convention center. "The figure 200,000 square feet was referred to as a benchmark," says Kanter, who is Past-chair of the chapter and a member of the IAEM board of directors as well as Chair of IAEM's Long Range Planning Committee. "It consolidated in one phrase, the elements that had to be factored into the decision-making process." That was the minimum size, they determined, that could attract events to Hawaii, accommodate multiple events and rapid turnaround, and give show organizers enough space to achieve a return on their investment. "Anything less than that would be non-competitive and, maybe, obsolete."

For Steve Pitt, Executive Director of Member Services, Convention and Exposition for the National Automobile Dealers Association in McLean, VA, benchmarking means staying on the cutting edge. "It's done on a networking level with your peers," says Pitt, who chairs IAEM's Council of Association Exhibitions. "It's being aware of how they're doing things and staying on the cutting edge -- trying to improve, change, move forward and peak each area. We're doing that all the time."

Because every trade show creates a microcosm of an industry, the show itself is an environment in which exhibitors can benchmark their products. "Marketing is something that everyone thinks about," says Kanter. "They're constantly reinventing the process. In the trade show industry, show managers make their money by selling booth space, but they earn their money by delivering buyers to sellers. Those who constantly search for ways to improve that process are the ones who will succeed."


Sidebar: Benchmarking jargon

Benchmarking, according to the American Productivity & Quality Center (APQC), is "the process of identifying, understanding and adapting outstanding practices and processes from organizations anywhere in the world to help your organization improve its performance." APQC Past-president Carl G. Thor adds that this systematic comparison is usually done with the aim of mutual improvement.

"Best in class," "baselines," "stretch goals," "competitive intelligence" and other phrases are sometimes used interchangeably. Best in Class usually refers to a limited kind of benchmarking, one which stays within the industry or type of organization.

The terms baseline and stretch goal are sometimes confused with benchmarked data; in actuality, a baseline is simply the starting point which you hope to improve, and a stretch goal is the figure you're aiming to reach. For example, if you had 65 percent exhibitor retention last year, and you have your mind set on increasing that to 75 percent, then 65 percent is your baseline and 75 percent is your stretch goal.

Competitive intelligence is information about a company obtained not necessarily with the cooperation, or even the permission, of that company.


Sidebar: A Guide To Benchmarking Ethics

The International Benchmarking Clearinghouse of the American Productivity & Quality Center offers the following advice on benchmarking ethics:


PRINCIPLE OF LEGALITY

If there's any question on the legality of an activity, don't do it.

Avoid discussions or actions that could lead to or imply an interest in restraint of trade, market and/or customer allocation schemes, price fixing, dealing arrangements, bid rigging or bribery. Don't discuss costs with competitors if costs are an element of pricing.

Refrain from the acquisition of trade secrets by any means that could be interpreted as improper, including the breach of, or inducement to breach, secrecy. Do not disclose or use any trade secret that may have been obtained through improper means or that was disclosed by another in violation of a confidentiality agreement.

PRINCIPLE OF EXCHANGE

Be willing to provide the same type and level of information that you request from your benchmarking partner to your benchmarking partner.

Communicate fully and early in the relationship to clarify expectations, avoid misunderstanding and establish mutual interest in the benchmarking exchange. Be honest and forthcoming.

PRINCIPLE OF CONFIDENTIALITY

Treat benchmarking interchange as confidential to the individuals and companies involved. Information must not be communicated outside the partnering organizations without the prior consent of the benchmarking partner who shared the information.

A company's participation in a study is confidential and shouldn't be communicated externally without the company's prior permission.

PRINCIPLE OF USE

Use information obtained through benchmarking only for purposes of formulating improvements in operations or processes within the companies participating in the benchmarking study.

The use or communication of a benchmarking partner's name with the data obtained or practices observed requires the prior permission of that partner.

Don't use benchmarking information, or any information resulting from benchmarking-related activities, as a means to market or sell.


Sidebar: Resource List

American Productivity & Quality Center's International Benchmarking Clearinghouse, Houston, TX: (800) 776-9676 or (713) 681-4020. Helps organizations find and adapt best practices through benchmarking, as well as learn from one another through networking, benchmarking studies, consortium studies, knowledge transfer and the sharing of outstanding practices (http://www.apqc.org/).

American Society of Quality Control's Benchmarking Competency Center, Milwaukee, WI: (800) 248-1946 or (414) 272-8575. Section of the Quality Management Division specializing in establishing alliances with other organizations in the area of benchmarking, process improvement and reengineering (http://benchnet.com/bcc/).

Association for Quality & Participation, Cincinnati, OH: (513) 381-1959. Provides resources for achieving goals in quality improvement, human resource development and customer service through employee involvement.

The Benchmarking Exchange, Aptos, CA: (800) 662-9801 or (408) 662-9800. On-line resource dedicated to the practice of benchmarking, reengineering, and process and quality improvement (http://www.benchnet.com).

Society of Competitive Intelligence Professionals, Alexandria, VA: (703) 739-0696. Dedicated to the ethical gathering, analysis and dissemination of information about competitors and the competitive environment to gain a competitive edge (http://www.scip.org/).


Stay informed with Expo's weekly e-newsletter:
Get daily industry news via RSS What is RSS?