Share

Food Companies Get Smart About Artificial Intelligence

AI and machine learning are adding value to product development and sensory evaluation, not to mention operations and logistics. Here’s a look at how some progressive players—both established giants and entrepreneurial innovators—are applying these technologies.
Robot at computer screen

For Nestlé and Nuritas, artificial intelligence (AI) is helping identify proteins that lead to healthier foods. Kraft Heinz’s focus for now is using AI to optimize operations and enhance relationships with stores, sales reps, and consumers. Kroger plans to leverage AI through a new investment in start-up distribution specialist Ocado. And Domino’s is harnessing AI to help with phone orders of pizza.

The food business finally is doing a deep dive with artificial intelligence and its close companion, machine learning (ML). A fleet of start-ups is hoping to exponentially improve the process of ingredient discovery and development, trying to optimize seed cultivation and livestock output, and improving customization of commercial diets. Established giants are trying to keep pace by using AI and ML in product R&D as well as across the spectrum of operations and relationships.

“We keep finding areas where AI and ML can be applied to help our organization ‘be the best food company,’” says Francesco Tinto, global chief information officer for Kraft Heinz, citing the company’s slogan. “The road to leverage [these technologies] is not a destination but more like a journey.”

It’s a journey that must be hurried. Traditional food and beverage companies are struggling mightily with competition from start-ups and private labels, and food industry employees—from CEOs to factory workers—are losing their jobs in the process. So they’re pressing AI and ML into service across the board, perhaps most promisingly in improving and accelerating product innovation.

Jason Cohen“About 95% of new food and beverage products fail in their first three years on the market,” says Jason Cohen, founder and chief executive officer of Analytical Flavor Systems, a start-up that uses AI and ML to predict humans’ perceptions of flavor, aroma, and texture—and, by proxy, predicts the chances of success for a new product. “It doesn’t matter the size or category or level of R&D spending: Failure rates from concept development are through the roof.”

Playing Catch-Up
But the business is behind in AI, just as it was initially in e-commerce. The food and beverage industry doesn’t even register on an “AI Heatmap” of deals distribution in 24 verticals compiled by CB Insights, where health care and advertising are two of the most active; agriculture is No. 17. And pharmaceuticals, a business closely related to food, has darted ahead of it in AI, partly because the payoffs from discovering new drugs can be enormous, which is not necessarily the case in foods and beverages.

Food and beverage companies also typically are among the least prepared to exploit the power of AI and ML because of deficiencies in the raw material required by those technologies: data to crunch, massage, and extrapolate from.

Tony DeLio“We in the industry haven’t been generating as much data as other industries where this can be applied,” says Tony DeLio, senior vice president of corporate strategy and innovation for Ingredion, a major ingredient developer and supplier. “We haven’t necessarily done a good job of structuring the data as we’ve captured it so we can utilize it. And, honestly, the industry really hasn’t focused on this until now because the cost has been too high.”

Another reality is that AI is not a panacea. For one thing, its emphasis on engineering may seem at cross-purposes with the biggest trend in the industry: consumer demand for the pure and natural, unadulterated and unaltered. “No one wants to feel like they’re eating Frankenfood,” says Ken Harris, managing director of Cadent Consulting, which works with food companies.

Also, some early flame-outs damaged AI’s reputation in the industry. Seven-year-old Hampton Creek was a start-up sensation, with founder Joshua Tetrick initially promising a stream of plant-based products and lately patenting an AI system dubbed “Blackbird” to research proteins at the molecular level. But Tetrick squandered early retailer and consumer fascination with Hampton Creek and products such as Just Mayo, sinking into financial scandal, legal battles, and food safety concerns that prompted Target to remove its products from shelves last year.

U2’s Bono (far left) and The Edge (third from left), Nora Khaldi and CEO Emmet Browne. Accelerating Discovery
Nuritas hopes for far better results. Founder Nora Khaldi is an Irish mathematician who established the company in 2014 to use AI and genomics to identify bioactive peptides in plants that could provide health benefits in foods. Early investors, to the tune of a total of $30 million, include U2’s Bono and Salesforce CEO Marc Benioff.

“I recognized that the industry was taking too long—seven to 10 years and at least $35 million—identifying one scientifically proven ingredient that could benefit human health, and even with all of that, only at an accuracy rate of 0.1 percent,” says Khaldi.

Peptides are the most potent molecules in food because “every signal that occurs in the human body is based on peptide attraction of DNA,” Khaldi explains. “Yet there are billions of peptides in a common apple, and most of them haven’t yet even been found, much less analyzed. We came up with an accelerated way to find things that have always been there, but humankind has never been able to find them.”

The Nuritas AI platform combines the company’s own research with two centuries of scientific literature, patents, and other information sources to target diseases and conditions including diabetes, aging, and loss of muscle mass. It predicts which peptides might help. Then Nuritas scientists try to “unlock” the substance for real-world applications. Machine learning all along improves the process, which has been shown to identify peptides 10 times faster and 500 times more accurately while significantly cutting costs, the company says.

Already, Nuritas has reached a deal with Nestlé to identify and exploit peptides for a health-oriented application that neither company will disclose. Nuritas also has partnered with BASF to commercialize a network of its existing peptides as an anti-inflammatory ingredient in medical foods, supplements, and functional foods, and to work in other areas of interest for the Germany-based chemical giant.

And Khaldi believes it won’t be long before Nuritas helps a CPG company develop a nutrition bar for prediabetics. “They could consume it on a daily basis to prevent them from going to diabetes,” she says. “There’s nothing on the market that does that.”

Applying AI to Sensory Analysis
Analytical Flavor Systems harnesses AI and ML for a different purpose: identifying ingredients and foods that consumers will love and selling that research to food and beverage companies.

In a drive to help clients come up with hyper-personalized foods, the company takes three sources of data—its own R&D, large-scale consumer panels, and tastings by client CPG companies—and plugs it into an AI-based algorithm that helps overcome the predictive shortcomings of traditional methods.

Its Gastrograph is a smart phone app whose central feature is a wheel with 24 spokes, where each sliver represents a discrete category of sensory experience, such as “meaty,” “bitter,” or “mouthfeel.” Research participants indicate the intensity of their perceptions of a product along these specifications. It also gathers demographic and lifestyle data.

“We can translate all the data into target markets and tastes, so we can model preferences,” Cohen says. “And once we understand what individual demographics taste in products, we can predict what they like and dislike.”

Gastrograph wheel

The algorithm also makes decisions about whether the taste preferences of various cohorts are expressions of physiological characteristics or learned behaviors. It can help predict predilections for flavors that testers can’t name or maybe have never experienced before. And if, for example, there are no Germans on the taste panels, Gastrograph infers what Germans would like anyway.

Another start-up, FlavorWiki, uses AI and ML to extrapolate taste preferences and help established food companies and start-ups alike avoid the expense of continually engaging large panels of consumers or high-cost, sensory-trained tasters.

FlavorWiki on smartphone.“We’ve built an algorithm that is able to process simple digital inputs that an untrained person can give us, say distinguishing between two flavors and textures rather than having to scale them—and then it develops those into profiles,” says founder Daniel Protz. “Over time, working with actual panels, FlavorWiki optimizes the data.”

FlavorWiki also helps clients understand what factors truly drive satisfaction as consumers experience existing products. “It’s not actually really known,” Protz said, “why many successful brands and products succeed.”

AI in Product Development
Among old-line food companies, Harris says, use of AI so far has fallen into two main camps. First, big beverage companies are harnessing the technologies in an unending search for sweeteners that replicate the appeal of sugar without the calories, after current alternatives ranging from aspartame to stevia haven’t provided an ultimate solution.

Beverage makers are among the industry’s most active users of AI applications in product development. Coca-Cola, for instance, last year decided to launch Cherry Sprite as a new flavor based on monitoring data collected from the latest generation of self-service soft-drink fountains, Freestyle, which allow customers to mix their own drinks. And Carlsberg has launched the Beer Fingerprinting Project, which uses AI to reduce time and cost in developing new types of beer, in conjunction with Microsoft, with an advanced “sensor platform” that can determine complex flavor compounds in beverages.

A second tranche of interest in AI by the established industry is ingredient and end-goods companies “trying to create products using different elements to come up with food that is essentially better in nutrients but has the look, taste, touch, and feel of things that we’re familiar with,” Harris says.

Ingredion is one of those. Helped by the fact that off-the-shelf AI algorithms have become practically free over the past few years, the company is scrambling to use AI and ML to turbocharge substance discovery and experimentation. “We’re starting that journey, and it’s exciting,” DeLio says.

For example, Ingredion has hired AI experts and has begun applying the techniques to starch and other texturizers, soon to move on to more classes of ingredients. The company is agglomerating data from three primary sources to feed AI’s capabilities: information on consumers, sensory data that it has been accumulating for decades, and a new system for generating texture data called Texture Robotics Experimenter.

“T-Rex” is a series of nine different robots that perform a range of texture measurements to help understand how a product’s performance is affected by other ingredients or by conditions such as cooking temperatures and times, and process shear. The platform can precisely screen texture systems up to 10 times faster than traditional methods, which may have involved scouring the world for dozens of existing products and testing some with consumers. T-Rex nicely tees up all this great new data for AI applications.

“With AI starting to come into play,” DeLio explains, “we can start to project. We can link in more of the sensory stuff with the rheological data so that we can start to predict an optimized texture for, say, a yogurt product. And if someone wants to mimic this sort of texture, we can go in and, through our system, pretty accurately define an ingredient solution that gets you to that texture.”

Similarly, Kraft Heinz is experimenting with AI and ML in product development as well as packaging, Tinto says. “We believe there are opportunities hidden in multiple places in the organization, and we are actively looking to uncover hidden gems anywhere we can find them,” he says. The company’s “analytics innovation process allows us to test and learn quickly across all areas of the company and geographies to look for opportunities to leverage new ways of working, using advanced analytical techniques.”

Still, Tinto, DeLio, and peers across the CPG industry are running into complications as they grapple with a technology that they know will help dictate their future.

For one thing, DeLio says, “Food is complex.” He began his career in instant coffee, searching for aromas among 3,000 identified flavor ingredients. “If you got one of them wrong,” he says, “it’s, ‘This one smells like burning tires.’”

The psychological nature of food consumption can throw curves that even the best AI and ML can’t solve so far. “Pharma can develop AI operations that measure very specific things, but it’s simpler because there’s only one output, and you don’t worry about too much other than that,” DeLio says. “But what’s handicapped the food industry is that most decisions on formulation come down to tasting it, and capturing what humans think is a very complex process of assimilating a lot of inputs.”

Thinking Beyond Algorithms
Cathy Kapica agrees. “Especially thinking about food, there is an irrational aspect as well as a huge emotional component that no algorithm is going to be able to capture,” says the food scientist who formerly was global head of nutrition for McDonald’s and now leads the Awegrin Institute, a food policy think tank. “Those things you’re not going to get from AI until we get a quantum computer.”

Kapica further argues that AI can lead down rabbit holes in the food and beverage industry if it’s misdirected in the first place. “AI is only as good as the programmer who’s programming the thing,” she says. “That’s especially important with product development, where human creativity and innovation are crucial. Technology can’t do everything. And to think that you can replace humans—especially around something like food—is short-sighted, especially in consumer preferences, which change. Humans can’t even predict what humans will do.”

For example, Kapica says, AI and ML were unlikely to have presaged today’s boom in gluten-free foods by extrapolating demand from existing products. “Who would have thought gluten-free would be a big deal despite how it tastes?” she says. “An algorithm wouldn’t have predicted that.”

Another example: AI and ML can’t suggest “healthy” or “nutritious” foods because “there’s no consensus on what that means,” Kapica says. “So if we can’t agree on the parameters for an algorithm in this area, you’d have, ‘Garbage in; garbage out.’”

Food companies also must learn to interpret their growing interest in AI and ML for consumers and other constituencies who have been pulling them strongly in the direction of transparency and simplicity in every phase of their operations, especially in product formulations, supply-chain sourcing, and packaging.

“AI has the potential to transform food and beverage, but with challenges that other verticals don’t have,” says Harris. “It isn’t the benefit of the technology and the accelerated learning that’s the issue, but rather the countervailing demands from consumers for authenticity and simple, natural ingredients.”

For such reasons, Harris says, some CPG companies have looked at making significant investments in AI and ML and have backed off, choosing at least for now to stick with conventional means of product development.

“They’re sophisticated,” he says of these companies, which he declined to identify. “But they’re trying to go back to creating food using very tried-and-true methods and forcing themselves to use worn-out tools to do it.”

Still, in an industry that has only begun to touch on the possibilities for artificial intelligence and machine learning, even these companies might not be holdouts for long.

IFTNEXT is made possible through the generous support of Ingredion, IFT’s Platinum Innovation Sponsor.

Creating Customized Eating Plans With AI

Habit’s algorithm-driven system develops individualized eating plans. For those seeking to live healthfully, hundreds of diet options are available, and finding the most optimal can be challenging. One of the biggest promises of artificial intelligence and machine learning for the food business is to give consumers a choice of just one diet: the one that’s individualized for them alone.

Neil Grimmer figures his start-up, Habit, has a pole position to win this race. He sold Plum Organics to Campbell Soup in 2013 and then, after assessing his own flagging health, got Campbell to invest $32 million in a company he was forming to provide “personalized nutrition blueprints.”

A customer sends his DNA, detailed personal information, and $299 to Habit and gets an individualized diet plan. “All of the information goes into our nutrition-intelligence engine, which is driven by algorithms that help define all the personalization that goes into our recommendations,” Grimmer explains.

Habit also provides regular phone coaching by registered dietitians, which recently was augmented by another AI-driven feature: a “bot” named Ally that is a text-based coaching program, available for another $129. “Ally allows our human coaches to spend more time on high-value-add interactions instead of the more transactional kinds of things,” Grimmer says.

And he promises more. “We’re only at the early stages of embracing the capabilities of AI in our coaching experience,” he says. “We want to augment our ability to drive personalization with a human touch.”

Virta applies the individualization capabilities of AI and ML to a specific malady: Type 2 diabetes. Using those technologies, Virta applies a ketogenic diet to the particulars of an applicant and, for $500 up front and $370 for the first year, aims to thwart or reverse the advance of the disease by providing personalized dietary guidance and health coaching, information and supplies, and an app that helps adjust its treatment on the fly around individual biochemistry.

“We help patients find the sweet spot that’s perfect for them and understand what their nutrition should look like for the long run,” says Brett Volk, a Virta clinical specialist. In the short run, Virta looks promising: 60% of patients from an initial clinical trial had reversed Type 2 diabetes and 94% of insulin users had reduced or stopped usage altogether.

Zipongo has taken a more oblique approach to improving human diets: by working through employers who figure healthier employees are better employees.

The company harnesses AI and ML for its digital nutrition platform but goes beyond merely suggesting personalized meals. Zipongo helps employees navigate a company’s cafeteria menu to find healthy choices as well as helps them with their off-hour selections. Then Zipongo charges the employer a per-person fee ranging from rich-text__embed l-rte-full to a few dollars per capita. More than 150 companies are onboard so far, including Google and IBM.

“We’re pre-integrated into the menu data with Compass [foodservice] systems and so we can give an employee a personalized, prefixed mini-menu each day that will fit within their preference sets,” says Jason Langheier, founder and chief executive officer. “Maybe you’re vegan, or you have this allergy, or you’re trying to improve your blood pressure. It’s, ‘Try these foods; you’ll like them; and they’re offered in the cafeteria today.’”

Smart Technologies Help Companies Optimize Operations

Online grocery shopping and fulfillment platformTheir ranks include some of the most disciplined manufacturers, distributors, marketers, and salespeople in the world, so it’s little surprise that operations teams tend to be at the leading edge of food industry artificial intelligence and machine learning applications.

“With things that have fairly hard-and-fast processes and end points, such as the supply chain and food safety, AI can be tremendous because it improves efficiencies,” says Cathy Kapica, an industry consultant.

Thus, Hershey is using AI to counteract the effects of temperature on the weight of Twizzlers as they’re being manufactured in its plant in Lancaster, Pa. Machine learning is teaching robots to make tiny adjustments and avoid heavy scrappage that human operators couldn’t prevent by adjusting extruders up to 12 times a day.

Meanwhile, Ingredion is beginning to use the Internet of Things and working with AI and ML to monitor preventive-maintenance needs at its 40 facilities worldwide.

“If equipment goes down and some of these continuous processes have to stop, it’s big money, maybe rich-text__embed l-rte-full million a day,” says Ingredion’s Tony DeLio. “But everything is connected now, and we can get real-time information as well as proactively address needs.”

On the distribution and retailing front, Kroger just boosted its ownership to 6% of Ocado, a United Kingdom–based online grocery shopping and delivery platform that uses the technologies to forecast demand, make it easier for its robots to pick warehouses for individual customers’ food orders, and optimize delivery routes. The supermarket giant will roll out the Ocado platform through its 2,700-plus stores.

AI and ML are helping in shopper marketing, too. For example, tech vendor Cloverleaf has introduced AI-powered digital signs that slide over retailers’ shelves to give brands some insights about who’s standing in front of their store displays. In the ShelfPoint platform, a digital screen wraps around the shelf and flashes ads even while built-in optical sensors detect information about the shopper, anonymously providing information about customer demographics and shopper reactions that companies including Procter & Gamble and Coca-Cola are plumbing.

Francesco TintoKraft Heinz is typical of CPG companies that are trying to get their arms around all the various capabilities of AI—before the competition does. Global Chief Information Officer Francesco Tinto is pressing AI and machine learning into every crook and crevasse across the $25-billion enterprise, identifying waste, inefficiencies, and areas ripe for trimming and optimization in manufacturing, supply chains, sales, and even IT itself.

“AI has had immediate and measurable impact in our operations function in several areas,” Tinto says. For one thing, “We’ve been able to leverage AI to capture the implicit knowledge of plant schedulers and improve our plants’ productivity."
"For example, the company faced a challenge on how to maximize throughput of coffee, one of its major products. Traditionally, human roasters made the decisions about when to roast coffee, and for how long, based on their experience, production requirements, and environmental variables such as humidity.

Now Kraft Heinz is using AI to create a new algorithm that took every variable the expert used—including production constraints, changeover times, and packing requirements—and added more relevant variables, optimizing the production schedule. “Now,” Tinto says, “we’ve got better yields and compliance than [with] the previous program generated by the expert."

In the warehouse, the company uses AI and ML to recommend carriers that are redeploying products between warehouses. That has “reduced the labor required to produce a redeployment plan by 95% percent,” Tinto says.

And Kraft Heinz sends its growing AI and ML capabilities into the marketplace with its brands and products as well. These applications range from digital recommendations of Thanksgiving recipes to customers to optimizing the product selection at the 60,000 stores that carry its products.

On the foodservice side, Starbucks keeps rolling out its cloud-based Digital Flywheel program that uses AI to make coffee and snack suggestions to its regulars each day, including different recommendations on a rainy day than on a sunny one.

And Domino’s is harnessing AI and ML to train its natural-language voice-recognition assistant, Dom, to help on the phone. At this point, because it involves two humans interacting, ordering by phone is much more subject to mistakes and misunderstandings than online transactions.

“That’s where AI comes in,” says Dennis Maloney, Domino’s chief digital officer. “It helps Dom learn those processes and how to refine them over time. If we can create every good repeatable process for handling phone orders in our stores, that’s the best and most consistent way to create a great—and consistent—pizza experience for all of our customers."

And yet when it comes to factors such as coupons and other promotions and payments, human interactions in phone ordering are still too complex for the technologies to handle. “We’re working on that,” Maloney says.

And the world’s No. 1 pizza chain has only gotten started with AI and ML, he says.

“The amazing thing about it is if you peel these technologies back, they’re just ways to handle lots and lots of data beyond what you were ever able to handle as a human being, and extract intents or insights out of the data, and change algorithms as a result,” Maloney observes.

So, he says, “There are literally hundreds of things we can be using AI for in our data, from marketing to the supply chain and even to hiring people."

 

Dale Buss is a freelance writer based in Rochester Hills, Mich. (daledbuss@aol.com). 

Hero Image: © videodoctor/Adobe Stock

Authors

  • Dale Buss

Categories

  • Food Business Trends

  • Food Product Development

  • Innovation and Insights

  • IFTNEXT

  • Food Technology Magazine