E-Commerce Recommender applications Page 1 of 24 E-Commerce Recommendation Applications J. Ben Schafer, Joseph A Konstan, John Riedl GroupLens Research Project Department of Computer Science and Engineering University of Minnesota Minneapolis, MN 55455 1612-6254002 (schafer, konstan, ried@cs. umn. edu ABSTRACT Recommender systems are being used by an ever-increasing number of E-commerce sites to help consumers find products to purchase. What started as a novelty has turned into a serious business tool. Recommender systems use product knowledge - either hand-coded knowledge provided by experts or"mined knowledge learned from the behavior of consumers- to guide consumers through the often-overwhelming task of locating products they will like. In this rticle we present an explanation of how recommender systems are related to some traditional database analysis techniques. We examine how recommender systems help e-commerce sites increase sales and analyze the recommender systems at six market-leading sites. Based these examples, we create a taxonomy of recommender systems, including the inputs required from the consumers, the additional knowledge required from the database, the ways the recommendations are presented to rs, the technologies used to create the recommendations, and the level of personalization of the recommendations. We identify five ommonly used E-commerce recommender application models, describe several open research problems in the field of recommender systems, and examine privacy implications of recommender systems technology Keywords Electronic commerce, recommender systems, personalization, customer loyalty, cross-sell, up-sell, mass customization, privacy, data lining, database marketing, user interface 1. INTRODUCTION If i have 3 million customers on the Web. i should have 3 million stores on the web - Jeff bezos ceo of amazon com m magine a physical world where there are hundreds upon hundreds of branches of the same store. I have a branch in my neighborhood tailored to my needs, and you have a branch in your neighborhood tailored to yours. In the physical world this would be impossible(notwithstanding a Starbucks on every corner ); however, the movement toward E-commerce-commerce in the virtual space -has produced business strategies that could never exist in the physical world. In his book Mass Customization(Pine, 1993) oe Pine argues that companies need to shift from the old world of mass production where"standardized products, homogeneous tandardized products "Pine argues that building one product is simply not adequate anymore. At a minimum, companies nt ent markets, and long product life and development cycles were the rule to the new world where " variety and customization suppl be able to develop multiple products that meet the multiple needs of multiple consumers. While E-commerce hasn't necessarily allowed businesses to produce more products, it has allowed them to provide consumers with more choices. Instead of tens of thousands of books in a superstore, consumers may choose among millions of books in an online store. Increasing choice, however, has also increased the amount of information that consumers must process before they are able to select which items meet their needs. To address this information overload, e-commerce stores are applying mass customization principles not to the products but o their presentation in the on-line store(Pine and Gilmore, 1999). One way to achieve mass customization in e-commerce is the use of recommender systems Recommender systems are used by E-commerce sites to suggest products to their customers and to provide consumers with nformation to help them decide which products to purchase. The products can be recommended based on the top overall sellers on a site, on the demographics of the consumer, or on an analysis of the past buying behavior of the consumer as a prediction for future
E-Commerce Recommender Applications Page 1 of 24 E-Commerce Recommendation Applications J. Ben Schafer, Joseph A. Konstan, John Riedl GroupLens Research Project Department of Computer Science and Engineering University of Minnesota Minneapolis, MN 55455 1-612-625-4002 {schafer, konstan, riedl}@cs.umn.edu ABSTRACT Recommender systems are being used by an ever-increasing number of E-commerce sites to help consumers find products to purchase. What started as a novelty has turned into a serious business tool. Recommender systems use product knowledge – either hand-coded knowledge provided by experts or “mined” knowledge learned from the behavior of consumers – to guide consumers through the often-overwhelming task of locating products they will like. In this article we present an explanation of how recommender systems are related to some traditional database analysis techniques. We examine how recommender systems help E-commerce sites increase sales and analyze the recommender systems at six market-leading sites. Based on these examples, we create a taxonomy of recommender systems, including the inputs required from the consumers, the additional knowledge required from the database, the ways the recommendations are presented to consumers, the technologies used to create the recommendations, and the level of personalization of the recommendations. We identify five commonly used E-commerce recommender application models, describe several open research problems in the field of recommender systems, and examine privacy implications of recommender systems technology. Keywords Electronic commerce, recommender systems, personalization, customer loyalty, cross-sell, up-sell, mass customization, privacy, data mining, database marketing, user interface. 1. INTRODUCTION “If I have 3 million customers on the Web, I should have 3 million stores on the Web.” –Jeff Bezos, CEO of Amazon.com™ Imagine a physical world where there are hundreds upon hundreds of branches of the same store. I have a branch in my neighborhood tailored to my needs, and you have a branch in your neighborhood tailored to yours. In the physical world this would be impossible (notwithstanding a Starbucks on every corner); however, the movement toward E-commerce – commerce in the virtual space – has produced business strategies that could never exist in the physical world. In his book Mass Customization (Pine, 1993), Joe Pine argues that companies need to shift from the old world of mass production where “standardized products, homogeneous markets, and long product life and development cycles were the rule” to the new world where “variety and customization supplant standardized products.” Pine argues that building one product is simply not adequate anymore. At a minimum, companies need to be able to develop multiple products that meet the multiple needs of multiple consumers. While E-commerce hasn’t necessarily allowed businesses to produce more products, it has allowed them to provide consumers with more choices. Instead of tens of thousands of books in a superstore, consumers may choose among millions of books in an online store. Increasing choice, however, has also increased the amount of information that consumers must process before they are able to select which items meet their needs. To address this information overload, e-commerce stores are applying mass customization principles not to the products but to their presentation in the on-line store (Pine and Gilmore, 1999). One way to achieve mass customization in e-commerce is the use of recommender systems. Recommender systems* are used by E-commerce sites to suggest products to their customers and to provide consumers with information to help them decide which products to purchase. The products can be recommended based on the top overall sellers on a site, on the demographics of the consumer, or on an analysis of the past buying behavior of the consumer as a prediction for future
E-Commerce Recommender applications Page 2 of 24 buying behavior, The forms of recommendation include suggesting products to the er, providing personalized product nformation, summarizing community opinion, and providing community critiques. Broadly, these recommendation techniques are part of personalization on a site because they help the site adapt itself to each customer. Personalization, to this extent, is one way to realize Pine's ideas on the Web. Mass customization originally referred to the physical modification of products and services to make them fit each consumers needs(Pine, 1993). More recently, mass customization has evolved to encompass a wide range of methods for customizing the consumer experience(Pine and Gilmore, 1999). The consumer experience includes the physical products, which can be customized in function or in appearance, and the presentation of those products, which can be customized automatically or with help from the consumer. Under this broader definition, recommender systems serve to support a customization of the consumer experience in the presentation of the products sold on a Web site. In a sense, recommender systems enable the creation of a new store personally designed for each consumer. Of course, in the virtual world, all that changes is the selection of products shown to the consumer, not an underlying physical store Recommender systems are similar to but also different from, marketing systems and supply-chain decision-support systems. Marketing systems support the marketer in making decisions about how to market products to consumers, usually by grouping the consumers according to marketing segments and grouping the products in categories that can be aligned with the marketing selected by the marketer. By contrast, recommender systems directly interact with consumers, helping them find products they wl egments. Marketing campaigns can then be run to encourage consumers in different segments to purchase products from categori like to purchase. Supply-chain decision-support systems help marketers make decisions about how many products to manufacture, and to which warehouses or retail stores to ship the products. These decision-support systems use analytic technology to predict how many of which products will be purchased in each location, so the right products are available for consumers to purchase. Many supply-chain decision-support systems answer questions about aggregates: of all the consumers in Minneapolis, how many will buy toothpaste in February? Recommender systems answer questions about individual consumers: which product will this consumer prefer to buy right now? Recommender systems include processes that are conducted largely by hand, such as manually creating cross-sell lists, and actions that are performed largely by computer, such as collaborative filtering. We will refer to the latter as automatic recommender systems. Automatic recommender systems are specialized data mining systems that have been optimized for interaction with consumers rather than marketers. They have been explicitly designed to take advantage of the real-time personalization opportunities of interactive e-commerce. Accordingly, the algorithms focus more on real-time and just-in-time learning than on odel-building and execution. We study both manual and automatic recommender systems since each offers many interesting ideas about the presentation of recommendations to consumers. This paper serves as an introduction to the elements of recommender systems and their application to e-commerce. Recommender systems enhance E-commerce sales in three ways Converting Browsers into Buyers: Visitors to a Web site often look over the site without purchasing anything. Recommender Increasing Cross-sell: Recommender systems improve cross-sell by suggesting additional products for the customer to purchase. If the checkout process, bacy od, the average order size should increase. For instance, a site mug the recommendations are ght recommend additional products in ed on those products already in the shopping cart click or twe business strategy(Reichheld and Sesser, 1990; Reichheld, 1993). Recommender systems improve loyalty by creating a value-added relationship between the site and the customer. Sites invest in learning about their customers, use recommender systems to perationalize that learning, and present custom interfaces that match consumer needs. Consumers repay these sites by returning to he ones that best match their needs. The more a customer uses the recommendation system- teaching it what he wants-the more oyal he is to the site. "Even if a competitor were to build the exact same capabilities, a customer.. would have to spend an inordinate amount of time and energy teaching the competitor what the company already knows"(Pine, et al., 1995). Creating relationships between consumers can als se loyalty, for consumers will return to the site that recommends people with who they will like to interact This paper makes five contributions to the understanding of the application of recommender systems in E-commerce. First, examine how traditional marketing methods provided a foundation for the growth of recommender systems as a marketing tool in E- adequately explored by the existing applications. Finally, in the appendix, we consider e h parts o t o. the commerce. Second, we present a taxonomy for Recommender Applications, classifying them based on the inputs to the recommender personalization. Third, we examine the patterns that emerge when considering the taxonomy and identify five models or e degree of ess, the method used to generate recommendations, the outputs of the recommendation process to the customer, and the degree of commander applications. These five models are currently the dominant uses of recommender systems in E-commerce. Fourth, we describe four domains of future study for new recommender system applications based our taxonomy that have not beer The paper is useful to two groups: academics studying recommender systems in E-commerce and implementers considering applyi recommender systems in their site. For academics, the examples and taxonomies provide a useful initial framework within which
E-Commerce Recommender Applications Page 2 of 24 buying behavior. The forms of recommendation include suggesting products to the consumer, providing personalized product information, summarizing community opinion, and providing community critiques. Broadly, these recommendation techniques are part of personalization on a site because they help the site adapt itself to each customer. Personalization, to this extent, is one way to realize Pine’s ideas on the Web. Mass customization originally referred to the physical modification of products and services to make them fit each consumer’s needs (Pine, 1993). More recently, mass customization has evolved to encompass a wide range of methods for customizing the consumer experience (Pine and Gilmore, 1999). The consumer experience includes the physical products, which can be customized in function or in appearance, and the presentation of those products, which can be customized automatically or with help from the consumer. Under this broader definition, recommender systems serve to support a customization of the consumer experience in the presentation of the products sold on a Web site. In a sense, recommender systems enable the creation of a new store personally designed for each consumer. Of course, in the virtual world, all that changes is the selection of products shown to the consumer, not an underlying physical store. Recommender systems are similar to, but also different from, marketing systems and supply-chain decision-support systems. Marketing systems support the marketer in making decisions about how to market products to consumers, usually by grouping the consumers according to marketing segments and grouping the products in categories that can be aligned with the marketing segments. Marketing campaigns can then be run to encourage consumers in different segments to purchase products from categories selected by the marketer. By contrast, recommender systems directly interact with consumers, helping them find products they will like to purchase. Supply-chain decision-support systems help marketers make decisions about how many products to manufacture, and to which warehouses or retail stores to ship the products. These decision-support systems use analytic technology to predict how many of which products will be purchased in each location, so the right products are available for consumers to purchase. Many supply-chain decision-support systems answer questions about aggregates: of all the consumers in Minneapolis, how many will buy toothpaste in February? Recommender systems answer questions about individual consumers: which product will this consumer prefer to buy right now? Recommender systems include processes that are conducted largely by hand, such as manually creating cross-sell lists, and actions that are performed largely by computer, such as collaborative filtering. We will refer to the latter as automatic recommender systems. Automatic recommender systems are specialized data mining systems that have been optimized for interaction with consumers rather than marketers. They have been explicitly designed to take advantage of the real-time personalization opportunities of interactive e-commerce. Accordingly, the algorithms focus more on real-time and just-in-time learning than on model-building and execution. We study both manual and automatic recommender systems since each offers many interesting ideas about the presentation of recommendations to consumers. This paper serves as an introduction to the elements of recommender systems and their application to e-commerce. Recommender systems enhance E-commerce sales in three ways: Converting Browsers into Buyers: Visitors to a Web site often look over the site without purchasing anything. Recommender systems can help consumers find products they wish to purchase. Increasing Cross-sell: Recommender systems improve cross-sell by suggesting additional products for the customer to purchase. If the recommendations are good, the average order size should increase. For instance, a site might recommend additional products in the checkout process, based on those products already in the shopping cart. Building Loyalty: In a world where a site’s competitors are only a click or two away, gaining consumer loyalty is an essential business strategy (Reichheld and Sesser, 1990; Reichheld, 1993). Recommender systems improve loyalty by creating a value-added relationship between the site and the customer. Sites invest in learning about their customers, use recommender systems to operationalize that learning, and present custom interfaces that match consumer needs. Consumers repay these sites by returning to the ones that best match their needs. The more a customer uses the recommendation system – teaching it what he wants – the more loyal he is to the site. “Even if a competitor were to build the exact same capabilities, a customer … would have to spend an inordinate amount of time and energy teaching the competitor what the company already knows” (Pine, et al., 1995). Creating relationships between consumers can also increase loyalty, for consumers will return to the site that recommends people with whom they will like to interact. This paper makes five contributions to the understanding of the application of recommender systems in E-commerce. First, we examine how traditional marketing methods provided a foundation for the growth of recommender systems as a marketing tool in Ecommerce. Second, we present a taxonomy for Recommender Applications, classifying them based on the inputs to the recommender process, the method used to generate recommendations, the outputs of the recommendation process to the customer, and the degree of personalization. Third, we examine the patterns that emerge when considering the taxonomy and identify five models of recommender applications. These five models are currently the dominant uses of recommender systems in E-commerce. Fourth, we describe four domains of future study for new recommender system applications based on parts of our taxonomy that have not been adequately explored by the existing applications. Finally, in the appendix, we consider privacy issues that are evolving as more sites begin to implement recommender applications. The paper is useful to two groups: academics studying recommender systems in E-commerce and implementers considering applying recommender systems in their site. For academics, the examples and taxonomies provide a useful initial framework within which
E-Commerce Recommender applications Page 3 of 24 their research can be placed. The framework will undoubtedly be expanded to include future applications of recommender systems Also, the paper identifies research challenges in recommender systems for the data mining community. For implementers, the paper provides a means of making choices among the available applications and technologies. An implementer can choose a moneymaking goal, select the interfaces that will help achieve that goal, and pick an implementation technique that supports the goal within the This paper differs from our earlier work(Schafer, Konstan, riedl, 1999)in several key ways. First, the examples have been updated and expanded to better reflect the rapidly expanding field of recommender systems. Second, the taxonomy has been modified and expanded to more accurately encompass all of the aspects of recommendation technology and to be appropriate for a data mining audience. Third, the opportunities section has been expanded to feature additional ideas and to reflect the current state of the field. Finally, several new sections have been added, including sections relating recommender systems to traditiona marketing techniques and a discussion of privacy concerns 2. Prior and Related Work As merchandisers gained the ability to record transaction data, they started collecting and analyzing data about consumer behavior The term data mining is used to describe the collection of analysis techniques used to infer rules from or build models from large data sets. One of the best-known examples of data mining in commerce is the discovery of association rules-relationships between items that indicate a relationship between the purchase of one item and the purchase of another. These rules can help a merchandiser rrange products so that, for example, a consumer purchasing ketchup sees relish nearby. More sophisticated temporal data mining may suggest that a consumer who buys a new charcoal grill today is likely to buy a fire extinguisher in the next month. More generally, data mining has two phases. In the learning phase, the data mining system analyzes the data and builds a model of consumer behavior(e.g, association rules). This phase is often very time-consuming and may require the assistance of human analysts. After the model is built, the system enters a use phase where the model can be rapidly and easily applied to consumer situations. One of the challenges in implementing data mining within organizations is creating the organizational processes that successfully transfer the knowledge from the learning phase into practice in the use phas recommenders have an offline phase during which they learn a model of customer behavior, and then an online phase during they apply the model in real time. Most recommenders, however, use a lazy learning approach, in which they build and update model while making recommendations in real time. Approaches Many different approaches have been applied to the basic problem of making accurate and efficient recommender and data mining systems. Many of the technologies used in the actual recommender systems studied are fairly simple database queries. Automatic recommender systems, however, use a wide range of techniques, ranging from nearest neighbor algorithms to Bayesian analysis. The worst-case performance of many of these algorithms is known to be poor. However, many of the algorithms have been tuned to use heuristics that are particularly efficient on the types of data that occur in practice The earliest recommenders used nearest-neighbor collaborative filtering algorithms( Resnick et al. 1994, Shardanand et al. 1995) Nearest neig algorithms are based on computing the distance between consumers based on their preference history. Predictions of how much a consumer will like a product are computed by taking the weighted average of the opinions of a set of nearest neighbors for that product. Neighbors who have expressed no opinion on the product in question are ignored. Opinions should be scaled to adjust for differences in ratings tendencies between users( Herlocker et al., 1999). Nearest neighbor algorithms have the advantage of being able to rapidly incorporate the most up-to-date information, but the search for neighbors is slow in databases. Practical algorithms use heuristics to search for good neighbors and may use opportunistic sampling when faced with very large populations essentially as accurate as nearest neighbor methods(Breese et al., 1998). Bayesian networks may prove practical for environments in which knowledge of consumer preferences changes slowly with respect to the time needed to build the model but are not suitable for environments in which consumer preference models must be updated rapidly or frequently Clustering techniques work by identifying groups of consumers who appear to have similar preferences. Once the clusters are created, predictions for an individual can be made by averaging the opinions of the other consumers in that cluster. Some clustering techniques represent each consumer with partial participation in several clusters. The prediction is then an average across the lusters, weighted by degree of participation. Clustering techniques usually produce less-personal recommendations than other methods, and in some cases, the clusters have worse accuracy than nearest neighbor algorithms( Breese et al., 1998). Once the clustering is complete, however, performance can be very good, since the size of the group that must be analyzed is much smaller Clustering techniques can also be applied as a"first step for shrinking the candidate set in a nearest neighbor algorithm or for distributing nearest-neighbor computation across several recommender engines. While dividing the population into clusters may hurt the accuracy or recommendations to users near the fringes of their assigned cluster, pre-clustering may be a worthwhile trade-off
E-Commerce Recommender Applications Page 3 of 24 their research can be placed. The framework will undoubtedly be expanded to include future applications of recommender systems. Also, the paper identifies research challenges in recommender systems for the data mining community. For implementers, the paper provides a means of making choices among the available applications and technologies. An implementer can choose a moneymaking goal, select the interfaces that will help achieve that goal, and pick an implementation technique that supports the goal within the interface. This paper differs from our earlier work (Schafer, Konstan, & Riedl, 1999) in several key ways. First, the examples have been updated and expanded to better reflect the rapidly expanding field of recommender systems. Second, the taxonomy has been modified and expanded to more accurately encompass all of the aspects of recommendation technology and to be appropriate for a data mining audience. Third, the opportunities section has been expanded to feature additional ideas and to reflect the current state of the field. Finally, several new sections have been added, including sections relating recommender systems to traditional marketing techniques and a discussion of privacy concerns. 2. Prior and Related Work As merchandisers gained the ability to record transaction data, they started collecting and analyzing data about consumer behavior. The term data mining is used to describe the collection of analysis techniques used to infer rules from or build models from large data sets. One of the best-known examples of data mining in commerce is the discovery of association rules – relationships between items that indicate a relationship between the purchase of one item and the purchase of another. These rules can help a merchandiser arrange products so that, for example, a consumer purchasing ketchup sees relish nearby. More sophisticated temporal data mining may suggest that a consumer who buys a new charcoal grill today is likely to buy a fire extinguisher in the next month. More generally, data mining has two phases. In the learning phase, the data mining system analyzes the data and builds a model of consumer behavior (e.g., association rules). This phase is often very time-consuming and may require the assistance of human analysts. After the model is built, the system enters a use phase where the model can be rapidly and easily applied to consumer situations. One of the challenges in implementing data mining within organizations is creating the organizational processes that successfully transfer the knowledge from the learning phase into practice in the use phase. Automatic recommender systems are machine learning systems specialized to recommend products in commerce applications. Some recommenders have an offline phase during which they learn a model of customer behavior, and then an online phase during which they apply the model in real time. Most recommenders, however, use a lazy learning approach, in which they build and update the model while making recommendations in real time. Approaches Many different approaches have been applied to the basic problem of making accurate and efficient recommender and data mining systems. Many of the technologies used in the actual recommender systems studied are fairly simple database queries. Automatic recommender systems, however, use a wide range of techniques, ranging from nearest neighbor algorithms to Bayesian analysis. The worst-case performance of many of these algorithms is known to be poor. However, many of the algorithms have been tuned to use heuristics that are particularly efficient on the types of data that occur in practice. The earliest recommenders used nearest-neighbor collaborative filtering algorithms (Resnick et al. 1994, Shardanand et al. 1995). Nearest neighbor algorithms are based on computing the distance between consumers based on their preference history. Predictions of how much a consumer will like a product are computed by taking the weighted average of the opinions of a set of nearest neighbors for that product. Neighbors who have expressed no opinion on the product in question are ignored. Opinions should be scaled to adjust for differences in ratings tendencies between users (Herlocker et al., 1999). Nearest neighbor algorithms have the advantage of being able to rapidly incorporate the most up-to-date information, but the search for neighbors is slow in large databases. Practical algorithms use heuristics to search for good neighbors and may use opportunistic sampling when faced with very large populations. Bayesian networks create a model based on a training set with a decision tree at each node and edges representing consumer information. The model can be built off-line over a matter of hours or days. The resulting model is very small, very fast, and essentially as accurate as nearest neighbor methods (Breese et al., 1998). Bayesian networks may prove practical for environments in which knowledge of consumer preferences changes slowly with respect to the time needed to build the model but are not suitable for environments in which consumer preference models must be updated rapidly or frequently. Clustering techniques work by identifying groups of consumers who appear to have similar preferences. Once the clusters are created, predictions for an individual can be made by averaging the opinions of the other consumers in that cluster. Some clustering techniques represent each consumer with partial participation in several clusters. The prediction is then an average across the clusters, weighted by degree of participation. Clustering techniques usually produce less-personal recommendations than other methods, and in some cases, the clusters have worse accuracy than nearest neighbor algorithms (Breese et al., 1998). Once the clustering is complete, however, performance can be very good, since the size of the group that must be analyzed is much smaller. Clustering techniques can also be applied as a “first step” for shrinking the candidate set in a nearest neighbor algorithm or for distributing nearest-neighbor computation across several recommender engines. While dividing the population into clusters may hurt the accuracy or recommendations to users near the fringes of their assigned cluster, pre-clustering may be a worthwhile trade-off
E-Commerce Recommender applications Page 4 of 24 etween accuracy and throughput. Information filtering and information retrieval involve selecting text items that a user may be interested in reading based on the presence or absence of keywords in the text items. The user can explicitly enter the keywords, or they can be inferred from the items that the user has found interesting in the past. Information filtering or information retrieval systems are often used in search systems on e-commerce sites to help consumers find specific products in which they are interested. These systems have some features in common with recommender systems, in that both systems produce lists of suggestions for a user; however, the more the system provides direct responses to syntactic user queries the less it feels like a recommender system to the user. Information filtering systems that notify users when interesting items are for sale are more like recommender systems, especially if part of the selection process involves attributes that are not under the user's direct control, such as whether other users have liked the item Classifiers are general computational models for assigning a category to an input. The inputs may be vectors of features for the items being classified or data about relationships among the items. The category is a domain-specific classification such as malignant/benign for tumor classification, approve/reject for credit requests, or intruder/authorized for security checks. One way to build a recommender system using a classifier is to use information about a product and a customer as the input, and to have the utput category represent how strongly to recommend the product to the customer Classifiers may be implemented using many different machine-learning strategies including rule induction, neural networks, and Bayesian networks. In each case, the classifier is trained using a training set in which ground truth classifications are available. It can then be applied to classify new items for which the ground truths are not available. If subsequent ground truths become available, the classifier may be retrained over time. Classifiers have been quite successful in a variety of domains ranging from the identification of fraud and credit risks in financial transactions to medical diagnosis to intrusion detection. Basu et al. (1998) built a hybrid recommender system that mixes collaborative and content filtering using an induction-learning classifier. Good et al. (1999)implemented induction-learned feature- vector classification of movies and compared the classification with nearest-neighbor recommendation; this study found that the classifiers did not perform as well as nearest neighbor, but that combining the two added value over nearest-neighbor alone Association rules have been used for many years in merchandising, both to analyze patterns of preference across products, and to recommend products to consumers based on other products they have selected. An association rule expresses the relationship that one product is often purchased along with other products. The number of possible association rules grows exponentially with the umber of products in a rule, but constraints on confidence and support, combined with algorithms that build association rules with itemsets of n items from rules with n-l item itemsets, reduce the effective search space, Association rules can form a very compact representation of preference data that may improve efficiency of storage as well as performance. They are more commonly used for larger populations rather than for individual consumers, and they, like other learning methods that first build and then apply models, are less suitable for applications where knowledge of preferences changes rapidly. Association rules have been particularly successfully in broad applications such as shelf layout in retail stores. By contrast, recommender systems based on nearest neighbor techniques are easier to implement for personal recommendation in a domain where consumer opinions are frequently added, such as on-line retail orting is a graph-based technique in which nodes are consumers, and edges between nodes indicate degree of similarity between wo consumers(Wolfet al. 1999). Predictions are produced by walking the graph to nearby nodes and combining the opinions of the earby consumers. Horting differs from nearest neighbor as the graph may be walked through other consumers who have not rated the product in question, thus exploring transitive relationships that nearest neighbor algorithms do not consider. In one study using nthetic data, Horting produced better predictions than a nearest neighbor algorithm( Wolf et al., 1999) In this paper we review existing e-commerce implementations according to how they are presented to consumers. Most of the Web stores we review consider the algorithms they use to be proprietary. Many of these algorithms could be used while still presenting the same interface to the user. For this reason, our taxonomy is based on the basic approach to recommendation, rather than the specific technology used Marketing Technologies Recommender systems evolved in response to an increasing set of choices in products to buy and information to consume, combined with consumer frustration at a decreasing level of professional support for making these choices(ie, fewer expert shopkeepers) conditions created challenges for both consumers and merchandisers. Consumers experienced information overload and t help in selecting from an overwhelming array of products while merchandisers lost their relationships with consumers and to re-build and deepen those relationships by better helping consumers find products of interest. Recommender systems responded directly to consumers, giving them independent advice modeled after informal"word of mouth. At the same time, new database marketing techniques, data mining, and targeted advertising responded to merchandisers, giving them tools to respond to consumer needs, understand consumer behavior, and best use the limited available customer attention. This ection briefly describes database marketing and targeted advertising technologies and their relationship to recommender systems Database marketing is an attempt by businesses to provide more personal service to their customers. Neighborhood shopkeepers knew their regular customers and could provide each one with personal assistance, services, and advice. Many businesses today cannot maintain that one-to-one human relationship because of the prevalence of much larger retail stores, low employee-to-customer
E-Commerce Recommender Applications Page 4 of 24 between accuracy and throughput. Information filtering and information retrieval involve selecting text items that a user may be interested in reading based on the presence or absence of keywords in the text items. The user can explicitly enter the keywords, or they can be inferred from the items that the user has found interesting in the past. Information filtering or information retrieval systems are often used in search systems on e-commerce sites to help consumers find specific products in which they are interested. These systems have some features in common with recommender systems, in that both systems produce lists of suggestions for a user; however, the more the system provides direct responses to syntactic user queries the less it feels like a recommender system to the user. Information filtering systems that notify users when interesting items are for sale are more like recommender systems, especially if part of the selection process involves attributes that are not under the user’s direct control, such as whether other users have liked the item. Classifiers are general computational models for assigning a category to an input. The inputs may be vectors of features for the items being classified or data about relationships among the items. The category is a domain-specific classification such as malignant/benign for tumor classification, approve/reject for credit requests, or intruder/authorized for security checks. One way to build a recommender system using a classifier is to use information about a product and a customer as the input, and to have the output category represent how strongly to recommend the product to the customer. Classifiers may be implemented using many different machine-learning strategies including rule induction, neural networks, and Bayesian networks. In each case, the classifier is trained using a training set in which ground truth classifications are available. It can then be applied to classify new items for which the ground truths are not available. If subsequent ground truths become available, the classifier may be retrained over time. Classifiers have been quite successful in a variety of domains ranging from the identification of fraud and credit risks in financial transactions to medical diagnosis to intrusion detection. Basu et al. (1998) built a hybrid recommender system that mixes collaborative and content filtering using an induction-learning classifier. Good et al. (1999) implemented induction-learned featurevector classification of movies and compared the classification with nearest-neighbor recommendation; this study found that the classifiers did not perform as well as nearest neighbor, but that combining the two added value over nearest-neighbor alone. Association rules have been used for many years in merchandising, both to analyze patterns of preference across products, and to recommend products to consumers based on other products they have selected. An association rule expresses the relationship that one product is often purchased along with other products. The number of possible association rules grows exponentially with the number of products in a rule, but constraints on confidence and support, combined with algorithms that build association rules with itemsets of n items from rules with n-1 item itemsets, reduce the effective search space. Association rules can form a very compact representation of preference data that may improve efficiency of storage as well as performance. They are more commonly used for larger populations rather than for individual consumers, and they, like other learning methods that first build and then apply models, are less suitable for applications where knowledge of preferences changes rapidly. Association rules have been particularly successfully in broad applications such as shelf layout in retail stores. By contrast, recommender systems based on nearest neighbor techniques are easier to implement for personal recommendation in a domain where consumer opinions are frequently added, such as on-line retail. Horting is a graph-based technique in which nodes are consumers, and edges between nodes indicate degree of similarity between two consumers (Wolf et al. 1999). Predictions are produced by walking the graph to nearby nodes and combining the opinions of the nearby consumers. Horting differs from nearest neighbor as the graph may be walked through other consumers who have not rated the product in question, thus exploring transitive relationships that nearest neighbor algorithms do not consider. In one study using synthetic data, Horting produced better predictions than a nearest neighbor algorithm (Wolf et al., 1999). In this paper we review existing e-commerce implementations according to how they are presented to consumers. Most of the Web stores we review consider the algorithms they use to be proprietary. Many of these algorithms could be used while still presenting the same interface to the user. For this reason, our taxonomy is based on the basic approach to recommendation, rather than the specific technology used. Marketing Technologies Recommender systems evolved in response to an increasing set of choices in products to buy and information to consume, combined with consumer frustration at a decreasing level of professional support for making these choices (i.e., fewer expert shopkeepers). These conditions created challenges for both consumers and merchandisers. Consumers experienced information overload and sought help in selecting from an overwhelming array of products while merchandisers lost their relationships with consumers and sought to re-build and deepen those relationships by better helping consumers find products of interest. Recommender systems responded directly to consumers, giving them independent advice modeled after informal "word of mouth." At the same time, new database marketing techniques, data mining, and targeted advertising responded to merchandisers, giving them tools to respond to consumer needs, understand consumer behavior, and best use the limited available customer attention. This section briefly describes database marketing and targeted advertising technologies and their relationship to recommender systems. Database marketing is an attempt by businesses to provide more personal service to their customers. Neighborhood shopkeepers knew their regular customers and could provide each one with personal assistance, services, and advice. Many businesses today cannot maintain that one-to-one human relationship because of the prevalence of much larger retail stores, low employee-to-customer
E-Commerce Recommender applications Page 5 of 24 ratios, and high turnover among employees. Some businesses responded by treating all consumers the same. Others used database eting to divide consumers into segments based on demographic characteristics such as ZiP code, income, and occupati eted to each segment p. In some cases database marketing chiefly treats consumers according to their individual needs, but in other cases co as part of a segment find that the business no longer understands their individual preferences, needs. or desires One-to-one marketing( Peppers Rogers 1997)attempts to overcome the impersonal nature of marketing by using technology to ssist businesses in treating each consumer individually. Part of one-to-one marketing is the capture and use of consumer preferences(e.g, learning that a particular customer always wants gifts shipped overnight or that a particular customer collects an entire line of porcelain dolls). Other parts involve changing business practices to use the consumer knowledge gathered by the Recommender systems are a technology that helps merchandisers implement a one-to-one marketing strategy. The recommender em analyzes a database of consumer preferences to overcome the limitations of segment-based mass marketing by presenting each customer with a personal set of recommendations. Of course, recommender systems are not a complete solution. It is still necessary to record and use other consumer data, such as preferred credit card and shipping address, to deliver complete one-to-one service to Ad targeting, or more generally offer targeting, is an attempt to identify which consumers should be made an offer based up prior behavior. Traditional marketers watch for a given"event"in a customer's life and then aim specific advertisements off the card. When he purchases a house, he begins receiving offers for loan consolidation, second mortgages, life insurance anion of the consumer. When a consumer applies for his first credit card, he begins receiving offers from numerous banks for their version of book clubs and once again, life insurance Offer targeting treats consumers as both individuals and as members of a market group. Offers are typically made to all consume whose names appear on a list(ie, the "just acquired a mortgage "list ). However, individual customers are added and removed from these lists based on their individual behavior. Achieving a "life event gets a customer added to a list. Consumers who continue to ignore the offers will eventually be removed from the list Recommender systems are a technology that can help businesses decide to whom to make an offer. Such systems allow searc engines and advertising companies to suggest advertisements or offers to display based on consumer behavior. Yahoo or Excite could use a recommender system to identify which banner ad to display based on which keywords the consumer queried, or to which subsection of the hierarchy a customer navigated. Not surprisingly, customers who enter the keywords"Buick Century" in a search engine may find a banner advertising the latest Buick product. Likewise, consumers searching through the NFL section at Y ahoocb ceive a banner add for Sports Authority. com, while consumers navigating to the directory of insurance agents in Utah may an ad for AccuQuote 3. Recommender system Examples In the following section we present six E-commerce businesses that use one or more variations of red technology in their web sites. For each site, and each variation, we give a brief description of the features of the sy ions we refer to these examples as we explain the types of recommendations provided, the type of technology used, a gathered. For organizational purposes these sites have been alphabetized. The descriptions of these sites are as of this writing, though E-commerce applications of recommender systems are changing rapidly. 3.1 Amazon. com WewillfocushereonrecommendersystemsinthebooksectionofAmazon.com. CustomersWhoBoughtLikemanyE-commercesitesAmazon.comm(www.amazon.com)isstructuredwithaninformationpage or each book, giving details of the text and purchase information. The Customers who bought feature is und on the information books frequently purchased by customers who purchased the selected book. The second recommends a whose books are frequently purchased by customers who purchased works by the author of the selected book books they have read on a 5-point scalo encourages direct feedback from customers about books they have read. Customers rate Your Recommendations: Amazon als om"hated it to"loved it. After rating a sample of books, customers may request recommendations for books that they might like. At that point, a half dozen non-rated texts are presented that correlate with the user's indicated tastes. Figure I shows a sample screen from Your Recommendation
E-Commerce Recommender Applications Page 5 of 24 ratios, and high turnover among employees. Some businesses responded by treating all consumers the same. Others used database marketing to divide consumers into segments based on demographic characteristics such as ZIP code, income, and occupation and marketed to each segment as a group. In some cases database marketing chiefly treats consumers according to their individual needs, but in other cases consumers treated as part of a segment find that the business no longer understands their individual preferences, needs, or desires. One-to-one marketing (Peppers & Rogers 1997) attempts to overcome the impersonal nature of marketing by using technology to assist businesses in treating each consumer individually. Part of one-to-one marketing is the capture and use of consumer preferences (e.g., learning that a particular customer always wants gifts shipped overnight or that a particular customer collects an entire line of porcelain dolls). Other parts involve changing business practices to use the consumer knowledge gathered by the business. Recommender systems are a technology that helps merchandisers implement a one-to-one marketing strategy. The recommender system analyzes a database of consumer preferences to overcome the limitations of segment-based mass marketing by presenting each customer with a personal set of recommendations. Of course, recommender systems are not a complete solution. It is still necessary to record and use other consumer data, such as preferred credit card and shipping address, to deliver complete one-to-one service to consumers. Ad targeting, or more generally offer targeting, is an attempt to identify which consumers should be made an offer based upon their prior behavior. Traditional marketers watch for a given “event” in a customer’s life and then aim specific advertisements or offers to the consumer. When a consumer applies for his first credit card, he begins receiving offers from numerous banks for their version of the card. When he purchases a house, he begins receiving offers for loan consolidation, second mortgages, life insurance and aluminum siding. When he has a child, he finds himself inundated with advertisements for everything from diapers and formula to book clubs and, once again, life insurance. Offer targeting treats consumers as both individuals and as members of a market group. Offers are typically made to all consumers whose names appear on a list (i.e., the “just acquired a mortgage” list). However, individual customers are added and removed from these lists based on their individual behavior. Achieving a “life event” gets a customer added to a list. Consumers who continue to ignore the offers will eventually be removed from the list. Recommender systems are a technology that can help businesses decide to whom to make an offer. Such systems allow search engines and advertising companies to suggest advertisements or offers to display based on consumer behavior. Yahoo or Excite could use a recommender system to identify which banner ad to display based on which keywords the consumer queried, or to which subsection of the hierarchy a customer navigated. Not surprisingly, customers who enter the keywords “Buick Century” in a search engine may find a banner advertising the latest Buick product. Likewise, consumers searching through the NFL section at Yahoo may receive a banner add for SportsAuthority.com, while consumers navigating to the directory of insurance agents in Utah may find an ad for AccuQuote. 3. Recommender System Examples In the following section we present six E-commerce businesses that use one or more variations of recommender system technology in their web sites. For each site, and each variation, we give a brief description of the features of the system. In later sections we refer to these examples as we explain the types of recommendations provided, the type of technology used, and the types of information gathered. For organizational purposes these sites have been alphabetized. The descriptions of these sites are accurate as of this writing, though E-commerce applications of recommender systems are changing rapidly. 3.1 Amazon.com We will focus here on recommender systems in the book section of Amazon.com. Customers Who Bought: Like many E-commerce sites, Amazon.com™ (www.amazon.com) is structured with an information page for each book, giving details of the text and purchase information. The Customers Who Bought feature is found on the information page for each book in their catalog. It is in fact two separate recommendation lists. The first recommends books frequently purchased by customers who purchased the selected book. The second recommends authors whose books are frequently purchased by customers who purchased works by the author of the selected book. Your Recommendations: Amazon also encourages direct feedback from customers about books they have read. Customers rate books they have read on a 5-point scale from “hated it” to “loved it.” After rating a sample of books, customers may request recommendations for books that they might like. At that point, a half dozen non-rated texts are presented that correlate with the user’s indicated tastes. Figure 1 shows a sample screen from Your Recommendations
E-Commerce Recommender applications Page 6 of 24 3面的3,已,司· Rernrmrnendaticns vmot is the gating Earnrmanratinne Rate Your purchases The buttons numbered t-5 BankE Ratng your past purchases heps us improve your represent the fulvene commendations. To dude a titi from be used for you fat MIE de ltam"option G1食合DD数 Tre.AMrag onEsE pest purses RAted Dont Hu r kat angie it temo IhgsgiKInD SILEnkuDriR-nihs ::: Purchases by Abart Mamin ML DE soWs nn, Che van Allsburg out et the Duat (Newhec MedaLBcck g in cheftAtrhan Lincoln are :: by Esther Forbes, Lyman ward (lustrator) azon.comratingspagepromptsthecustomertorateitemsrecentlypurchasedTheseratingsareusedasinputtoarecommendationengine her find other items that she is likely to like. Customers are asked to invest effort in rating, in exchange for which they get more useful Eyes: The Eyes feature allows customers to be notified via email of new items that have been added to the amazon. com catalog Customers enter requests based upon author, title, subject, isBN, or publication date information. Customers can use both simple and more complex Boolean-based criteria(AND/OR) for notification queries. One of the interest ing variations of the Eyes system allows requests to be directly entered from any search results screen, creating a persistent request based on the search of specific categories/genres(Oprah books, biographies, cooking. Periodically the editors at Amazon. com send their later a list Amazon. com Delivers: Amazon. com Delivers is a variation on the eyes feature. Customers select checkboxes to choose from a list Bookstore Gift Ideas: The Gift Ideas feature allows customers to receive recommendations from editors. Customers pick a category of books for which they would like some suggestions. By navigating to that section of the "Gift Department, they can view a general list of recommendations created by the editors of Amazon. com. They also can select to view recommendations in one of a predefined list of categories including Globetrotter, Entrepreneur, and Teens. In many ways this serves as an online version of the Amazon.comDeliversfeaturediscussedearlierHowever,customerscanbeprovidedwithrecommendationsanonymouslysince there is no need to register with the site as there is with delivers. Customer Comments: The Customer Comments feature allows customers to receive text recommendations based on the opinions of other customers. Located on the information page for each book is a list of 1-5 star ratings and written comments provided by customers who have read the book in question and submitted a review. Customers have the option of incorporating these recommendations into their purchase decision. Furthermore, customers can "rate the comments. With each comment is the question"Did this comment help you. Customers may indicate yes or no. Results are tabulated and reported such as"5 of 7 peopl found the following review helpful
E-Commerce Recommender Applications Page 6 of 24 Figure 1: The Amazon.com ratings page prompts the customer to rate items recently purchased. These ratings are used as input to a recommendation engine to help the customer find other items that she is likely to like. Customers are asked to invest effort in rating, in exchange for which they get more useful recommendations. Eyes: The Eyes feature allows customers to be notified via email of new items that have been added to the Amazon.com catalog. Customers enter requests based upon author, title, subject, ISBN, or publication date information. Customers can use both simple and more complex Boolean-based criteria (AND/OR) for notification queries. One of the interesting variations of the Eyes system allows requests to be directly entered from any search results screen, creating a persistent request based on the search. Amazon.com Delivers: Amazon.com Delivers is a variation on the Eyes feature. Customers select checkboxes to choose from a list of specific categories/genres (Oprah books, biographies, cooking). Periodically the editors at Amazon.com send their latest recommendations by email to subscribers in each category. Bookstore Gift Ideas: The Gift Ideas feature allows customers to receive recommendations from editors. Customers pick a category of books for which they would like some suggestions. By navigating to that section of the “Gift Department,” they can view a general list of recommendations created by the editors of Amazon.com. They also can select to view recommendations in one of a predefined list of categories including Globetrotter, Entrepreneur, and Teens. In many ways this serves as an online version of the Amazon.com Delivers feature discussed earlier. However, customers can be provided with recommendations anonymously since there is no need to register with the site as there is with Delivers. Customer Comments: The Customer Comments feature allows customers to receive text recommendations based on the opinions of other customers. Located on the information page for each book is a list of 1-5 star ratings and written comments provided by customers who have read the book in question and submitted a review. Customers have the option of incorporating these recommendations into their purchase decision. Furthermore, customers can “rate the comments.” With each comment is the question “Did this comment help you.” Customers may indicate yes or no. Results are tabulated and reported such as “5 of 7 people found the following review helpful
E-Commerce Recommender applications Page 7 of 24 Purchase Circles: The Purchase Circles feature allows customers to view the"top 10"list for a given geographic region, company, ducational institution, government or other organization. For example, a customer could request to see what books are the best ellers for customers at Oracle, MIT, or residents of New York City. Purchase Circles provide another"fellow customer" form of allowing them to select a"domain"with which they associate themselves. Customers can view Purchase Circles by nal ons by commendations by allowing customers not only to see what others are reading but also to personalize the recommendations by Circle that interests them 3.2 CDNOW Album Advisor The Album Advisor feature of CdnoWtm (Www.cDnow. Com)woRkS in three different modes The first two are similartotheCustomersWhoBoughtfeatureofAmazon.com.Customerslocatetheinformationpageforagivenalbumorartist The system then recommends ten other albums related to the album or artist in question. Results are presented as "Customers who bought X also bought set s or"Customers who bought items by y also bought set T." The third mode works as a"gift advisor. Customers type in the names of up to three artists, and the system returns a list of ten albums Cdnow considers similar to the artists in question. Related Artists: The Related Artists feature of CDNOW works on the assumption that if a customer likes a certain performer, there is a group of artists with similar styles that she will also like. Customers locate an artist and select the related Artists link. Upon doing so, they are provided with a list of these artists who are considered to be"similar artists" and a list of artists who are considered to be among the"roots and influences"for the selected artist. of music. Customers browse a list of genres provided by the site, including categories such as British Invasion, Big Chilling, any a Buyers Guides: The Buyers Guide feature at CDNOW allows customers to receive recommendations based on a particular genr Parent Pop. Selecting one of the links from this list takes customers to a new list of albums the editors consider the essential part of Artist Picks: In the Similar Artist feature at CDNOW one of the categories of recommendations is "roots and influences Presumably editors create this list. The Artist Picks feature provides similar recommendations, directly from the artists. Each week a different artist is featured, who lists the albums that shaped his or her taste as well as what is currently in their CD player Top 100: Traditionally, hype and"bestseller" status have been used by commerce sites to make recommendations to their customers After all, if an album is on the Billboard Top 10, then it must be a good album. The Top 100 feature allows customers of CDNOW to receive this type of recommendation, but the 100 are drawn from the sales figures of the site and can theoretically be continuously upgraded to reflect actual sales My CDNOW: My CDNoW enables customers to set own music store, based on albums and artists they like. Custo indicate which albums they own, and which artists ar vorites. Purchases from CDNOW are entered automatically an indication of positive likes, customers can go back and d distinguish between"own it and like it and"own it but dislike it. "When customers request recommendations, the system predicts six albums the customer might like based on what is already owned. Feedback is provided by customers selecting"own it, "move to wish list or"not for me' for any of the albums in this prediction list. The albums recommended change based on the feedback. Figure 2 ows a sample screen from My CdNow 出··A,它点三 CDNOW , XEDM09 Sum mary for John Riedl 位式 a 0comeenrod for yo Start ynr lnt tody
E-Commerce Recommender Applications Page 7 of 24 Purchase Circles: The Purchase Circles feature allows customers to view the "top 10" list for a given geographic region, company, educational institution, government or other organization. For example, a customer could request to see what books are the best sellers for customers at Oracle, MIT, or residents of New York City. Purchase Circles provide another “fellow customer” form of recommendations by allowing customers not only to see what others are reading but also to personalize the recommendations by allowing them to select a “domain” with which they associate themselves. Customers can view Purchase Circles by navigating to the Circle that interests them. 3.2 CDNOW Album Advisor: The Album Advisor feature of CDNOW™ (www.cdnow.com) works in three different modes. The first two are similar to the Customers Who Bought feature of Amazon.com. Customers locate the information page for a given album or artist. The system then recommends ten other albums related to the album or artist in question. Results are presented as “Customers who bought X also bought set S” or “Customers who bought items by Y also bought set T.” The third mode works as a “gift advisor.” Customers type in the names of up to three artists, and the system returns a list of ten albums CDNOW considers similar to the artists in question. Related Artists: The Related Artists feature of CDNOW works on the assumption that if a customer likes a certain performer, there is a group of artists with similar styles that she will also like. Customers locate an artist and select the Related Artists link. Upon doing so, they are provided with a list of these artists who are considered to be "similar artists" and a list of artists who are considered to be among the "roots and influences" for the selected artist. Buyer’s Guides: The Buyer’s Guide feature at CDNOW allows customers to receive recommendations based on a particular genre of music. Customers browse a list of genres provided by the site, including categories such as British Invasion, Big Chilling, and Parent Pop. Selecting one of the links from this list takes customers to a new list of albums the editors consider the essential part of this genre. Artist Picks: In the Similar Artist feature at CDNOW one of the categories of recommendations is “roots and influences.” Presumably editors create this list. The Artist Picks feature provides similar recommendations, directly from the artists. Each week a different artist is featured, who lists the albums that shaped his or her taste as well as what is currently in their CD player. Top 100: Traditionally, hype and “bestseller” status have been used by commerce sites to make recommendations to their customers. After all, if an album is on the Billboard Top 10, then it must be a good album. The Top 100 feature allows customers of CDNOW to receive this type of recommendation, but the 100 are drawn from the sales figures of the site and can theoretically be continuously upgraded to reflect actual sales. My CDNOW: My CDNOW enables customers to set up their own music store, based on albums and artists they like. Customers indicate which albums they own, and which artists are their favorites. Purchases from CDNOW are entered automatically into the “own it” list. Although “own it” ratings are initially treated as an indication of positive likes, customers can go back and distinguish between “own it and like it” and “own it but dislike it.” When customers request recommendations, the system predicts six albums the customer might like based on what is already owned. Feedback is provided by customers selecting “own it,” “move to wish list” or “not for me” for any of the albums in this prediction list. The albums recommended change based on the feedback. Figure 2 shows a sample screen from My CDNOW
E-Commerce Recommender applications Page 8 of 24 Medf, yaw npeent a4 eneck far /c nce odo ad wa Raleseoe from al Medify yRr Accunt afomaiar, chan?a ou ll you has a tans that you havant rated yat. and ha ul Figure 2 The My CDNOW page nendations, prompts to rate past purchases, updates on favorite artists, and a wish List, to communicate gift wishes to family or friends. Th ntry point for a frequent CDNOW customer, as well as serving for an integrated access point to commendations 3.3 Drugstore. com Advisor: The Advisor feature at drus customers to indicate their preferer hen pure oduct from a category such as"suncare " or"cold a For example, in the latter, custome s they wish to elieve(runny nose and sneezing) the he fomi y want the relief (caplets) and the of patient nt to won m they want to administer the product(adult). Upon being ith this information the Advisor returns a list of products recommended to meet the conditions Test Drives: In the Test Drives feature, a team of volunteers, made up of customers from the site, is sent a new product. These fellow customers'" provide reviews of the product including a star rating and text comments 3.4 eBay FeedbackProfileTheFeedbackProfilefeatureatebay.comtm(www.ebAy.com)allowsbothbuyersandsellerstocontributeto feedback profiles of other customers with whom they have done business. The feedback consists of a satisfaction rating (satisfied/neutral/dissatisfied) as well as a specific comment about the other customer. Feedback is used to provide a recommender system for purchasers, who are able to view the profile of sellers. This profile consists of a table of the number of each rating in the past 7 days, past month, and past 6 months, as well as an overall summary(e.g, 867 positives from 776 unique customers). Upon further request, customers can browse the individual ratings and comments for the seller Personal Shopper: The personal shopper feature of e Bay allows customers to indicate items they are interested in purchasing Customers input a"short term"(30/60/90 days) and search on a set of keywords of their choosing, including their price limit. On a periodic basis(one or three day intervals) the site performs the customer's search over all auctions at the site and sends the customer an email with the results of this search 3.5 Movie finder. com Movie Finder. com is the movie site maintained by E! Online Users Grade/Our Grade: Both the Users grade and the Our grade features report a letter grade recommendation to the customer The Users grade feature allows customers to register with the site and give letter grades(A-F) to the movies they have seen. These rades are then averaged over all customers and reported as the Users Grade. The Our Grade feature provides customers with a grade from the editors of E! Online. Thus, customers viewing the information page for Toy Story 2 might find that it gets a grade of A from the editors with a grade of A- from the customers who have rated it. Top 10: The Top 10 feature at E! Online allows the customers to get recommendations from the editors in a category of their choice Customers select a category from a list of previously defined categories such as chick flicks, sex scenes, and movies from books Selecting a list takes the customer through descriptions of the top ten movies in that category as defined by one of the editors of E Online 3.6 Reel com Matches: Similar to Amazon coms Customers who Bought Reel coms Movie eel. com) provides endations on the information page for each movie. These recommendatio hes" and/or“ creative Each set contains up to a dozen hyperlinks to the information pages fo films. The hyperlinks are annotated with one-sentence descriptions of how the new movie is similar to the novie in question(e.g. Darker thriller raises similarly disturbing questions. ) Figure 3 shows a sample screen from Movie Matche
E-Commerce Recommender Applications Page 8 of 24 Figure 2 The My CDNOW page includes recommendations, prompts to rate past purchases, updates on favorite artists, and a Wish List, to communicate gift wishes to family or friends. This page serves as an entry point for a frequent CDNOW customer, as well as serving for an integrated access point to recommendations. 3.3 Drugstore.com Advisor: The Advisor feature at Drugstore.com allows customers to indicate their preferences when purchasing a product from a category such as “suncare” or “cold and flu remedies.” For example, in the latter, customers indicate the symptoms they wish to relieve (runny nose and sneezing), the form in which they want the relief (caplets) and the "age” of patient to whom they want to administer the product (adult). Upon being provided with this information the Advisor returns a list of products recommended to meet the conditions. Test Drives: In the Test Drives feature, a team of volunteers, made up of customers from the site, is sent a new product. These “fellow customers” provide reviews of the product including a star rating and text comments. 3.4 eBay Feedback Profile: The Feedback Profile feature at eBay.com™ (www.ebay.com) allows both buyers and sellers to contribute to feedback profiles of other customers with whom they have done business. The feedback consists of a satisfaction rating (satisfied/neutral/dissatisfied) as well as a specific comment about the other customer. Feedback is used to provide a recommender system for purchasers, who are able to view the profile of sellers. This profile consists of a table of the number of each rating in the past 7 days, past month, and past 6 months, as well as an overall summary (e.g., 867 positives from 776 unique customers). Upon further request, customers can browse the individual ratings and comments for the sellers. Personal Shopper: The personal shopper feature of eBay allows customers to indicate items they are interested in purchasing. Customers input a “short term” (30/60/90 days) and search on a set of keywords of their choosing, including their price limit. On a periodic basis (one or three day intervals) the site performs the customer’s search over all auctions at the site and sends the customer an email with the results of this search. 3.5 MovieFinder.com MovieFinder.com is the movie site maintained by E! Online. Users Grade/Our Grade: Both the Users Grade and the Our Grade features report a letter grade recommendation to the customer. The Users Grade feature allows customers to register with the site and give letter grades (A-F) to the movies they have seen. These grades are then averaged over all customers and reported as the Users Grade. The Our Grade feature provides customers with a grade from the editors of E! Online. Thus, customers viewing the information page for Toy Story 2 might find that it gets a grade of A from the editors with a grade of A- from the customers who have rated it. Top 10: The Top 10 feature at E! Online allows the customers to get recommendations from the editors in a category of their choice. Customers select a category from a list of previously defined categories such as chick flicks, sex scenes, and movies from books. Selecting a list takes the customer through descriptions of the top ten movies in that category as defined by one of the editors of E! Online. 3.6 Reel.com Movie Matches: Similar to Amazon.com’s Customers Who Bought, Reel.com’s Movie Matches (www.reel.com) provides recommendations on the information page for each movie. These recommendations consist of “close matches” and/or “creative matches.” Each set contains up to a dozen hyperlinks to the information pages for each of these “matched” films. The hyperlinks are annotated with one-sentence descriptions of how the new movie is similar to the original movie in question (e.g. “Darker thriller raises similarly disturbing questions… ”). Figure 3 shows a sample screen from Movie Matches
E-Commerce Recommender applications Page 9 of 24 MM” cOse Movie Motono 独m班(9 mgsp由e的 ngetrcte wth ansl口m以的npt wtadtmewand ctonthnlw featues corm a ably thougte-Hrwwiin put, Mfenatng catenate hilera Racellrgin 开时等加时时 afi Movie Matd a. KetrSttheda Staning teda ceae. te Irca Malf tustocnagau bsm amenatnnspt stary win tar noob bir Ghin the She!l n99 只杯 et srme Nma.1射 mia dermis c elemnt些x打相 Figure 3: Reel coms Movie Matches presents editors'picks for movies that will appeal to a customer using the movie a customer is currently browsing as indication of interest. The picks are made by human editors, and come in two categories: Close Movie Matches, designed to provide saferowsing as commendations, and Creative Movie Matches, designed to provide more serendipity in the recommendation. 4. A Taxonomy for Recommender applications Recommendation Method Raw retrieval Manually selected Statistical summarization Targeted Customer Attribute-based Community Inputs Item-to-Item correlat ion Item Attribute Implicit Navigation User-to-User correlation External item Explicit Navigation Popularity Keyword/Item Purchase History Attribute Outputs Rati Ratings Suggestion Text Comments Purchase History Prediction Ratina
E-Commerce Recommender Applications Page 9 of 24 Figure 3: Reel.com’s Movie Matches presents editors’ picks for movies that will appeal to a customer using the movie a customer is currently browsing as an indication of interest. The picks are made by human editors, and come in two categories: Close Movie Matches, designed to provide safer recommendations, and Creative Movie Matches, designed to provide more serendipity in the recommendation. 4. A Taxonomy for Recommender Applications · Recommendation Method Raw retrieval Manually selected Statistical summarization Attribute-based Item-to-Item correlation User-to-User correlation Outputs Suggestion Prediction Ratings Targeted Customer Inputs Implicit Navigation Explicit Navigation Keyword/Item Attribute Ratings Purchase History Community Inputs Item Attribute External Item Popularity Purchase History Ratings Text Comments
E-Commerce Recommender applications Page 10 of 24 Re Delivery E-store Engine Push Pull Non-personalized Passive Epher 己 Have we got an offer for you: Responses/Feedback Responses/Feedback igure 4: Recommender applications combine inputs about the customer in question, with those about product and user communit sites use decisions about pe ization level and delivery method to transform these into specific recommendation packages. Fee these recommendation nay generate additional inputs for future recommendations Using the previous examples, we have developed a taxonomy for E-commerce recommender applications that separates their attributes into three categories: the functional I/O, the recommendation method, and other design issues. Figure 4 illustrates how sul parts of these categories are used in the recommendation process, as well as what the dimensions are within each portion. These parts and their dimensions are explained in more detail in the remainder of this section These three categories are not independent; as the examples in Table I illustrate, certain design choices require specific outputs Similarly, certain outputs can be produced only by some, but not all, of the recommendation methods. Furthermore, our taxonomy includes only recommenders that attempt to help individual consumers based on preference data, such as interest information about oducts or purchase history. We do not consider methods that recommend according to less personal information, such as ation, demographic or psychographic or purely business information. Finally, we do not claim that the taxonomy is comple it represents the range of E-commerce applications in use at the time of this writing. We fully expect new I/O, methods, and to emerge. We do, however, expect the basic structure of the taxonomy to remain useful as new practices are integrated into 4.1 Functionall o ourselves only with the data flowing into and out of these systems. Each system takes in a collection of inputs that may include consumer preference data, attribute data, and other correlates. Since this covers a large space of data, we additionally divide these inputs to indicate their origin -inputs about the targeted customer (i.e, about the applications use these inputs to produce output recommendations for other items. Analysis of these 1/O produced the following customer for whom we are making recommendations)vs general inputs regarding the community of other customers. Recommen Targeted Customer Inputs puts about the targeted customer are fed into the recommendation process to provide personalized recommendations.An application that uses no inputs about the targeted customer can produce only non-personal recommendations. Adding one or more mend nendations based customers long-term preferences, or both. While there are multiple ways of categorizing the inputs from the targeted customer, one compelling set of categories evolves from the customer's approach toward providing the input While many recommender applications are still global in nature, more are beginning to respond to the customer's current state by using the customer's current navigation to provide context for the production or refinement of recommendations. Consumer behaviors interpreted for this input include both actions the consumer would have performed in exactly the same way even if he was unaware of
E-Commerce Recommender Applications Page 10 of 24 Using the previous examples, we have developed a taxonomy for E-commerce recommender applications that separates their attributes into three categories: the functional I/O, the recommendation method, and other design issues. Figure 4 illustrates how subparts of these categories are used in the recommendation process, as well as what the dimensions are within each portion. These parts and their dimensions are explained in more detail in the remainder of this section. These three categories are not independent; as the examples in Table 1 illustrate, certain design choices require specific outputs. Similarly, certain outputs can be produced only by some, but not all, of the recommendation methods. Furthermore, our taxonomy includes only recommenders that attempt to help individual consumers based on preference data, such as interest information about products or purchase history. We do not consider methods that recommend according to less personal information, such as segmentation, demographic or psychographic or purely business information. Finally, we do not claim that the taxonomy is complete. Rather, it represents the range of E-commerce applications in use at the time of this writing. We fully expect new I/O, methods, and designs to emerge. We do, however, expect the basic structure of the taxonomy to remain useful as new practices are integrated into it. 4.1 Functional I/O To simplify the process, we begin by concerning ourselves only with the data flowing into and out of these systems. Each system takes in a collection of inputs that may include consumer preference data, attribute data, and other correlates. Since this covers a large space of data, we additionally divide these inputs to indicate their origin – inputs about the targeted customer (i.e., about the customer for whom we are making recommendations) vs. general inputs regarding the community of other customers. Recommender applications use these inputs to produce output recommendations for other items. Analysis of these I/O produced the following dimensions. Targeted Customer Inputs Inputs about the targeted customer are fed into the recommendation process to provide personalized recommendations. An application that uses no inputs about the targeted customer can produce only non-personal recommendations. Adding one or more types of inputs allows the recommender application to personalize recommendations based on the customer's current activity, the customer's long-term preferences, or both. While there are multiple ways of categorizing the inputs from the targeted customer, one compelling set of categories evolves from the customer’s approach toward providing the input. While many recommender applications are still global in nature, more are beginning to respond to the customer’s current state by using the customer's current navigation to provide context for the production or refinement of recommendations. Consumer behaviors interpreted for this input include both actions the consumer would have performed in exactly the same way even if he was unaware of Responses/Feedback Responses/Feedback Ratings Reviews Delivery Push Pull Passive Degree of Personalization Non-personalized Ephemeral Persistent E-store Engine Have we got an offer for you!! Figure 4: Recommender applications combine inputs about the customer in question, with those about product and user communities to generate recommendations. Sites use decisions about personalization level and delivery method to transform these into specific recommendation packages. Feedback to these recommendations may generate additional inputs for future recommendations