Crowdreviewing

Crowdreviewing is the practice of gathering opinion or feedback from a large number of people, typically via the internet or an online community; a portmanteau of "crowd" and "reviews". Crowdreviewing is also often viewed as a form of crowd voting which occurs when a website gathers a large group's opinions and judgment.^[1] The concept is based on the principles of crowdsourcing and lets users submit online reviews to participate in building online metrics that measure performance. By harnessing social collaboration in the form of feedback individuals are generally able to form a more informed opinion.^[2]^[3]^[4]^[5]^[6]

Role of the crowd

In crowdreviewing the crowd becomes the source of information used in determining the relative performance of products and services.^[7] As crowdreviewing focuses on receiving input from a large number of parties, the resulting collaboration produces more credible feedback compared to the feedback left by a single party. The responsibility of identifying strengths and weaknesses falls to multiple individuals which each have had their own experience rather than on a single individual. Buyers will therefore be more likely to trust the feedback of a collective group of people rather than a single individual.^[8]^[9]

Common Parties

The crowd consists of a number of different parties which have various interests in regards to the outcome produced.^[10]

Potential Customers

A potential customer of a product or service would have an interest in viewing information on how a particular product or service stands in terms of subjective or objective quality before making a purchasing decision. Potential customers may also be interested in leaving feedback on a particular product or service to explain why they did not make their purchase.^[11]^[12]^[13]

Customers

Customers of products and services are a primary party in the process of reviewing. Customers are closely connected to the process as they would have first-hand experience with a product and service. Their primary role would be detailing their experiences with the product or service. A customer's interest in crowdreviewing would stem from an interest in showing their appreciation towards the quality of a product or service or in voicing their concerns or disappointment in a product or service.^[1]^[6]

Sellers

Sellers usually get their satisfied customers involved in leaving reviews for their products and services. A seller has an interest in having positive feedback on display as a means to influence potential buyers.^[2]^[3]^[4]^[5]^[14]

Competitors

Competitors would have an interest in reviewing feedback from the crowd as a means of obtaining competitive intelligence.^[2]^[4]

There may be other audiences involved in the process such as employees, suppliers, partners, and other relevant parties.^[15]

Benefits and risks

There are a number of benefits to the different parties which make up the crowd. Potential buyers are able to obtain information on products and services prior to making a purchase. Those which have already bought or used the product or service are able to post experiences both positive and negative in order to inform other potential buyers. As an additional benefit to the buyers, buyers may also post negative reviews in hopes of resolving their negative experiences with their seller. Sellers have the benefits of receiving positive feedback and also potentially resolving issues with dissatisfied customers. Competitors are able to learn more about what their competition is doing in order to improve their own products and services.^[16]^[17]^[18]

In addition to the benefits associated with crowdreviewing, there are a number of risks and challenges to overcome. For potential buyers there is always the risk that reviews may be sourced by the vendors themselves or other parties paid to leave a specific type of feedback on a product or service. Sellers have the possibility of receiving negative reviews which may in turn negatively influence their reputation and affect their bottom line revenue numbers. Competitors, while enjoying the benefit of being able to learn from their competitors are also subject to their competitors learning about their positives and negatives.^[17]^[19]

Limitations and controversies

Size of the Crowd

One of the major factors influencing crowdreviewing is the size of the crowd involved. A crowdreviewing venture is positively influenced by having a large number of parties leave reviews and feedback on products and services. In cases where a small number of individuals leave their feedback, more weight is placed on an individual reviewer or opinion and could therefore be of minimal value to potential customers. A smaller sample of reviews may also exhibit bias towards or against the product or service.^[20]

Industry Knowledge

A common limitation of allowing all parties to have an opportunity to review a product or service may involve having reviews written without a minimal or meaningful understanding of the product or service. A lack of industry or specialized knowledge may in turn minimize the value of a review or potentially inversely affect what would be considered a fair review.^[20]

Seller Manipulation

With allowing multiple parties to review a product or service there is a possibility that a seller may attempt to manipulate reviews in a number of ways. Sellers may hire third parties or create fake identities in order to leave positive reviews on their product or service. They may also do the same to create negative reviews on competing products and services.^[21]

Balance of Negative and Positive Reviews

Customers which have a negative experience with a product or service are more likely to offer a their review in an effort to resolve buyer's remorse in comparison to those which have had a positive experience.^[22]

One Side of the Story

Those reading reviews on products and services are likely to view reviews which only tell one side to the story. This is a disadvantage to both a potential customer and seller as the review may not tell the other side of a story which may be based on a misunderstanding.^[23]

References

^ ^a ^b Robson, John (February 24, 2012). "IEM Demonstrates the Political Wisdom of Crowds". Canoe.ca. Archived from the original on April 7, 2012. Retrieved March 31, 2012.
^ ^a ^b ^c "Crowdreviews: Today's Word of Mouth - Search Marketing Standard Magazine | Covering Search Engines". www.searchmarketingstandard.com. Archived from the original on 2015-10-17. Retrieved 2015-10-01.
^ ^a ^b "Crowdreviews". www.crowdreviews.com. Retrieved 2015-10-01.
^ ^a ^b ^c "Article - CrowdReviews.com takes lead as a top reputation tool - sourced from the crowd by visibility". Visibility Magazine. Retrieved 2015-10-01.
^ ^a ^b Mosley, Eric (2013-05-31). The Crowdsourced Performance Review: How to Use the Power of Social Recognition to Transform Employee Performance. McGraw Hill Professional. ISBN 9780071817998.
^ ^a ^b Hakikur, Rahman (2014-04-30). Information Systems and Technology for Organizational Agility, Intelligence, and Resilience. IGI Global. ISBN 9781466659711.
^ Safire, William (February 5, 2009). "On Language". New York Times Magazine. Retrieved May 19, 2013.
^ Estellés-Arolas, Enrique; González-Ladrón-de-Guevara, Fernando (2012), "Towards an Integrated Crowdsourcing Definition" (PDF), Journal of Information Science, 38 (2): 189–200, doi:10.1177/0165551512437638, hdl:10251/56904, S2CID 18535678
^ DeVun, Leah (November 19, 2009). "Looking at how crowds produce and present art". Wired News. Archived from the original on 2012-10-24. Retrieved February 26, 2012.
^ Prpić, J; Shukla, P.; Roth, Y.; Lemoine, J.F. (2015). "A Geography of Participation in IT-Mediated Crowds". Proceedings of the Hawaii International Conference on Systems Sciences 2015. SSRN 2494537.
^ Kaufmann, N.; Schulze, T.; Viet, D. (2011). "More than fun and money. Worker Motivation in Crowdsourcing – A Study on Mechanical Turk" (PDF). Proceedings of the Seventeenth Americas Conference on Information Systems. Archived from the original (PDF) on 2012-02-27. Retrieved 2015-10-16.
^ Brabham, Daren C. (2012). "Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning". Journal of Applied Communication Research. 40 (3): 307–328. doi:10.1080/00909882.2012.693940. S2CID 144807388.
^ Lietsala, Katri; Joutsen, Atte (2007). "Hang-a-rounds and True Believers: A Case Analysis of the Roles and Motivational Factors of the Star Wreck Fans". MindTrek 2007 Conference Proceedings.
^ Bracken, D.W., Rose, D.S. (2011) "When does 360-degree Feedback create behavior change? And How would we know when it does?"
^ Britt, Darice. "Crowdsourcing: The Debate Roars On". Archived from the original on 2014-07-01. Retrieved 2015-10-02.
^ Burnap, Alex; Ren, Alex J.; Papazoglou, Giannis; Gerth, Richard; Gonzalez, Richard; Papalambros, Panos. "When Crowdsourcing Fails: A Study of Expertise on Crowdsourced Design Evaluation" (PDF). Archived from the original (PDF) on 2015-10-29. Retrieved 2015-10-16. {{cite journal}}: Cite journal requires |journal= (help)
^ ^a ^b Aitamurto, Tanja; Leiponen, Aija. "The Promise of Idea Crowdsourcing: Benefits, Contexts, Limitations | Tanja Aitamurto". Ideasproject.com. Retrieved 2015-07-02.
^ Ipeirotis; Provost; Wang (2010). "Quality Management on Amazon Mechanical Turk" (PDF). Archived from the original (PDF) on 2012-08-09. Retrieved 2015-10-16. {{cite journal}}: Cite journal requires |journal= (help)
^ Woods, Dan (28 September 2009). "The Myth of Crowdsourcing". Forbes. Retrieved 2012-12-04.
^ ^a ^b Borst, Irma. "The Case For and Against Crowdsourcing: Part 2". Archived from the original on 2015-09-12. Retrieved 2015-02-09.{{cite web}}: CS1 maint: unfit URL (link)
^ Ipeirotis (2010). "Analyzing the Amazon Mechanical Turk Marketplace". XRDS: Crossroads, the ACM Magazine for Students. 17 (2): 16–21. doi:10.1145/1869086.1869094.
^ Kurve, Aditya; Miller, David J.; Kesidis, George (30 May 2014). "Multicategory Crowdsourcing Accounting for Variable Task Difficulty, Worker Skill, and Worker Intention". IEEE Kde (99).
^ Britt, Darice. "Crowdsourcing: The Debate Roars On". Archived from the original on 2014-07-01. Retrieved 2012-12-04.