Skip to main content

A Trust Framework for the Collection of Reliable Crowd-Sourced Data

  • Conference paper
  • First Online:
Advances in Information and Communication (FICC 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1130))

Included in the following conference series:

Abstract

With increasing access to the Internet through a multitude of devices, it is relatively easy to collect data from the public through a process called crowd-sourcing. Unfortunately, this approach has two problems: enticing users to contribute data, and determining if users have provided accurate data. The problem of inaccurate responses is compounded when a group of malicious users intentionally skew survey results in order to benefit themselves in some way. The first issue can be addressed through incentives, but this increases the need to solve the second issue since it is likely that users would produce fake data in order to obtain more of the offered incentives. We present a simple trust framework for addressing the issue of data quality in surveys, and illustrate its use with a real-world example. In this model, users are given access to the platform only when trusted users on the platform vouch for them. Although not fool proof, it does increase the quality of the collected data. Access to the survey results is used to incentivize users. We compared our solution to a traditional internet survey; we found that our solution reduced the number of invalid submissions by 9.29%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A CAPTCHA is a program that protects websites against bots by generating and grading tests that humans can pass but current computer programs cannot. http://www.captcha.net.

  2. 2.

    Django is a high-level Python Web framework that encourages rapid development and clean, pragmatic design. https://www.djangoproject.com.

  3. 3.

    JavaScript Object Notation. JSON is a lightweight data-interchange format. https://www.json.org.

References

  1. Sherchan, W., Nepal, S., Paris, C.: A survey of trust in social networks. ACM Comput. Surv. 45(4), 47:1–47:33 (2013). https://doi.org/10.1145/2501654.2501661

    Article  Google Scholar 

  2. DuBois, T., Golbeck, J., Srinivasan, A.: Predicting trust and distrust in social networks. In: 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing, pp. 418–424, October 2011

    Google Scholar 

  3. Massa, P., Avesani, P.: Trust-aware recommender systems. In: Proceedings of the 2007 ACM Conference on Recommender Systems, RecSys 2007, pp. 17–24. ACM, New York (2007). https://doi.org/10.1145/1297231.1297235

  4. Artz, D., Gil, Y.: A survey of trust in computer science and the semantic web. Web Semant. Sci. Serv. Agents World Wide Web 5(2), 58–71 (2007)

    Article  Google Scholar 

  5. Wang, Y., Vassileva, J.: Bayesian network-based trust model in peer-to-peer networks. In: Proceedings of the Workshop on Deception, Fraud and Trust in Agent Societies, pp. 57–68. Citeseer (2003)

    Google Scholar 

  6. Bhattacharya, R., Devinney, T.M., Pillutla, M.M.: A formal model of trust based on outcomes. Acad. Manag. Rev. 23(3), 459–472 (1998)

    Article  Google Scholar 

  7. Zhao, K., Pan, L.: A machine learning based trust evaluation framework for online social networks. In: 2014 IEEE 13th International Conference on Trust, Security and Privacy in Computing and Communications, pp. 69–74, September 2014

    Google Scholar 

  8. Massa, P., Avesani, P.: Trust metrics on controversial users: balancing between tyranny of the majority. Int. J. Semant. Web Inf. Syst. (IJSWIS) 3(1), 39–64 (2007)

    Article  Google Scholar 

  9. Cho, J.H., Chan, K., Adali, S.: A survey on trust modeling. ACM Comput. Surv. 48(2), 28:1–28:40 (2015). https://doi.org/10.1145/2815595

    Article  Google Scholar 

  10. Guha, R., Kumar, R., Raghavan, P., Tomkins, A.: Propagation of trust and distrust. In: Proceedings of the 13th International Conference on World Wide Web, WWW 2004, pp. 403–412. ACM, New York (2004). https://doi.org/10.1145/988672.988727

  11. Roztocki, N.: Using internet-based surveys for academic research: opportunities and problems. In: Proceedings of the 2001 American Society for Engineering Management (ASEM) National Conference, pp. 290–295 (2001)

    Google Scholar 

  12. Curran, P.G.: Methods for the detection of carelessly invalid responses in survey data. J. Exp. Soc. Psychol. 66, 4–19 (2016)

    Article  Google Scholar 

  13. Curran, P., Hauser, D.: Understanding responses to check items: a verbal protocol analysis. In: Philadelphia, PA: Paper presented at the 30th Annual Conference of the Society for Industrial and Organizational Psychology (2015)

    Google Scholar 

  14. Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. (CSUR) 41(3), 15 (2009)

    Article  Google Scholar 

  15. Ramoudith, S., Hosein, P.: A metric for the fair comparison of ISPs (To be presented at the Sixth International Conference on Internet Science in December 2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shiva Ramoudith .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ramoudith, S., Hosein, P. (2020). A Trust Framework for the Collection of Reliable Crowd-Sourced Data. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Advances in Information and Communication. FICC 2020. Advances in Intelligent Systems and Computing, vol 1130. Springer, Cham. https://doi.org/10.1007/978-3-030-39442-4_4

Download citation

Publish with us

Policies and ethics