The Evolution of Human Computation: Past, Present and Future
DOI:
https://doi.org/10.18063/phci.v1i2.805Keywords:
human computation, human factorsAbstract
Human computation is a technique that utilizes human abilities to perform computation tasks that are difficult for computers to process. Since the concept of human computation was introduced in 2003, many applications have been developed in an ad hoc manner and a large number of published works have focused on different aspects of human computation, such as computational techniques and performance analysis. To understand how to apply human computation to solve different problems today, it is important to understand how human computation evolves and why it happens. In light of the achievements of human computation so far, we consider what the future may hold for this relatively new field.
References
von Ahn, L. 2006. Games with a purpose. Computer 39, 92–94.
Casey, S., Kirman, B., and Rowland, D. 2007. The gopher game: a social, mobile, locative game with user generated content and peer review. In ACE ’07: Proceedings of the international conference on Advances in computer entertainment technology. ACM, 9–16.
Hacker, S. and von Ahn, L. 2009. Matchin: eliciting user preferences with an online game. In CHI ’09: Proceedings of the 27th international conference on Human factors in computing systems. ACM, 1207–1216.
Quinn, A. J. and Bederson, B. B. 2011. Human computation: a survey and taxonomy of a growing field. In CHI ’11: Proceedings of the 2011 annual conference on Human factors in computing systems. ACM, 1403–1412.
von Ahn, L. 2005. Human computation. Ph.D. thesis, Carnegie Mellon University.
von Ahn, L. and Dabbish, L. 2008. Designing games with a purpose. Communications of the ACM 51, 8, 58–67.
von Ahn, L., Blum, M., Hopper, N. J., and Langford, J. 2003. CAPTCHA: Using Hard AI Problems for Security. In EUROCRYPT ’03: Proceedings of the 22nd international conference on Theory and applications of cryptographic techniques. Springer, 294–311.
von Ahn, L. and Dabbish, L. 2004. Labeling images with a computer game. In CHI ’04: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 319–326.
von Ahn, L., Ginosar, S., Kedia, M., Liu, R., and Blum, M. 2006. Improving accessibility of the web with a computer game. In CHI ’06: Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM, 79–82.
von Ahn, L., Maurer, B., Mcmillen, C., Abraham, D., and Blum, M. 2008. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 5895, 1465–1468.
Grier, D. A. 2005. When computers were human. Princeton University Press.
Lenat, D. B. 1995. CYC: a large-scale investment in knowledge infrastructure. Communications of the ACM 38, 11, 33–38.
Friedland, N. S., Allen, P. G., Matthews, G., et al. 2004. Project halo: Towards a digital aristotle. AI Magazine 25, 4, 29–48.
Stock, D. and C.P., L. 2000. Open mind animals: Insuring the quality of data openly contributed over the world wide
web. In Proceedings of AAAI Workshop on Learning from Imbalanced Data Sets. AAAI Press, 4–9.
Stork, D. G. 1999. The open mind initiative. IEEE Expert Systems and Their Applications 14, 3, 19–20.
Stork, D. G. 2000a. Open data collection for training intelligent software in the open mind initiative. In EIS ’00: Proceedings
of the Engineering Intelligent Systems Symposium. 1–7.
Stork, D. G. 2000b. Using open data collection for intelligent software. Computer 33, 10, 104–106.
Liu, H. and Singh, P. 2004. Conceptnet: A practical commonsense reasoning toolkit. BT Technology Journal 22, 211–226.
Havasi, C., Speer, R., and Alonso, J. 2007. Conceptnet 3: a flexible, multilingual semantic network for common sense knowledge. In RANLP ’07: Proceedings of Recent Advances in Natural Language Processing.
Chung, H. 2006. Globalmind - bridging the gap between different cultures and languages with common-sense computing. M.S. thesis, Massachusetts Institute of Technology.
Lam, C. P. and Stork, D. G. 2003. Evaluating classifiers by means of test data with noisy labels. In IJCAI’03: Proceedings of the 18th international joint conference on Artificial intelligence. Morgan Kaufmann Publishers Inc., 513–518.
RICHARDSON, M. AND DOMINGOS, P. 2003. Building large knowledge bases by mass collaboration. In K-CAP ’03: Proceedings of the 2nd international conference on Knowledge capture. ACM, 129–137.
DASDAN, A., DROME, C., KOLAY, S., ALPERN, M., HAN, A., CHI, T., HOOVER, J., DAVTCHEV, I., AND VERMA, S. 2009. Thumbs-up: a game for playing to rank search results. In HCOMP ’09: Proceedings of the ACM SIGKDD Workshop on Human Computation. ACM, 36–37.
LAW, E. AND VON AHN, L. 2009. Input-agreement: a new mechanism for collecting data using human computation games. In CHI ’09: Proceedings of the 27th international conference on Human factors in computing systems. ACM, 1197– 1206.
BARRINGTON, L., O’MALLEY, D., TURNBULL, D., AND LANCKRIET, G. 2009. User-centered design of a social game to tag music. In HCOMP ’09: Proceedings of the ACM SIGKDD Workshop on Human Computation. ACM, 7–10.
GENTRY, C., RAMZAN, Z., AND STUBBLEBINE, S. 2005. Secure distributed human computation. In EC ’05: Proceedings of the 6th ACM conference on Electronic commerce. ACM, 155–164.
HEYMAN, J. AND ARIELY, D. 2004. Effort for Payment. A Tale of Two Markets. Psychological Science 15, 11, 787–793.
MASON, B. AND THOMAS, S. 2008. A million penguins research report. Tech. rep., Institute of Creative Technologies, De Montfort University, Leicester, UK.
ROHWER, P. 2010. A note on human computation limits. In HCOMP ’10: Proceedings of the ACM SIGKDD Workshop on
Human Computation. ACM, 38–40.
YUEN, M.-C., CHEN, L.-J., AND KING, I. 2009. A survey of human computation systems. In CSE ’09: Proceedings of
IEEE International Conference on Computational Science and Engineering. IEEE Computer Society, 723–728.
YUEN, M.-C., KING, I., AND LEUNG, K.-S. 2011. A survey of crowdsourcing systems. In SocialCom ’11: Proceedings
of The Third IEEE International Conference on Social Computing. IEEE Computer Society, 766–773.
