Return-of-Interest Conscious Truth Inference for Crowdsourcing Queries

Lok Him Leung, Po An Yang, Kun Ta Chuang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In the big data era, the flourishing development of Internet services brings a lot of user generated data, in which most new information cannot be systematically retrieved by current knowledge bases. For example, a dramatic number of new hashtags appear in the social media every day, resulting in much unknown but valuable knowledge that requires reliable category/attribute labeling strategies. The crowdsourcing platform provides an effective tool to leverage opinions from the Internet crowd. In this paper, we propose incorporating varied task importance, called Return of Interest (RoI), into resource allocation in crowdsourcing. The awareness of RoI is important in the business sense, but it introduces new challenges. In this paper, we propose a two-phase framework, called Macro-Assignment and Micro-Optimization (MAMO), to simultaneously consider the issue of budget allocation and the chance of iteratively obtaining RoI. With the fixed budget, we prove that worker allocation to diverse pools for the best expectation of RoI in return is a NPhard challenge. We propose a Dynamic-Programming strategy to resolve the issue effectively. As shown in our experimental results, we demonstrate that the DP-based strategy can significantly outperform the baseline greedy approaches, also indicating its feasibility to be deployed as the standard component for budget allocation in crowdsourcing.

Original languageEnglish
Title of host publicationProceedings - 2021 International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages60-65
Number of pages6
ISBN (Electronic)9781665408257
DOIs
Publication statusPublished - 2021
Event26th International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2021 - Taichung, Taiwan
Duration: 2021 Nov 182021 Nov 20

Publication series

NameProceedings - 2021 International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2021

Conference

Conference26th International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2021
Country/TerritoryTaiwan
CityTaichung
Period21-11-1821-11-20

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'Return-of-Interest Conscious Truth Inference for Crowdsourcing Queries'. Together they form a unique fingerprint.

Cite this