Live Roundups Editor's Desk Insights Executive Ops Weather About 🔍
Home › Science › Unlocking Crowdsourcing for Ontology Matching Validation
Science

Unlocking Crowdsourcing for Ontology Matching Validation

arXiv CS Thursday 04 June 2026, 04:00 UTC By Zhangcheng Qiang 1 min read
Key Points

arXiv:2605.12226v4 Announce Type: replace Abstract: Recent advances in large language models (LLMs) pose new challenges for ontology matching (OM). While OM systems built on LLMs have shown remarkable capabilities in discovering more matching candidates, traditional OM validation that relies on domain experts has become overwhelming. In this study, we explore the use of crowdsourcing for OM validation and introduce a novel crowdsourcing system.

arXiv:2605.12226v4 Announce Type: replace Abstract: Recent advances in large language models (LLMs) pose new challenges for ontology matching (OM). While OM systems built on LLMs have shown remarkable capabilities in discovering more matching candidates, traditional OM validation that relies on domain experts has become overwhelming. In this study, we explore the use of crowdsourcing for OM validation and introduce a novel crowdsourcing system. We propose three domain-specific mechanisms, namely differential trustworthiness, coherence pre-filling, and time-dependent opinion, to ensure the quality of crowdsourcing for OM validation. We demonstrate that our crowdsourcing system can be integrated with existing OM systems to enable human-in-the-loop validation. The evaluation of the system shows its effectiveness in handling diverse user groups and different annotation settings. We discuss two real-world use cases of the system and current limitations for improvement.
OM (ORG)
Originally published by arXiv CS Read original →

Related Stories

Low-copper paints matched high-copper rivals, while silicone performed best against fouling

When comparing different types of antifouling paints against fouling on leisure boats, the results were the opposite of what many would expect. Of the paints tested, the biocide-free silicone paint worked best, and the paint marketed as environmentally friendly turned out to be extremely toxic. The study, led by Chalmers University of Technology in Sweden, was conducted in Swedish, Danish and French coastal waters and also showed that coatings with a low copper content can be just as...

Phys.org 8m ago

Novel catalyst design boosts solar-driven ammonia production under mild conditions

Sunlight, water, air and metal-organic catalysts—that could be all it takes. TU Wien has shown how catalyst design can be advanced for solar-driven NH3 synthesis. Without this chemical technology, feeding the world as we know it would be nearly impossible.

Phys.org 8m ago

Hurricane rainfall and landslide risk are on the rise in Southern California

Climate change could make historically rare tropical storms in Southern California produce significantly more precipitation in the next few decades, and when they strike, landslides are likely to become a bigger risk across the region, according to new research in Nature Climate Change.

Phys.org 18m ago

Global warming hit 1.37°C in 2025, with Earth accumulating heat at an accelerating rate

Strong and consistent evidence shows that the entire climate system is continuing to heat, driving rapid global warming. Human activities pushed global warming to 1.37°C in 2025, and its level is projected to surpass 1.5°C in about four years. Crucially, the rate at which heat is accumulating in Earth's system suggests high levels of future warming.

Phys.org 18m ago