FEVER - Framework for EValuating Entity Resolution
FEVER is a new evaluation platform for entity resolution
approaches. The modular structure of the FEVER framework
supports the incorporation or reconstruction of many previously
proposed approaches for entity resolution. A distinctive feature of
FEVER is that it not only evaluates traditional measures such as
precision and recall but also the effort for configuring (e.g., parameter
tuning, training) a good entity resolution approach.
Architecture
The above figure illustrates the architecture of FEVER consisting of modules
for the definition and execution of entity resolution approaches
or so-called match workflows. A GUI-based workflow
editor allows to interactively specify match workflows utilizing
operator trees. The FEVER runtime executes a specified workflow
and, thus, generates evaluation data.
Comparative evaluation of entity resolution approaches with FEVER
Analysis of entity resolution publications
For our comparative evaluation of entity resolution approaches
in [1] [1] we have analyzed numerous research publications w.r.t. their
evaluation of entity resolution approaches. The complete list can be found here [2].
Datasets
The datasets used in the evaluation can be downloaded here [3]
Publications
 [4]
 [5]
 [6] |  [7] | Köpcke, H. [8]
Object Matching on Real-world Problems [9]
Dissertation, Universität Leipzig
2014-05 [10] |
|
[11]
[12] |  [13] | Köpcke, H. [14]; Thor, A. [15]; Rahm, E. [16]
Evaluation of entity resolution approaches on real-world match problems [17]
Proc. 36th Intl. Conference on Very Large Databases (VLDB) / Proceedings of the VLDB Endowment 3(1), 2010
2010-09 [18] |
|
[19]
[20] |  [21] | Thor, A. [22]
Toward an adaptive String Similarity Measure for Matching Product Offers [23]
Proc. GI-Workshop - Informationsintegration in Service-Architekturen, 2010
2010-09 [24] |
|
[25]
[26]
[27] |  [28] | Köpcke, H. [29]; Thor, A. [30]; Rahm, E. [31]
Learning-based approaches for matching web data entities [32]
IEEE Internet Computing 14(4), 2010
2010-07 [33] |
|
[34]
[35] |  [36] | Köpcke, H. [37]; Thor, A. [38]; Rahm, E. [39]
Comparative evaluation of entity resolution approaches with FEVER [40]
Proc. 35th Intl. Conference on Very Large Databases (VLDB), 2009 (demo)
2009-08 [41] |
|
Contact/Project Members
- Prof. Dr. Erhard Rahm [42]
- Hanna Köpcke [43]
- Dr. Andreas Thor [44]
Links:
[1] http://dbs.uni-leipzig.de/en/publication/title/comparative_evaluation_of_entity_resolution_approaches_with_fever
[2] http://dbs.uni-leipzig.de/de/research/projects/object_matching/fever/analysis_of_research_publications
[3] http://dbs.uni-leipzig.de/de/research/projects/object_matching/fever/benchmark_datasets_for_entity_resolution
[4] https://old.dbs.uni-leipzig.de/file/Dissertation_HannaKöpcke_online.pdf
[5] https://katalog.ub.uni-leipzig.de/Record/0013004879
[6] http://scholar.google.com/scholar?q=+intitle%3A%22Object+Matching+on+Real-world+Problems%22
[7] https://old.dbs.uni-leipzig.de/de/publication/title/object_matching_on_real_world_problems
[8] https://old.dbs.uni-leipzig.de/de/publication/author/Köpcke, H
[9] https://old.dbs.uni-leipzig.de/de/publication/title/object_matching_on_real_world_problems
[10] https://old.dbs.uni-leipzig.de/de/publication/year/2014
[11] https://old.dbs.uni-leipzig.de/file/EvaluationOfEntityResolutionApproaches_vldb2010_CameraReady.pdf
[12] http://scholar.google.com/scholar?q=+Thor+Rahm+intitle%3A%22Evaluation+of+entity+resolution+approaches+on+real-world+match+problems%22
[13] https://old.dbs.uni-leipzig.de/de/publication/title/evaluation_of_entity_resolution_approaches_on_real_world_match_problems
[14] https://old.dbs.uni-leipzig.de/de/publication/author/Köpcke, H
[15] https://old.dbs.uni-leipzig.de/de/publication/author/Thor, A
[16] https://old.dbs.uni-leipzig.de/de/publication/author/Rahm, E
[17] https://old.dbs.uni-leipzig.de/de/publication/title/evaluation_of_entity_resolution_approaches_on_real_world_match_problems
[18] https://old.dbs.uni-leipzig.de/de/publication/year/2010
[19] https://old.dbs.uni-leipzig.de/file/prodmatch_final.pdf
[20] http://scholar.google.com/scholar?q=+Thor+intitle%3A%22Toward+an+adaptive+String+Similarity+Measure+for+Matching+Product+Offers%22
[21] https://old.dbs.uni-leipzig.de/de/publication/title/toward_an_adaptive_string_similarity_measure_for_matching_product_offers
[22] https://old.dbs.uni-leipzig.de/de/publication/author/Thor, A
[23] https://old.dbs.uni-leipzig.de/de/publication/title/toward_an_adaptive_string_similarity_measure_for_matching_product_offers
[24] https://old.dbs.uni-leipzig.de/de/publication/year/2010
[25] https://old.dbs.uni-leipzig.de/file/ieeeInternet2010-final.pdf
[26] http://doi.ieeecomputersociety.org/10.1109/MIC.2010.58
[27] http://scholar.google.com/scholar?q=+Thor+Rahm+intitle%3A%22Learning-based+approaches+for+matching+web+data+entities%22
[28] https://old.dbs.uni-leipzig.de/de/publication/title/evaluation_of_learning_based_approaches_for_matching_web_data_entities
[29] https://old.dbs.uni-leipzig.de/de/publication/author/Köpcke, H
[30] https://old.dbs.uni-leipzig.de/de/publication/author/Thor, A
[31] https://old.dbs.uni-leipzig.de/de/publication/author/Rahm, E
[32] https://old.dbs.uni-leipzig.de/de/publication/title/evaluation_of_learning_based_approaches_for_matching_web_data_entities
[33] https://old.dbs.uni-leipzig.de/de/publication/year/2010
[34] https://old.dbs.uni-leipzig.de/file/FEVER_vldb09_demo_cameraReady.pdf
[35] http://scholar.google.com/scholar?q=+Thor+Rahm+intitle%3A%22Comparative+evaluation+of+entity+resolution+approaches+with+FEVER%22
[36] https://old.dbs.uni-leipzig.de/de/publication/title/comparative_evaluation_of_entity_resolution_approaches_with_fever
[37] https://old.dbs.uni-leipzig.de/de/publication/author/Köpcke, H
[38] https://old.dbs.uni-leipzig.de/de/publication/author/Thor, A
[39] https://old.dbs.uni-leipzig.de/de/publication/author/Rahm, E
[40] https://old.dbs.uni-leipzig.de/de/publication/title/comparative_evaluation_of_entity_resolution_approaches_with_fever
[41] https://old.dbs.uni-leipzig.de/de/publication/year/2009
[42] https://old.dbs.uni-leipzig.de/en//person/rahm
[43] https://old.dbs.uni-leipzig.de/en//person/hanna_koepcke
[44] https://old.dbs.uni-leipzig.de/en//person/andreas_thor