We investigate workflow-based approaches for online integration of web data. In the online setting data integration tasks have to be executed at run-time, e.g. interactive web applications such as mashups. Such an ad-hoc data integration requires to combine content from multiple services or sources dynamically within a very short time. Existing mashup approaches only support rather simple data integration tasks.

Our work on workflow-based data integration started already well before the general mashup interest in 2005 with our prototypeiFuice. iFuice sexploits mappings between logical and physical data sources and supports search query generation, online matching as well as for additional data transformation. Query results can be interactively refined to improve the result quality by executing madditional queries. A script-based definition of mashups (integration workflows) facilitates the development as well as the dynamic execution of mashups. The script programmer can use powerful generic operators to execute and manipulate mappings and their results. Based on the generic iFuice infrastructure we develop several domain-specific integration systems such as BioFuice. The CloudFuice tool enables script execution in the cloud.

Based on the experiences with the iFuice-related systems we have developed a new, more powerful mashup tool WETSUIT.

People

• Prof. Dr. Erhard Rahm
• Dr. Andreas Thor
• Stefan Endrullis (DFG)
• David Aumueller

Funding

Publications

Endrullis, S.; Thor, A.; Rahm, E. WETSUIT: An Efficient Mashup Tool for Searching and Fusing Web Entities Proc. 38th Intl. Conference on Very Large Databases (VLDB) / Proceedings of the VLDB Endowment 5(12), 2012 (demo) 2012-08

Endrullis, S.; Thor, A.; Rahm, E. Entity Search Strategies for Mashup Applications Proc. 28th Intl. Conference on Data Engineering (ICDE), 2012 2012-04

Thor, A.; Rahm, E. CloudFuice: A flexible Cloud-based Data Integration System Proc. of 10th Intl. Conference on Web Engineering (ICWE), 2011 2011-06

Wartner, C.; Kitschke, S. PROOF: Produktmonitoring im Web Proc. of 14. GI-Fachtagung für Datenbanksysteme in Business, Technologie und Web (BTW), 2011 2011-03

Endrullis, S.; Thor, A.; Rahm, E. Evaluation of Query Generators for Entity Search Engines Proc. Intl. Workshop on Using Search Engine Technology for Information Management (USETIM), 2009 2009-08

Aumueller, D.; Thor, A. Mashup-Werkzeuge zur Ad-hoc-Datenintegration im Web Datenbank-Spektrum 8(26), 2008 2008-09

Rahm, E.; Thor, A.; Aumueller, D. Dynamic Fusion of Web Data Proc. 5th Intl. XML Database Symposium (XSym), 2007 2007-09

Thor, Andreas; Aumueller, David; Rahm, Erhard Data Integration Support for Mashups Proc. 6th Intl. Workshop on Information Integration on the Web (IIWeb), 2007 2007-07

Kirsten, Toralf; Rahm, Erhard BioFuice: Mapping-based data integration in bioinformatics Proc. of 3rd Int. Workshop on Data Integration in the Life Sciences (DILS), Springer LNCS 4075, 2006 2006-07

Rahm, E.; Thor, A.; Aumueller, D.; Do, H.H.; Golovin, N.; Kirsten, T. iFuice - Information Fusion utilizing Instance Correspondences and Peer Mappings Proc. 8th Intl. Workshop on the Web and Databases (WebDB), 2005 2005-06

A growing collection of mashup-related publications can be found in the mashup publication categorizer.