Data Integration: Achievements and Perspectives in the last ten years AiJing
Data Integration: Achievements and Perspectives in the Last Ten Years AiJing
Outline a Motivation background Best Paper: Information Manifold Building on the Foundation Data Integration Industry a Future Challenges Conclusion
Outline ◼ Motivation & Background ◼ Best Paper: Information Manifold ◼ Building on the Foundation ◼ Data Integration Industry ◼ Future Challenges ◼ Conclusion
Motivation background Data integration is a pervasive challenge faced in applications that need to query across multiple autonomous and heterogeneous data sources Data integration is crucial in large enterprises that own a multitude of data sources a For better cooperation among agencies, each with their own data sources
Motivation & Background ◼ Data integration is a pervasive challenge faced in applications that need to query across multiple autonomous and heterogeneous data sources. ◼ Data integration is crucial in large enterprises that own a multitude of data sources. ◼ For better cooperation among agencies, each with their own data sources
Kayak. com Search Results- Mozilla Firefox 回区 File Edit View Go Bookmarks Tools Help 中,中·⑧价体如 Or) Travel Center B crossing the Structur.[ Schedule a Conferen.. B Main-Scuba Dashboard Sign out John Battelle's Searc..2) Goge·skh Gsa·@ycek, AutoLink a AutoF Best fare Trend details ICN>SF0 X Asiana Airlines /1:33p 5: 40p 0(12h 07m $1423SF0>CN Multiple Airlines 5: 30p 3: 35p 1(14h 05m $850 800 90 Days Ago Today $1423 SFO ICN >c Asiana Airlines / 1: 33p 5:40p 0(12h 07m Stop ICN SF0 Multiple Airlines 5: 30 413p1(14h43m 回 nonstop國±st回2+ stops obtz:$1423 details email Airlines ICN>SFO X Asiana Airlines/1:33p 5: 40p 0(12h 07m $1423SF0>CN elect all I onstop 1 Multiple Airlines 5: 30p 525p1(15h55m) MAir France 多10486 orbitz: $1423 details emai 回 All Nippon AMerican Airlines $1423 SFO >ICN Ye Asiana Airlines /1:33p 5: 40p 0(12h 071 Cathay Pacific 2845 ICN SFO Multiple Airlines 5 30p 5: 50p 1(16h 20m) cHina Airlines 1483 obtz:$1423 details email 回 EVA Corporation M Multiple Airlines $2044 51423 $1453 SFO> ICN 回 Singapore Airlines s1796 SCN SFO S EVA Corporation 7:158 7 5p 1 (16h 40m) United s2291 s2170 airfare: $1453 US Airways s2242 $1483SF0>0N·⌒ ∧: 105a12:00p1(18h55m) 》 Done Open Notebook
Data Integration Legacy Databases Services and Applications Enterprise Databases
Outline a Motivation background a Best Paper: Information Manifold Building on the Foundation Data Integration Industry a Future Challenges Conclusion
Outline ◼ Motivation & Background ◼ Best Paper: Information Manifold ◼ Building on the Foundation ◼ Data Integration Industry ◼ Future Challenges ◼ Conclusion
Ten-Year Best paper Querying Heterogeneous Information Sources using Source Descriptions. VLDB96 Alon Halevy a principal member of technical staff at at&T Bell Laboratories. and then at at &T Laboratories Main idea: the nformation manifold led to tremendous progress on data integration and to quite a few commercial data integration products
Ten-Year Best Paper Querying Heterogeneous Information Sources using Source Descriptions. VLDB96 Alon Halevy a principal member of technical staff at AT&T Bell Laboratories, and then at AT&T Laboratories. • Main idea: the Information Manifold • led to tremendous progress on data integration and to quite a few commercial data integration products
The Information manifold An implemented data integration system Goal: provide a uniform query interface to a heterogeneous collection of Web data sources Main contribution: the way it described the contents of the data sources it knew about IM contains declarative descriptions of the contents and capabilities of the information sources. Source Description)
The Information Manifold ◼ An implemented data integration system ◼ Goal: provide a uniform query interface to a heterogeneous collection of Web data sources ◼ Main contribution: the way it described the contents of the data sources it knew about. ◼ IM contains declarative descriptions of the contents and capabilities of the information sources. (Source Description)
An example of complex query find reviews of movie directed by Woody Allen playing in my area three web sites join! 1. a movie site containing actor and director information(IMDB) 2. movie playing sources(e.g, 777film com 3. movie review sites(e.g, a newspaper)
An example of complex query find reviews of movie directed by Woody Allen playing in my area three web sites join! 1. a movie site containing actor and director information (IMDB) 2. movie playing sources(e.g.,777film.com) 3. movie review sites (e.g., a newspaper)
Design time Run time Mediated schema query reformulation Semantic mappings optimization execution wrapper wrapper wrapper wrapper wrapper
wrapper wrapper wrapper wrapper wrapper Mediated Schema Semantic mappings optimization & execution query reformulation Design time Run time
emantic mappings Mediated Schema CD: ASIN, Title, Genre Artist: ASIN, name, Informatio n sources Mapping logic Books Author Album Title ISBN ASIN ISBN FirstName Pri LastName DiscountPrice DiscountPrice Studio Edition Artists CDCategories Book Categories ASIN ASIN ISBN ArtistName Category Category Group Name
Semantic Mappings Books Title ISBN Price DiscountPrice Edition CDs Album ASIN Price DiscountPrice Studio BookCategories ISBN Category CDCategories ASIN Category Artists ASIN ArtistName GroupName Authors ISBN FirstName LastName CD: ASIN, Title, Genre,… Artist: ASIN, name, … Mediated Schema Mapping logic Informatio n sources