Aus Aifbportal
Wechseln zu:Navigation, Suche
XLiMe logo text v06.png

crossLingual crossMedia knowledge extraction

Kontaktperson: Achim Rettinger

Projektstatus: abgeschlossen


Europe is different from other large media markets such as the US or China in that information is being generated in different languages and distributed via diverse streams of localised media channels. Automatic analysis is complicated further by different content types (audio, video, text) and different channels (mainstream, social media). Thus, information can only be analysed independently for each dimension. This restricts the extractable knowledge and keeps it fragmented, which ultimately constrains the exchange of information. xLiMe proposes to extract knowledge from different media channels and languages and relate it to cross-lingual, cross-media knowledge bases. By doing this in near real-time we will provide a continuously updated and comprehensive view on knowledge diffusion across media, e.g., from European communities like Catalonia to worldwide content in English. Tools and methods developed in xLiMe will be applied in three complementary case studies and evaluated by several business clients and up to 10mio end users . We will 1. augment more than 250 TV channels in different languages with up-to-date information from social media and news in near real-time, 2. monitor brands and the diffusion of opinions across languages and media, and 3. analyse online shop performance with regard to external cross-lingual, cross-media factors, like campaigns for brands and the emergence of public opinions. By combining speech recognition, natural language processing, machine learning and semantic technologies we will advance key open research problems, by 1. extracting machine-readable knowledge (entities, sentiment, events and opinions) from multilingual, multimedia and social media content and integrate it with cross-lingual, cross-media knowledge bases, 2. searching this knowledge with structured and unstructured queries in near real-time, 3. monitoring its provenance, consumption and diffusion and 4. analysing the interdependency between media exposure and behavioural patterns.

Involvierte Personen
Achim RettingerLei ZhangAnja HessRudi StuderAndreas ThalhammerAditya MogadalaSteffen ThomaMaria Maleshkova


von: 1 November 2013
bis: 31 Oktober 2016
Finanzierung: EU
Vorgängerprojekt(e): XLike


Jozef Stefan Institute Ljubljana, University of Trento, ZATTOO corp., VICO Research & Consulting GmbH, ECONDA GmbH, Intelligent Software Components (ISOCO)


Web Science und Wissensmanagement


XLiMe (Wissensrepräsentation, Maschinelles Lernen, Text Mining, Semantische Annotation, Semantische Annotierung, Natürliche Sprachverarbeitung, Multimedia Annotation & Retrieval, Data Mining)


LinkSUM, X-LiSA, XKnowSearch!


DBpedia PageRank, XLiD-Lexica

Publikationen zum Projekt
 - book
 - incollection
 - booklet
 - phdthesis
 - techreport
 - deliverable
 - manual
 - misc
 - unpublished

Michael Färber, Frederic Bartscherer, Carsten Menne, Achim Rettinger
Linked Data Quality of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO
Semantic Web Journal, 9, (2), Seiten 77–129, 2018

Lei Zhang, Andreas Thalhammer, Achim Rettinger, Michael Färber, Aditya Mogadala, Ronald Denaux
The xLiMe System: Cross-lingual and Cross-modal Semantic Annotation, Search and Recommendation over Live-TV, News and Social Media Streams
Journal of Web Semantics, 46, Seiten 20-30, 2017

Alexander G. Hauptmann, James Hodson, Juanzi Li, Nicu Sebe, Achim Rettinger
Cross-Lingual Cross-Media Content Linking: Annotations and Joint Representations
Dagstuhl Reports, 5, (5), Seiten 2192-5283, Dezember, 2015

Lei Zhang, Achim Rettinger
X-LiSA: Cross-lingual Semantic Annotation
Proceedings of the VLDB Endowment (PVLDB), the 40th International Conference on Very Large Data Bases (VLDB), 7, (13), Seiten 1693-1696, September, 2014

↑ top

Aditya Mogadala, Dominik Jung, Achim Rettinger
Linking Tweets with Monolingual and Cross-Lingual News using Transformed Word Embeddings
18th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing), IJCLA, April, 2017

Andreas Thalhammer, Achim Rettinger
PageRank on Wikipedia: Towards General Importance Scores for Entities
In Harald Sack, Giuseppe Rizzo, Nadine Steinmetz, Dunja Mladenić, Sören Auer, Christoph Lange, The Semantic Web: ESWC 2016 Satellite Events, Heraklion, Crete, Greece, May 29 - June 2, 2016, Revised Selected Papers, Seiten: 227-240, Springer International Publishing, Lecture Notes in Computer Science, 9989, Cham, Oktober, 2016

Lei Zhang, Achim Rettinger, Patrick Philipp
Context-Aware Entity Disambiguation in Text Using Markov Chains
IEEE/WIC/ACM International Conference on Web Intelligence (WI'16), IEEE Computer Society Press, Oktober, 2016

Michael Färber, Achim Rettinger, Andreas Harth
Towards Monitoring of Novel Statements in the News
Proceedings of the 13th Extended Semantic Web Conference (ESWC 2016), Seiten: 285–299, Springer, Berlin, Mai, 2016

Lei Zhang, Michael Färber, Achim Rettinger
XKnowSearch! Exploiting Knowledge Bases for Entity-based Cross-lingual Information Retrieval
Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM 2016), Seiten: 2425–2428, ACM, Oktober, 2016

Christian Paul, Achim Rettinger, Aditya Mogadala, Craig A. Knoblock, Pedro Szekely
Efficient Graph-based Document Similarity
In Harald Sack, Eva Blomqvist, Mathieu d'Aquin, Chiara Ghidini, Simone Paolo Ponzetto, Christoph Lange, The Semantic Web. Latest Advances and New Domains. 13th Extended Semantic Web Conference (ESWC), Crete, Greece., Seiten:, Springer International Publishing., Juni, 2016

Aditya Mogadala, Achim Rettinger
Bilingual Word Embeddings from Parallel and Non-parallel Corpora for Cross-Language Text Classification.
Human Language Technologies: The 2016 Annual Conference of the North American Chapter of the ACL., Association for Computational Linguistics, Juni, 2016

Michael Färber, Achim Rettinger, Boulos El Asmar
On Emerging Entity Detection
Proceedings of the 20th International Conference on Knowledge Engineering and Knowledge Management (EKAW'16), Seiten: 223–238, Springer, November, 2016

Andreas Thalhammer, Nelia Lasierra, Achim Rettinger
LinkSUM: Using Link Analysis to Summarize Entity Data
In Bozzon, Alessandro and Cudré-Mauroux, Philippe and Pautasso, Cesare, Web Engineering, 16th International Conference, ICWE 2016, Lugano, Switzerland, June 6-9, 2016. Proceedings, Seiten: 244-261, Springer International Publishing, Lecture Notes in Computer Science, 9671, Cham, Juni, 2016

Lei Zhang, Achim Rettinger, Ji Zhang
A Knowledge Base Approach to Cross-lingual Keyword Query Interpretation
The 15th International Semantic Web Conference (ISWC'16), Springer, Oktober, 2016

Andreas Thalhammer, Achim Rettinger
ELES: Combining Entity Linking and Entity Summarization
In Bozzon, Alessandro and Cudré-Mauroux, Philippe and Pautasso, Cesare, Web Engineering, 16th International Conference, ICWE 2016, Lugano, Switzerland, June 6-9, 2016. Proceedings, Seiten: 547-550, Springer International Publishing, Lecture Notes in Computer Science, 9671, Cham, Juni, 2016

Lei Zhang, Achim Rettinger, Ji Zhang
A Probabilistic Model for Time-Aware Entity Recommendation
The 15th International Semantic Web Conference (ISWC'16) Best Student Paper Award at ISWC 2016, Springer, Oktober, 2016

Achim Rettinger, Artem Schumilin, Steffen Thoma, Basil Ell
Learning a Cross-Lingual Semantic Representation of Relations Expressed in Text
Proc. of the 12th Extended Semantic Web Conference (ESWC'15), Seiten: 337-352, Springer, Mai, 2015

Aditya Mogadala
Polylingual Multimodal Learning
In Hollmén, Jaakko and Papapetrou, Panagiotis, Proceedings of the ECMLPKDD 2015 Doctoral Consortium, Seiten: pp. 155-164, Aalto University publication series SCIENCE + TECHNOLOGY, 12/2015, September, 2015

Andreas Thalhammer, Steffen Stadtmüller
SUMMA: A Common API for Linked Data Entity Summaries
In Cimiano, Philipp and Frasincar, Flavius and Houben, Geert-Jan and Schwabe, Daniel, Engineering the Web in the Big Data Era, Seiten: 430-446, Springer International Publishing, 9114, Juni, 2015

Lei Zhang, Wentao Chen, Thanh Tran, Achim Rettinger
Time-Aware Entity Search in DBpedia
The Semantic Web: ESWC 2015 Satellite Events, Springer, LNCS, Mai, 2015

Aditya Mogadala, Achim Rettinger
Multi-Modal Correlated Centroid Space for Multi-Lingual Cross-Modal Retrieval
In Hanbury, Allan and Kazai, Gabriella and Rauber, Andreas and Fuhr, Norbert, Advances in Information Retrieval: 37th European Conference on IR Research (ECIR), Vienna, Austria., Seiten:, Springer International Publishing, Cham, Germany, April, 2015

Lei Zhang, Thanh Tran, Achim Rettinger
A Theoretical Analysis of Cross-lingual Semantic Relatedness in Vector Space Models
Proceedings of the ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR 2015), ACM, September, 2015

Lei Zhang, Yunpeng Dong, Achim Rettinger
Towards Entity Correctness, Completeness and Emergence for Entity Recognition
24th International World Wide Web Conference (WWW 2015), Companion Volume, ACM, Mai, 2015

Lei Zhang, Cong Liu, Achim Rettinger
A Topic-Sensitive Model for Salient Entity Linking
Proceedings of the LD4IE workshop co-located with the 14th International Semantic Web Conference (ISWC 2015), CEUR-WS, Oktober, 2015

Lei Zhang, Achim Rettinger, Steffen Thoma
Bridging the Gap between Cross-lingual NLP and DBpedia by Exploiting Wikipedia
Proceedings of the NLP&DBpedia workshop co-located with the 13th International Semantic Web Conference (ISWC 2014), CEUR-WS, Oktober, 2014

Lei Zhang, Michael Färber, Thanh Tran, Achim Rettinger
Exploiting Semantic Annotations for Entity-based Information Retrieval
Proceedings of the ISWC 2014 Posters & Demonstrations Track within the 13th International Semantic Web Conference (ISWC 2014), Seiten: 429–432, Springer, Oktober, 2014

Lei Zhang, Michael Färber, Achim Rettinger
xLiD-Lexica: Cross-lingual Linked Data Lexica
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), Seiten: 2101-2105, European Language Resources Association (ELRA), Mai, 2014

Andreas Thalhammer, Achim Rettinger
Browsing DBpedia Entities with Summaries
In Valentina Presutti, Eva Blomqvist, Raphael Troncy, Harald Sack, Ioannis Papadakis, Anna Tordai, The Semantic Web: ESWC 2014 Satellite Events, Seiten: 511-515, Springer, LNCS, Heidelberg, Oktober, 2014

↑ top

Gong Cheng, Kalpa Gunaratna, Andreas Thalhammer, Heiko Paulheim, Martin Voigt, Roberto García
Joint Proceedings SumPre and HSWI 2015
CEUR-WS, Vol. Vol-1556, Februar, 2016

↑ top

Lei Zhang, Michael Färber, Andreas Thalhammer, Aditya Mogadala, Achim Rettinger
Exploiting Knowledge Bases for Multilingual and Cross-lingual Semantic Annotation and Search
2nd Place in the Semantic Web Challenge (SWC), the 14th International Semantic Web Conference (ISWC 2015), Bethlehem, PA, USA, Oktober, 2015

↑ top