1 |
Unsupervised quantification of entity consistency between photos and text in real-world news ...
|
|
Müller-Budack, Eric. - : Hannover : Institutionelles Repositorium der Leibniz Universität Hannover, 2022
|
|
Abstract:
Das World Wide Web und die sozialen Medien übernehmen im heutigen Informationszeitalter eine wichtige Rolle für die Vermittlung von Nachrichten und Informationen. In der Regel werden verschiedene Modalitäten im Sinne der Informationskodierung wie beispielsweise Fotos und Text verwendet, um Nachrichten effektiver zu vermitteln oder Aufmerksamkeit zu erregen. Kommunikations- und Sprachwissenschaftler erforschen das komplexe Zusammenspiel zwischen Modalitäten seit Jahrzehnten und haben unter Anderem untersucht, wie durch die Kombination der Modalitäten zusätzliche Informationen oder eine neue Bedeutungsebene entstehen können. Die Anzahl gemeinsamer Konzepte oder Entitäten (beispielsweise Personen, Orte und Ereignisse) zwischen Fotos und Text stellen einen wichtigen Aspekt für die Bewertung der Gesamtaussage und Bedeutung eines multimodalen Artikels dar. Automatisierte Ansätze zur Quantifizierung von Bild-Text-Beziehungen können für zahlreiche Anwendungen eingesetzt werden. Sie ermöglichen beispielsweise eine ... : In today’s information age, the World Wide Web and social media are important sources for news and information. Different modalities (in the sense of information encoding) such as photos and text are typically used to communicate news more effectively or to attract attention. Communication scientists, linguists, and semioticians have studied the complex interplay between modalities for decades and investigated, e.g., how their combination can carry additional information or add a new level of meaning. The number of shared concepts or entities (e.g., persons, locations, and events) between photos and text is an important aspect to evaluate the overall message and meaning of an article. Computational models for the quantification of image-text relations can enable many applications. For example, they allow for more efficient exploration of news, facilitate semantic search and multimedia retrieval in large (web) archives, or assist human assessors in evaluating news for credibility. To date, only a few ...
|
|
Keyword:
Bild-Text-Beziehungen; Bildindexierung; Computer vision; Date estimation; Deep Learning; Deep learning; Dewey Decimal Classification000 | Allgemeines, Wissenschaft000 | Informatik, Wissen, Systeme004 | Informatik; Event classification; Eventklassifikation; Face recognition; Geolocation estimation; Image indexing; Image-text relations; Maschinelles Sehen; Multimedia retrieval; Multimedia Retrieval; Nachrichtenanalyse; Natürliche Sprachverarbeitung; Natural language processing; News analytics; Personenerkennung; Schätzung des Aufnahmejahres; Schätzung des Aufnahmeortes
|
|
URL: https://dx.doi.org/10.15488/11719 https://www.repo.uni-hannover.de/handle/123456789/11812
|
|
BASE
|
|
Hide details
|
|
2 |
COSMO-Onset: A Neurally-Inspired Computational Model of Spoken Word Recognition, Combining Top-Down Prediction and Bottom-Up Detection of Syllabic Onsets
|
|
|
|
In: ISSN: 1662-5137 ; Frontiers in Systems Neuroscience ; https://hal.archives-ouvertes.fr/hal-03318691 ; Frontiers in Systems Neuroscience, Frontiers, 2021, 15, pp.653975. ⟨10.3389/fnsys.2021.653975⟩ (2021)
|
|
BASE
|
|
Show details
|
|
3 |
Online activation of L1 Danish orthography enhances spoken word recognition of Swedish
|
|
|
|
In: ISSN: 0332-5865 ; Nordic Journal of Linguistics ; https://hal-amu.archives-ouvertes.fr/hal-03283527 ; Nordic Journal of Linguistics, 2021, pp.1-19. ⟨10.1017/S0332586521000056⟩ (2021)
|
|
BASE
|
|
Show details
|
|
4 |
Hand-gesture recognition based on EMG and event-based camera sensor fusion: a benchmark in neuromorphic computing
|
|
|
|
In: ISSN: 1662-4548 ; EISSN: 1662-453X ; Frontiers in Neuroscience ; https://hal.archives-ouvertes.fr/hal-02617084 ; Frontiers in Neuroscience, Frontiers, 2020, pp.36 ; https://www.frontiersin.org/ (2020)
|
|
BASE
|
|
Show details
|
|
7 |
Neuroplasticity in Visual Word Recognition: An Exploration of Learning-Related Behavioural and Neural Changes ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
The temporal dynamics of first and second language processing: ERPs to spoken words in Mandarin-English bilinguals
|
|
|
|
In: Brain and Mind Institute Researchers' Publications (2020)
|
|
BASE
|
|
Show details
|
|
9 |
Traitement neuronal des voix et familiarité : entre reconnaissance et identification du locuteur
|
|
|
|
BASE
|
|
Show details
|
|
10 |
The Role of Surface and Underlying Forms When Processing Tonal Alternations in Mandarin Chinese: A Mismatch Negativity Study
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Challenges in Audio Processing of Terrorist-Related Data
|
|
|
|
In: International Conference on Multimedia Modeling ; https://hal.archives-ouvertes.fr/hal-02415176 ; International Conference on Multimedia Modeling, Springer, Jan 2019, Thessaloniki, Greece (2019)
|
|
BASE
|
|
Show details
|
|
12 |
Challenges in Audio Processing of Terrorist-Related Data
|
|
|
|
In: International Conference on Multimedia Modeling ; https://hal.archives-ouvertes.fr/hal-02387373 ; International Conference on Multimedia Modeling, Springer, Jan 2019, Thessaloniki, Greece (2019)
|
|
BASE
|
|
Show details
|
|
13 |
Does the prosodic emphasis of sentential context cause deeper lexical-semantic processing?
|
|
|
|
In: ISSN: 2327-3798 ; EISSN: 2327-3801 ; Language, Cognition and Neuroscience ; https://hal.univ-lille.fr/hal-01917002 ; Language, Cognition and Neuroscience, Taylor and Francis, 2019, 34, pp.29-42. ⟨10.1080/23273798.2018.1499945⟩ (2019)
|
|
BASE
|
|
Show details
|
|
14 |
Acoustic event, spoken keyword and emotional outburst detection
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Event Structure In Vision And Language
|
|
|
|
In: Publicly Accessible Penn Dissertations (2019)
|
|
BASE
|
|
Show details
|
|
16 |
Investigating the Electrophysiology of Long-Term Priming in Spoken Word Recognition
|
|
|
|
In: ETD Archive (2018)
|
|
BASE
|
|
Show details
|
|
17 |
Non-linguistic Vocalization Recognition Based on Convolutional, Long Short-Term Memory, Deep Neural Networks
|
|
Qiu, Liang. - : eScholarship, University of California, 2018
|
|
In: Qiu, Liang. (2018). Non-linguistic Vocalization Recognition Based on Convolutional, Long Short-Term Memory, Deep Neural Networks. UCLA: Electrical Engineering 0303. Retrieved from: http://www.escholarship.org/uc/item/1pz29229 (2018)
|
|
BASE
|
|
Show details
|
|
20 |
Abstract Concepts and Pictures of Real-World Situations Activate One Another.
|
|
|
|
In: Psychology Publications (2018)
|
|
BASE
|
|
Show details
|
|
|
|