®®®® SIIA Público

Título del libro: Figlang 2024 - 4th Workshop On Figurative Language Processing, Proceedings Of The Workshop
Título del capítulo: Evaluating the Development of Linguistic Metaphor Annotation in Mexican Spanish Popular Science Tweets

Autores UNAM:
GEMMA BEL ENGUIX;
Autores externos:

Idioma:

Año de publicación:
2024
Palabras clave:

Inherent complexity; Initial phasis; Machine-learning; Processes stemming; Rigorous methodologies; Computational linguistics


Resumen:

Following previous work on metaphor annotation and automatic metaphor processing, this study presents the evaluation of an initial phase in the novel area of linguistic metaphor detection in Mexican Spanish popular science tweets. Specifically, we examine the challenges posed by the annotation process stemming from disagreement among annotators. During this phase of our work, we conducted the annotation of a corpus comprising 3733 Mexican Spanish popular science tweets. This corpus was divided into two halves and each half was then assigned to two different pairs of native Mexican Spanish-speaking annotators. Despite rigorous methodology and continuous training, inter-annotator agreement as measured by Cohen?s kappa was found to be low, slightly above chance levels, although the concordance percentage exceeded 60%. By elucidating the inherent complexity of metaphor annotation tasks, our evaluation emphasizes the implications of these findings and offers insights for future research in this field, with the aim of creating a robust dataset for machine learning in the future. © 2024 Association for Computational Linguistics.


Entidades citadas de la UNAM: