Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English
STREUSLE: a corpus with comprehensive lexical semantic annotation (multiword expressions, supersenses)
Code for NAACL 2019 paper: "Bridging the Gap: Attending to Discontinuity in Identification of Multiword Expressions"
Data for the DiMSUM shared task at SEMEVAL 2016
Comparison between various noun compound embeddings
Python package for exploratory data analysis (EDA) of text data, with LLM integration for to enable interacting with highly complex corpus statistics in natural language.
Data and code for the paper "ID10M: Idiom Identification in 10 Languages" (NAACL 2022).
A set of useful tools for use with multiword expression extraction from parallel corpora for Moses statistical machine translation system
Foma-based multi-word tagger and morphological analyzer
Repo for the paper "MWE as WSD: Solving Multi-Word Expression Identification with Word Sense Disambiguation"
Data and code for the paper "NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity Detection".
A SpaCy MWE identification pipeline component
Rigor-Mortis is an online GWAP where players have to find multiword expressions in French sentences
Adjacent code related to the paper prepared for Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD 2024), 25th May, 2024.
A extended a Bangla single-token entity dataset into a candidate multiword entity annotated corpus.
Evaluation of Google Translate’s handling of English→Arabic multiword expressions using the UN Parallel Corpus.
Java implementation of substitution driven measures of association that can be used to identify MWEs.
MWE Identification in Bioinformatics Research Articles
To associate your repository with the multiword-expressions topic, visit your repo's landing page and select "manage topics."