Category Archives: Research

Probabilistic German Morphosyntax (Habilitation)

Probabilistic German Morphosyntax is a sequence of five papers for my kumulative Habilitation (second thesis in the German/Austrian system, cumulative version). As of November 2017, three have been published, one accepted (with revisions), and one is still in preparation (to be submitted still in 2017). The papers will be edited into a book.

  1. Roland Schäfer & Elizabeth Pankratz (in preparation) Function and interpretability of compound linking elements in German.
  2. Roland Schäfer (2017 accepted with revisionsCompeting Constructions for German Measure Noun Phrases: from Usage Data to Experiment.
  3. Roland Schäfer & Ulrike Sayatz (2016) Punctuation and Syntactic Structure in “obwohl” and “weil” Clauses in Nonstandard Written German. Written Language and Literacy (WLL) 19:2, 215–248.
  4. Roland Schäfer (2016 ahead of print) Prototype-driven Alternations: The Case of German Weak Nouns. Corpus Linguistics and Linguistic Theory (CLLT).
  5. Roland Schäfer & Ulrike Sayatz (2014) Die Kurzformen des Indefinitartikels im Deutschen (Cliticization of the Indefinite Article in German). Zeitschrift für Sprachwissenschaft (ZS) 33(2).

ClaraX random walk crawler

Currently bundled with texrex on GitHub. 

ClaraX (funded by the German Research Council through grant SCHA1916/1-1 Linguistic web characterization) is the companion of the planned (but delayed) HeidiX (Heidi is a crawler system) software. It performs parametrized random walk crawls in the web graph and integrates full texrex‘s web page cleaning functionality. It is purely experimental in the sense that it is designed to conduct experiments and fundamental research. It is in no way suitable for large-scale productive crawling. It is released under a permissive 2-clause BSD license.

Linguistic web characterization and web corpus creation (DFG)

Work on this project at Freie Universität Berlin, German Grammar GroupGerman and Dutch Philology, is supported by the German Research Council (Deutsche Forschungsgemeinschaft, DFG) grant SCHA1916/1-1.

Project leader: Roland Schäfer

Funding amount: 286,100€

Runtime: January 2015 – June 2018 (interrupted April–September 2016)

Student assistants:

  • Kim Maser, Humboldt-Universität Berlin (2015–2017)
  • Luise Rißmann, Freie Universität Berlin (2015–)

Officially collaborating institutions:

Continue reading

Colibri² corpus portal

Because none of the available web interfaces to the IMS Open Corpus Workbench was right for hosting the COW web corpora, I started working on a bespoke interface called Colibri². It is really a spare-time project, and I do not release the code because I consider it trivialware.

Continue reading

COW web corpus initiative

COW (COrpora from the Web) is a collection of linguistically processed gigatoken web corpora. We have corpora in major European languages (Dutch, English, French, German, Spanish, Swedish). Currently, the corpora are between 1 billion and 10 billion tokens large. The third-generation corpora COW2014 are all larger than their predecessors, some containing 10 billion tokens or more. We are also focusing on corpus quality in all areas (data collection as well as post-processing and linguistic annotation), not just larger corpus sizes. To avoid legal problems with copyright claims, the published corpora are sentence shuffles.

Please go to the web page of COW (Corpoa from the Web).