XSLT script for cleaning up ECCO texts TEI P5 conversion
Author: See AUTHORS
Copyright: 2013, TEI Consortium
text nodes are examined to find soft-hyphen characters, which are replaced an empty <g>. To be on the safe side, apply Unicode NFC normalization to text (some decomposed characters seen in headers).
Milestones: convert to label, unless it has no @unit or occurs in some funny places
Previous way of doing milestones: a) if there is no @n, just @unit == marginal note b) if there is no @unit, just a @n, == marginal note, @type='milestone' c) if @unit is from a closed list of words (page, line, folio), it seems editorial, add as subtype on @note d) otherwise, make a label from @unit + @n, and put in a marginal note, @type='milestone'
A Q with just a Q inside it is redundant
A HEAD/@TYPE='sub' can lose itself if it consists of Q with L inside; though if thats all there is, it looks like an epigraph
EEBO-TCP is a partnership between the Universities of Michigan and Oxford and the publisher ProQuest to create accurately transcribed and encoded texts based on the image sets published by ProQuest via their Early English Books Online (EEBO) database (http://eebo.chadwyck.com). The general aim of EEBO-TCP is to encode one copy (usually the first edition) of every monographic English-language title published between 1473 and 1700 available in EEBO.
EEBO-TCP aimed to produce large quantities of textual data within the usual project restraints of time and funding, and therefore chose to create diplomatic transcriptions (as opposed to critical editions) with light-touch, mainly structural encoding based on the Text Encoding Initiative (http://www.tei-c.org).
The EEBO-TCP project was divided into two phases. The 25,363 texts created during Phase 1 of the project have been released into the public domain as of 1 January 2015. Anyone can now take and use these texts for their own purposes, but we respectfully request that due credit and attribution is given to their original source.
Users should be aware of the process of creating the TCP texts, and therefore of any assumptions that can be made about the data.
Text selection was based on the New Cambridge Bibliography of English Literature (NCBEL). If an author (or for an anonymous work, the title) appears in NCBEL, then their works are eligible for inclusion. Selection was intended to range over a wide variety of subject areas, to reflect the true nature of the print record of the period. In general, first editions of a works in English were prioritized, although there are a number of works in other languages, notably Latin and Welsh, included and sometimes a second or later edition of a work was chosen if there was a compelling reason to do so.
Image sets were sent to external keying companies for transcription and basic encoding. Quality assurance was then carried out by editorial teams in Oxford and Michigan. 5% (or 5 pages, whichever is the greater) of each text was proofread for accuracy and those which did not meet QA standards were returned to the keyers to be redone. After proofreading, the encoding was enhanced and/or corrected and characters marked as illegible were corrected where possible up to a limit of 100 instances per text. Any remaining illegibles were encoded as <gap>s. Understanding these processes should make clear that, while the overall quality of TCP data is very good, some errors will remain and some readable characters will be marked as illegible. Users should bear in mind that in all likelihood such instances will never have been looked at by a TCP editor.
The texts were encoded and linked to page images in accordance with level 4 of the TEI in Libraries guidelines.
Copies of the texts have been issued variously as SGML (TCP schema; ASCII text with mnemonic sdata character entities); displayable XML (TCP schema; characters represented either as UTF-8 Unicode or text strings within braces); or lossless XML (TEI P5, characters represented either as UTF-8 Unicode or TEI g elements).
Keying and markup guidelines are available at the Text Creation Partnership web site.
@PLACE has both inconsistencies and mistakes; some values should obviously be @n
You sometimes find a milestone inside a marginal note, where the note has the same value for @type as the milestone has for unit. Kill the @type on note in this situation.
a note following by a closer as content of body? please, wrap it in a p
Figures inside paragraphs can generally be free-standing, unless they are the only paragraph of this type (ie inside a div consisting only of pictures).
Process pointing attributes, which may me full URLs or not, and may contain multiple values.
Created by converting TCP files to TEI P5 using tcp2tei.xsl, TEI @ Oxford.
unknown
If we have made some @role into @ana, we need taxonomy elements to point to
zap empty postscript
The subtype attribute cant have spaces
The facs attribute should not have spaces or square brackets in
A p with list, floatingText or table as singletons can lose itself
A singleton p inside a note is bypassed
A singleton floatingText inside a q can skip the q
A singleton p inside a cell is bypassed
p inside add means we must make an addSpan
a paragraph containing add and nothing else, where those adds themselves contains paragraphs, can be bypassed
a list inside a label in a gloss list will have to turn into a table
a list inside a label in a gloss list (alternate way of doing gloss lists) will have to turn into a table
a singleton label inside a paragraph, containing a list, can be ignored.
This keyboarded and encoded edition of the work described above is co-owned by the institutions providing financial support to the Early English Books Online Text Creation Partnership. Searching, reading, printing, or downloading EEBO-TCP texts is reserved for the authorized users of these project partner institutions. Permission must be granted for subsequent distribution, in print or electronically, of this EEBO-TCP Phase II text, in whole or in part.
This keyboarded and encoded edition of the work described above is co-owned by the institutions providing financial support to the Early English Books Online Text Creation Partnership. This Phase I text is available for reuse, according to the terms of Creative Commons 0 1.0 Universal. The text can be copied, modified, distributed and performed, even for commercial purposes, all without asking permission.