Sentence examples for be segmented into words from inspiring English sources

Further, the straight text-lines must be segmented into words or characters before going for recognition process.

The Language Corpus System of Modern Chinese Study (LCSMCS) word frequencies, based on a corpus of 20 million characters of which 2 million have been segmented into words and assigned their parts-of-speech (PoS) [8]; available at http://www.dwhyyjzx.com/cgi-bin/yuliao/, checked on September 24 , 2009.

The original data are preprocessed by removing unnecessary data such as extraneous tags and duplicated sentences, and then normalizing to suitable forms for reading as described in Section 3. Next, these data are segmented into word sequences by CRF-based word segmentation, and afterwards the stylistic text classifications are applied.

To meet the requirement of BioCreative 2 challenge, we modified the Genia Tagger slightly so that punctuation symbols within words would be segmented into separated tokens.

As a letter in Thai is a phonogram which roughly represents a phoneme or combination of phonemes, Thai word could be segmented into a sequence of syllable-like units.

An agglutinating language (e.g., Turkish) is one in which the word forms can be segmented into morphs, each of which represents a single grammatical category.

These forms have been segmented into 115,320 words stored in separate files.

An Arabic text line is segmented into words/sub-words and dots are extracted.

The same text is segmented into a sequence of words in (a) and a sequence of PMs in (b).

Next, the less frequent words are segmented into PMs.

In the first pass, words are segmented into easily separable characters/composite characters.