Sentence examples for a token sequence from inspiring English sources

Will people go for this new proposition to buy a token, sequence their own data and then sell it directly?

Table 11 Example of a token sequence tagged with matches against our affix lists.

Table 10 Example of a token sequence tagged with matches against chemical dictionaries.

The RNN instance is trained to predict either the middle word of a token sequence captured in a window (CBOW) or surrounding words given the middle word of the sequence (skip-gram) depending on the model architecture [17].

If a class token sequence matches a pattern, a corresponding set of actions for that pattern is performed.

A CRF model with HMM-style features as given in Equation (3) is indeed symmetric in the sense that given a pair of input token sequence X and output tag sequence Y and its reversed pair X B and Y B, we have p(Y| X)= p(Y B | X B ).

Each token sequence representing an entry of GeoNames is modeled as a distinct branch of a tree, with its last node accepting.

When the evolving token sequence for a particular record has been tested against all the available patterns, the words in the input string are output into specific fields corresponding to the final class of the tokens associated with each word.

Whenever a domain entity (denoted by the Term element in the XML representation) is found, it is replaced by a 'normalized' version of the token sequence (term normalization involves concatenation of the lowercase version of all tokens into a single token, plus some minor ad-hoc changes that depend on the type of the term).

Then, general checks (like the match of numbers of opening and closing brackets or the pairwise occurrence of ring closures) are performed and finally the token sequence is analysed in a consecutive manner for its syntactic validity.

In this paper, we propose a new similarity detection technique not only based on token sequence matching but also on the factorization of the function call graphs.