LibreOffice Module comphelper (master) 1
Public Member Functions | Public Attributes | Private Member Functions | Private Attributes | List of all members
SyntaxHighlighter::Tokenizer Class Reference

Public Member Functions

 Tokenizer (HighlighterLanguage aLang)
void getHighlightPortions (std::u16string_view rLine, std::vector< HighlightPortion > &portions) const
void setKeyWords (const char **ppKeyWords, sal_uInt16 nCount)

Public Attributes

HighlighterLanguage const aLanguage

Private Member Functions

bool testCharFlags (sal_Unicode c, CharFlags nTestFlags) const
bool getNextToken (std::u16string_view::const_iterator &pos, std::u16string_view::const_iterator end, TokenType &reType, std::u16string_view::const_iterator &rpStartPos, std::u16string_view::const_iterator &rpEndPos) const

Private Attributes

CharFlags aCharTypeTab [256] = {}
const char ** ppListKeyWords
sal_uInt16 nKeyWordCount

Detailed Description

Definition at line 273 of file syntaxhighlight.cxx.

Constructor & Destructor Documentation

◆ Tokenizer()

SyntaxHighlighter::Tokenizer::Tokenizer ( HighlighterLanguage  aLang)

Definition at line 610 of file syntaxhighlight.cxx.

References aCharTypeTab, i, nKeyWordCount, and ppListKeyWords.

Member Function Documentation

◆ getHighlightPortions()

void SyntaxHighlighter::Tokenizer::getHighlightPortions ( std::u16string_view  rLine,
std::vector< HighlightPortion > &  portions 
) const

Definition at line 689 of file syntaxhighlight.cxx.

References eType, and pos.

◆ getNextToken()

bool SyntaxHighlighter::Tokenizer::getNextToken ( std::u16string_view::const_iterator &  pos,
std::u16string_view::const_iterator  end,
TokenType reType,
std::u16string_view::const_iterator &  rpStartPos,
std::u16string_view::const_iterator &  rpEndPos 
) const

◆ setKeyWords()

void SyntaxHighlighter::Tokenizer::setKeyWords ( const char **  ppKeyWords,
sal_uInt16  nCount 

Definition at line 314 of file syntaxhighlight.cxx.

References nCount.

◆ testCharFlags()

bool SyntaxHighlighter::Tokenizer::testCharFlags ( sal_Unicode  c,
CharFlags  nTestFlags 
) const

Definition at line 299 of file syntaxhighlight.cxx.

References aCharTypeTab, and isAlpha().

Member Data Documentation

◆ aCharTypeTab

CharFlags SyntaxHighlighter::Tokenizer::aCharTypeTab[256] = {}

Definition at line 276 of file syntaxhighlight.cxx.

Referenced by testCharFlags(), and Tokenizer().

◆ aLanguage

HighlighterLanguage const SyntaxHighlighter::Tokenizer::aLanguage

Definition at line 289 of file syntaxhighlight.cxx.

◆ nKeyWordCount

sal_uInt16 SyntaxHighlighter::Tokenizer::nKeyWordCount

Definition at line 286 of file syntaxhighlight.cxx.

Referenced by Tokenizer().

◆ ppListKeyWords

const char** SyntaxHighlighter::Tokenizer::ppListKeyWords

Definition at line 285 of file syntaxhighlight.cxx.

Referenced by Tokenizer().

The documentation for this class was generated from the following file: