SyntaxHighlighter::Tokenizer Class Reference

Public Member Functions
	Tokenizer (HighlighterLanguage aLang)
void	getHighlightPortions (std::u16string_view rLine, std::vector< HighlightPortion > &portions) const
void	setKeyWords (const char **ppKeyWords, sal_uInt16 nCount)

Public Attributes
HighlighterLanguage const	aLanguage

Private Member Functions
bool	testCharFlags (sal_Unicode c, CharFlags nTestFlags) const
bool	getNextToken (std::u16string_view::const_iterator &pos, std::u16string_view::const_iterator end, TokenType &reType, std::u16string_view::const_iterator &rpStartPos, std::u16string_view::const_iterator &rpEndPos) const

Private Attributes
CharFlags	aCharTypeTab [256] = {}
const char **	ppListKeyWords
sal_uInt16	nKeyWordCount

Detailed Description

Definition at line 273 of file syntaxhighlight.cxx.

Constructor & Destructor Documentation

Tokenizer()

SyntaxHighlighter::Tokenizer::Tokenizer ( HighlighterLanguage  aLang )

explicit

Definition at line 610 of file syntaxhighlight.cxx.

References aCharTypeTab, i, nKeyWordCount, and ppListKeyWords.

Member Function Documentation

getHighlightPortions()

void SyntaxHighlighter::Tokenizer::getHighlightPortions	(	std::u16string_view	rLine,
		std::vector< HighlightPortion > &	portions
	)		const

Definition at line 689 of file syntaxhighlight.cxx.

References eType, and pos.

getNextToken()

bool SyntaxHighlighter::Tokenizer::getNextToken ( std::u16string_view::const_iterator &  pos, std::u16string_view::const_iterator  end, TokenType &  reType, std::u16string_view::const_iterator &  rpStartPos, std::u16string_view::const_iterator &  rpEndPos  ) const

private

Definition at line 320 of file syntaxhighlight.cxx.

References Basic, Comment, compare_strings(), end, EOL, Error, i, Identifier, isAlpha(), Keywords, nCount, Number, Operator, OUStringToOString(), Parameter, pos, SQL, String, Unknown, and Whitespace.

setKeyWords()

void SyntaxHighlighter::Tokenizer::setKeyWords	(	const char **	ppKeyWords,
		sal_uInt16	nCount
	)

Definition at line 314 of file syntaxhighlight.cxx.

References nCount.

testCharFlags()

bool SyntaxHighlighter::Tokenizer::testCharFlags ( sal_Unicode  c, CharFlags  nTestFlags  ) const

private

Definition at line 299 of file syntaxhighlight.cxx.

References aCharTypeTab, and isAlpha().

Member Data Documentation

aCharTypeTab

CharFlags SyntaxHighlighter::Tokenizer::aCharTypeTab[256] = {}

private

Definition at line 276 of file syntaxhighlight.cxx.

Referenced by testCharFlags(), and Tokenizer().

aLanguage

HighlighterLanguage const SyntaxHighlighter::Tokenizer::aLanguage

Definition at line 289 of file syntaxhighlight.cxx.

nKeyWordCount

sal_uInt16 SyntaxHighlighter::Tokenizer::nKeyWordCount

private

Definition at line 286 of file syntaxhighlight.cxx.

Referenced by Tokenizer().

ppListKeyWords

const char** SyntaxHighlighter::Tokenizer::ppListKeyWords

private

Definition at line 285 of file syntaxhighlight.cxx.

Referenced by Tokenizer().

---

The documentation for this class was generated from the following file:

• syntaxhighlight.cxx