tijmen/wassembly
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Introduce simple character literal

Browse Source
This commit is contained in:
Tijmen van Nesselrooij
2020-08-28 20:00:49 +02:00
parent d396628310
commit 593506a907
4 changed files with 102 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

17
include/token/tokenizer.hpp
View File

@@ -10,8 +10,21 @@ namespace Token
private:
std::vector<std::pair<std::string, std::string>> substitutions;
Token ExtractToken(std::string string, int const lineNumber, int const lineColumn) const;
void ParseComment(std::string const & string, int const lineNumber, int const lineColumn);
Token ExtractToken(
std::string string,
int const lineNumber,
int const lineColumn) const;
void ParseComment(
std::string const & string,
int const lineNumber,
int const lineColumn);
void ParseCharacterLiteral(
std::string const & line,
int const lineNumber,
unsigned & lineColumn,
std::vector<Token> & tokens) const;
public:
void Tokenize(std::string const & line, int const lineNumber, std::vector<Token> & tokens);