Relative Content

Tag Archive for language-design

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?

Storing tokens during lexing stage

I am currently implementing a lexer that breaks XML files up into tokens, I’m considering ways of passing the tokens onto a parser to create a more useful data structure out of said tokens – my current plan is to store them in an arraylist and pass this to the parser , would a link list where each token points to the next be better suited? Or is being able to access tokens by index easier to make a parser for? Or is this all a terrible strategy?