Why #Lexing and #Parsing Should Be Separate
"Summary: Do the easy thing with the fast algorithm, and the hard thing with the slow algorithm. Lexing and parsing are different things."
https://github.com/oils-for-unix/oils/wiki/Why-Lexing-and-Parsing-Should-Be-Separate
Love 😍 such articles that cover a topic in depth:
“Modern Perfect Hashing For Strings” [2023], Wojciech Muła (http://0x80.pl/notesen/2023-04-30-lookup-in-strings.html).
On HN: https://news.ycombinator.com/item?id=35764176
#Hashing #PerfectHashing #Lexing #LexicalAnalysis #Programming #Algorithms #Trie #gperf #Tokenization
Mini-rust in Rust 005: Our lexer should be an iterator
Mini-rust in Rust 004: Refactoring our lexer
https://video.infosec.exchange/videos/watch/c15ce6a7-b800-4e7f-bc1c-d75d5a2431d8
Mini-rust in Rust 003: Much prettier errors
https://video.infosec.exchange/videos/watch/835f01a4-c74d-4e96-8cb6-ee888537b138
Mini-rust in Rust 002: Errors while lexing
https://video.infosec.exchange/videos/watch/078d563a-765f-4720-a14e-2589ac54a867
Mini-rust in Rust 001: Lexing an int
How to Train Your Scrappy Programmer devotes an entire chapter to parsing. Every programmer needs to parse inputs. Learn four different techniques for cracking open even the hardest content.
https://voyagesincode.com/products/the-wild-world-of-parsing
1. Writing a programming language - the Lexer
A long time #classic #tutorial that’s a little too heavy on the #lexing & #parsing parts of a #compiler:
“Let’s Build A Compiler” [1988], Jack Crenshaw (https://compilers.iecc.com/crenshaw/).
On HN: https://news.ycombinator.com/item?id=38773049 & https://news.ycombinator.com/item?id=38779776
Wonderful:
"Why Split Lexing And Parsing Into Two Separate Phases?", Laurence Tratt (https://tratt.net/laurie/blog/2023/why_split_lexing_and_parsing_into_two_separate_phases.html).
Via HN: https://news.ycombinator.com/item?id=35798829
#Lexing #Parsing #RegEx #RegularExpressions #Compilers #Interpreters #Lex #Yacc #grmtools #Rust #Programming #Grammar
1. Writing a programming language - the Lexer
https://diode.zone/videos/watch/4adcc2f9-ff0a-42ca-903c-97ebb0a478e8
(1) Writing a programming language - the Lexer https://peertube.mastodon.host/videos/watch/b22c04d2-528d-471e-8acf-ed5e2ebb2b14
