Learn Before
Tokenizing Source Code: Classifying Keywords and Operators in Pygments @ University of Michigan - Ann Arbor
Learners will explore the core mechanics of syntax highlighting by building and refining custom lexers with Python and the Pygments library. Through practical Python examples, you will learn how regular expressions break raw source code into tokens and accurately map them to distinct keyword and operator categories. By the end of the course, you will understand how to distinguish language constructs reliably and handle common tokenization edge cases.
0
1
Tags
Prep Sessions
Related
Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Foundational Deep Learning Architectures: Transformers and Residual Networks @ University of Michigan - Ann Arbor
Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor
Overcoming Neural Network Degradation Through Residual Learning @ University of Michigan - Ann Arbor
Frontier Model Dynamics: Scaling Laws, Calibration, and Post-Training Alignment @ University of Michigan - Ann Arbor
Frontier Foundation Models, Capability Evaluation, and Just-In-Time Agent Harnesses @ University of Michigan - Ann Arbor
Engineering State-Bound Execution Runtimes for Autonomous Agents @ University of Michigan - Ann Arbor
The Aqueous Continuum: Biomolecular Solvation and Planetary Dynamics @ Honor
Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor
Evidence Before Action — AI Tutor Demo @ Honor
AI Agent Oversight: Scoping, Output Interrogation, and Decision Control @ Honor
AI Agent Oversight: Task Delegation, Output Auditing, and Accountability @ Honor
Supervising AI Agents: Decision Rights, Verification, and Accountability @ Honor
Engineering Deterministic Runtimes and Verification for Autonomous Agents @ University of Michigan - Ann Arbor
Making Recommendations Leaders Can Act On @ Honor
Making Recommendations Leaders Can Act On @ Honor (Iman YeckehZaare)
Runtime Verification and Failure Mitigation in Autonomous Agent Workflows @ University of Michigan - Ann Arbor
Adaptive Agent Runtimes: Architecture, Synthesis, and State Control @ University of Michigan - Ann Arbor
Autonomous Agent Control Planes: State Scaffolding and Resilient Execution @ University of Michigan - Ann Arbor
From Photons to Glucose: Bioenergetics of Light Energy Conversion @ University of Michigan - Ann Arbor
Biological Energy Transformation: From Sunlight to Chemical Storage @ University of Michigan - Ann Arbor
Beyond Status Updates: A Framework for High-Trust One-on-Ones @ University of Michigan - Ann Arbor
Dynamic Agent Scaffolding: Synthesis, Diagnostic Repair, and Evolutionary Optimization @ University of Michigan - Ann Arbor
Synthetic recommendation evaluation October 4 @ Honor
Synthetic grading retest October 4 @ Honor
Home Composting Fundamentals for Backyard Gardeners @ University of Michigan - Ann Arbor
Making Recommendations Leaders Can Act On — October 7 Demo @ Honor
Custom Pygments Lexer Engineering for Magma @ University of Michigan - Ann Arbor
Tokenizing Source Code: Classifying Keywords and Operators in Pygments @ University of Michigan - Ann Arbor