Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: tokenizer

found 546 packages in 12ms

js-tokens270.7mMIT9.0.1

Tiny JavaScript tokenizer.

lydell7 months agoJavaScript, js, ECMAScript, es

npmGitHub

css-tree151mMIT3.1.0

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

csstree6 months agocss, ast, tokenizer, parser

npmGitHub

micromark49.5mMIT4.0.2

small commonmark compliant markdown parser with positional info and concrete tokens

micromark4 months agocommonmark, compiler, gfm, html

npmGitHub

strtok332.4mMIT10.3.1

A promise based streaming tokenizer

Borewit7 days agotokenizer, reader, token, async

npmGitHub

ret69.3mMIT0.5.0

Tokenizes a string that represents a regular expression.

fentabout 2 years agoregex, regexp, regular expression, parser

npmGitHub

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const