Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: tokenizer

found 525 packages in 5ms

js-tokens262.4mMIT9.0.1

Tiny JavaScript tokenizer.

lydell5 months agoJavaScript, js, ECMAScript, es

npmGitHub

css-tree147.1mMIT3.1.0

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

csstree5 months agocss, ast, tokenizer, parser

npmGitHub

micromark48.6mMIT4.0.2

small commonmark compliant markdown parser with positional info and concrete tokens

micromarkabout 2 months agocommonmark, compiler, gfm, html

npmGitHub

strtok327.5mMIT10.2.2

A promise based streaming tokenizer

Borewitabout 1 month agotokenizer, reader, token, async

npmGitHub

ret71.9mMIT0.5.0

Tokenizes a string that represents a regular expression.

fentabout 2 years agoregex, regexp, regular expression, parser

npmGitHub

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const