Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: llama2

found 43 packages in 2ms

@lenml/tokenizers16.5kApache-2.03.7.2

a lightweight no-dependency fork of transformers.js (only tokenizers)

lenMLabout 2 months agollama, llama2, llama3, chatgpt

npmGitHub

@lenml/llama2-tokenizer5.5kMIT1.1.4

Our library @lenml/llama2-tokenizer has been deprecated. We are excited to introduce our new library @lenml/tokenizers as its replacement, offering a broader set of features and an enhanced experience.

lenMLover 1 year agollama, llama2, chatgpt, mistral

npmGitHub

@lenml/llama2-tokenizer-vocab-llama25.2kMIT1.1.1

lenMLover 1 year agollama, llama2, chatgpt, mistral

npmGitHub

@lenml/tokenizer-claude4.7kApache-2.03.7.2

claude tokenizer for NodeJS/Browser

lenMLabout 2 months agollama, llama2, llama3, chatgpt

npmGitHub

@lenml/tokenizer-gemini3.3kApache-2.03.7.2

gemini tokenizer for NodeJS/Browser

lenMLabout 2 months agollama, llama2, llama3, chatgpt

npmGitHub

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const