Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: crawling

found 181 packages in 7ms

@crawlee/utils201.3kApache-2.03.13.8

A set of shared utilities that can be used by crawlers

apifyabout 1 hour agoapify, crawlers, crawling, utilities

npmGitHubHomepage

notion-md-crawler114.2kMIT1.0.1

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

TomPenguin5 months agonotion, crawler, crawling, serialization

npmGitHub

@hyperbrowser/sdk32.5kMIT0.51.0

Node SDK for Hyperbrowser API

leoscope13 days agohyperbrowser, browser, automation, webscraping

npm

crawlbase5.5kApache-2.01.0.2

Dependency free module for scraping and crawling websites using Crawlbase API

crawlbase-sourceabout 1 year agoscraping, crawling, scraper, scrape

npmGitHub

rebrowser-patches2.2kMIT1.0.19

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.

rebrowserabout 2 months agoautomation, bot, bot-detection, crawler

npmGitHubHomepage

Packages

debug-js debug

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

lodash lodash

Lodash modular utilities.

modules, stdlib, util

facebook react

React is a JavaScript library for building user interfaces.

react

ljharb qs

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

caolan async

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const