crawlee crawlee

crawlee was created by apify 8 year(s) ago, and last updated 6 day(s) ago.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript 136.11MB Apache-2.0 Github
Stars
17.1k
Fork
766
Watch
108
Open Issues
158

huginn

45.2k Ruby MIT

Create agents that monitor and act on your behalf. Your agents are standing by!

1 12 year(s) ago 4 day(s) ago

anything-llm

39.5k JavaScript MIT

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

1 1 year(s) ago 19 day(s) ago

react-bits

9.1k JavaScript NOASSERTION

An open source collection of animated, interactive & fully customizable React components for building stunning, memorable user interfaces.

1 7 month(s) ago 3 day(s) ago

hono

22.9k TypeScript MIT

Web framework built on Web Standards

1 3 year(s) ago 4 day(s) ago

electron

115.9k C++ MIT

:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS

1 11 year(s) ago 4 day(s) ago

tiptap

28k TypeScript MIT

The headless rich text editor framework for web artisans.

1 6 year(s) ago 21 day(s) ago

node-emoji

1.3k TypeScript MIT

💖 simple emoji support for node.js projects

1 10 year(s) ago 1 month(s) ago

deno

102.1k Rust MIT

A modern runtime for JavaScript and TypeScript.

1 6 year(s) ago 13 day(s) ago

biome

17.1k Rust Apache-2.0

A toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LSP.

1 1 year(s) ago 28 day(s) ago

n8n

67.3k TypeScript NOASSERTION

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

1 5 year(s) ago 5 day(s) ago

xyflow

28.3k TypeScript MIT

React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https://svelteflow.dev). Ready out-of-the-box and infinitely customizable.

1 5 year(s) ago 4 day(s) ago

micro-agent

3.8k TypeScript MIT

An AI agent that writes (actually useful) code for you

1 10 month(s) ago 17 day(s) ago

saas-starter-kit

3.9k TypeScript Apache-2.0

🔥 Enterprise SaaS Starter Kit - Kickstart your enterprise app development with the Next.js SaaS boilerplate 🚀

1 2 year(s) ago 1 month(s) ago

automatisch

8.5k JavaScript NOASSERTION

The open source Zapier alternative. Build workflow automation without spending time and money.

1 3 year(s) ago 1 day(s) ago

Jobs_Applier_AI_Agent_AIHawk

27.5k Python AGPL-3.0

Jobs_Applier_AI_Agent_AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

1 7 month(s) ago 8 day(s) ago

MagicMirror

20.7k JavaScript MIT

MagicMirror² is an open source modular smart mirror platform. With a growing list of installable modules, the MagicMirror² allows you to convert your hallway or bathroom mirror into your personal assistant.

1 11 year(s) ago 2 month(s) ago

MoneyPrinterTurbo

19.9k Python MIT

利用AI大模型,一键生成高清短视频 Generate short videos with one click using AI LLM.

1 1 year(s) ago 2 month(s) ago

plyr

27.4k JavaScript MIT

A simple HTML5, YouTube and Vimeo player

1 10 year(s) ago 2 month(s) ago

supermemory

8.7k TypeScript NOASSERTION

Build your own second brain with supermemory. It's a ChatGPT for your bookmarks. Import tweets or save websites and content using the chrome extension.

1 1 year(s) ago 19 day(s) ago

firecrawl

31.1k TypeScript AGPL-3.0

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

1 11 month(s) ago 5 day(s) ago