crawlee crawlee

crawlee was created by apify 10 year(s) ago, and last updated 3 day(s) ago.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript 171.53MB Apache-2.0 Github
Stars
25.9k
Fork
1.7k
Watch
136
Open Issues
135

katana

17.6k Go MIT

A next-generation crawling and spidering framework.

1 5 year(s) ago 4 day(s) ago

social-analyzer

24.1k JavaScript AGPL-3.0

API, CLI, and Web App for analyzing and finding a person's profile in 1000 social media \ websites

1 5 year(s) ago 4 day(s) ago

agents

20.1k Python MIT

Intelligent automation and multi-agent orchestration for Claude Code

1 1 year(s) ago 10 month(s) ago

magicui

18.3k MDX MIT

UI Library for Design Engineers. Animated components and effects you can copy and paste into your apps. Free. Open Source.

1 3 year(s) ago 1 year(s) ago

onlook

26.8k TypeScript Apache-2.0

The Cursor for Designers • An Open-Source AI-First Design tool • Visually build, style, and edit your React App with AI

1 2 year(s) ago 4 day(s) ago

AingDesk

2.3k TypeScript MIT

AingDesk是一款简单好用的AI助手,支持知识库、模型API、分享、联网搜索、智能体,它还在飞快成长中。 AingDesk is a simple and easy-to-use AI assistant that supports knowledge bases, model APIs, sharing, internet search, and intelligent agents. It is still growing rapidly.

1 1 year(s) ago 1 year(s) ago

huginn

47.9k Ruby MIT

Create agents that monitor and act on your behalf. Your agents are standing by!

1 13 year(s) ago 10 month(s) ago

anything-llm

46.9k JavaScript MIT

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

1 3 year(s) ago 1 year(s) ago

react-bits

21.4k JavaScript NOASSERTION

An open source collection of animated, interactive & fully customizable React components for building stunning, memorable websites.

1 2 year(s) ago 1 year(s) ago

hono

25.3k TypeScript MIT

Web framework built on Web Standards

1 4 year(s) ago 1 year(s) ago

electron

119k C++ MIT

:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS

1 13 year(s) ago 10 month(s) ago

tiptap

31k TypeScript MIT

The headless rich text editor framework for web artisans.

1 8 year(s) ago 1 year(s) ago

node-emoji

1.3k TypeScript MIT

💖 simple emoji support for node.js projects

1 12 year(s) ago 1 year(s) ago

deno

103.1k Rust MIT

A modern runtime for JavaScript and TypeScript.

1 8 year(s) ago 1 year(s) ago

biome

22.1k Rust Apache-2.0

A toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LSP.

1 3 year(s) ago 10 month(s) ago

n8n

155.1k TypeScript NOASSERTION

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

1 7 year(s) ago 10 month(s) ago

browser-use

66.3k Python MIT

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

1 1 year(s) ago 1 year(s) ago

xyflow

30.9k TypeScript MIT

React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https://svelteflow.dev). Ready out-of-the-box and infinitely customizable.

1 7 year(s) ago 1 year(s) ago

micro-agent

4.2k TypeScript MIT

An AI agent that writes (actually useful) code for you

1 2 year(s) ago 10 month(s) ago

saas-starter-kit

4.5k TypeScript Apache-2.0

🔥 Enterprise SaaS Starter Kit - Kickstart your enterprise app development with the Next.js SaaS boilerplate 🚀

1 4 year(s) ago 10 month(s) ago