crawlee crawlee

crawleeapify创建于 8 年前, 最后更新于 16 天前

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript 133.91MB Apache-2.0 Github
Stars
16.9k
Fork
759
Watch
106
Open Issues
157

anything-llm

39.5k JavaScript MIT

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

1 1 年前 13 天前

react-bits

8.1k JavaScript NOASSERTION

An open source collection of animated, interactive & fully customizable React components for building stunning, memorable user interfaces.

1 7 个月前 13 天前

hono

22.6k TypeScript MIT

Web framework built on Web Standards

1 3 年前 14 天前

electron

115.7k C++ MIT

:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS

1 11 年前 6 天前

tiptap

28k TypeScript MIT

The headless rich text editor framework for web artisans.

1 6 年前 15 天前

node-emoji

1.3k TypeScript MIT

💖 simple emoji support for node.js projects

1 10 年前 25 天前

deno

102.1k Rust MIT

A modern runtime for JavaScript and TypeScript.

1 6 年前 7 天前

biome

17.1k Rust Apache-2.0

A toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LSP.

1 1 年前 22 天前

n8n

64.9k TypeScript NOASSERTION

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

1 5 年前 7 天前

xyflow

28.1k TypeScript MIT

React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https://svelteflow.dev). Ready out-of-the-box and infinitely customizable.

1 5 年前 6 天前

micro-agent

3.8k TypeScript MIT

An AI agent that writes (actually useful) code for you

1 9 个月前 11 天前

saas-starter-kit

3.9k TypeScript Apache-2.0

🔥 Enterprise SaaS Starter Kit - Kickstart your enterprise app development with the Next.js SaaS boilerplate 🚀

1 2 年前 1 个月前

automatisch

8.4k JavaScript NOASSERTION

The open source Zapier alternative. Build workflow automation without spending time and money.

1 3 年前 10 天前

Jobs_Applier_AI_Agent_AIHawk

27.5k Python AGPL-3.0

Jobs_Applier_AI_Agent_AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

1 7 个月前 2 天前

MagicMirror

20.7k JavaScript MIT

MagicMirror² is an open source modular smart mirror platform. With a growing list of installable modules, the MagicMirror² allows you to convert your hallway or bathroom mirror into your personal assistant.

1 11 年前 1 个月前

MoneyPrinterTurbo

19.9k Python MIT

利用AI大模型,一键生成高清短视频 Generate short videos with one click using AI LLM.

1 1 年前 1 个月前

plyr

27.4k JavaScript MIT

A simple HTML5, YouTube and Vimeo player

1 10 年前 2 个月前

supermemory

8.7k TypeScript NOASSERTION

Build your own second brain with supermemory. It's a ChatGPT for your bookmarks. Import tweets or save websites and content using the chrome extension.

1 1 年前 13 天前

firecrawl

28.9k TypeScript AGPL-3.0

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

1 11 个月前 7 天前

immich

58.5k TypeScript AGPL-3.0

High performance self-hosted photo and video management solution.

1 3 年前 23 天前