vllm vllm

vllmvllm-project创建于 2 年前, 最后更新于 1 个月前

A high-throughput and memory-efficient inference and serving engine for LLMs
Python 29.89MB Apache-2.0 Github
Stars
33.9k
Fork
5.2k
Watch
280
Open Issues
1.7k

Chat2DB

19.4k Java Apache-2.0

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

1 1 年前 13 天前

anything-llm

39.5k JavaScript MIT

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

1 1 年前 13 天前

deep-research

13.5k TypeScript MIT

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

1 1 个月前 13 天前

cherry-studio

16.9k TypeScript NOASSERTION

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers. Support deepseek-r1

1 9 个月前 14 天前

chatbox

31.3k TypeScript GPL-3.0

User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)

1 2 年前 22 天前

vectordb-recipes

700 Jupyter Notebook Apache-2.0

High quality resources & applications for LLMs, multi-modal models and VectorDBs

1 1 年前 15 天前

code-review-gpt

1.8k TypeScript MIT

Code review powered by LLMs (OpenAI GPT4, Sonnet 3.5) & Embeddings ⚡️ Improve code quality and catch bugs before you break production 🚀 Lives in your Github/GitLab/Azure DevOps CI

1 1 年前 23 天前

langui

2.8k HTML MIT

UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.

1 1 年前 2 天前

browser-use

25.4k Python MIT

Make websites accessible for AI agents

1 4 个月前 1 个月前

ragflow

44.2k TypeScript Apache-2.0

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

1 1 年前 1 天前

LocalAI

30k Go MIT

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

1 1 年前 2 天前

khoj

26.6k Python AGPL-3.0

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

1 3 年前 2 天前

code2prompt

5k Rust MIT

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

1 1 年前 2 天前

scuda

1.6k C++ Apache-2.0

SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

1 6 个月前 19 天前

Jobs_Applier_AI_Agent_AIHawk

27.5k Python AGPL-3.0

Jobs_Applier_AI_Agent_AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

1 7 个月前 2 天前

ultravox

3.7k Python MIT

A fast multimodal LLM for real-time voice

1 9 个月前 10 天前

firecrawl

28.9k TypeScript AGPL-3.0

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

1 11 个月前 7 天前

WrenAI

6.9k TypeScript AGPL-3.0

🤖 Open-source GenBI AI Agent that empowers data-driven teams to chat with their data to generate Text-to-SQL, charts, spreadsheets, reports, and BI. 📈📊📋🧑‍💻

1 1 年前 4 天前

jan

27.9k TypeScript AGPL-3.0

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

1 1 年前 7 天前

DeepSeek-V3

25.3k Python MIT

1 2 个月前 1 个月前