vllm vllm

vllm was created by vllm-project 2 year(s) ago, and last updated 7 day(s) ago.

A high-throughput and memory-efficient inference and serving engine for LLMs
Python 48.25MB Apache-2.0 Github
Stars
46.4k
Fork
7.2k
Watch
383
Open Issues
2.4k

AingDesk

1.4k TypeScript MIT

AingDesk是一款简单好用的AI助手,支持知识库、模型API、分享、联网搜索、智能体,它还在飞快成长中。 AingDesk is a simple and easy-to-use AI assistant that supports knowledge bases, model APIs, sharing, internet search, and intelligent agents. It is still growing rapidly.

1 2 month(s) ago 18 day(s) ago

Real-ESRGAN

30.8k Python BSD-3-Clause

Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

1 3 year(s) ago 5 day(s) ago

weaviate

13.2k Go BSD-3-Clause

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

1 9 year(s) ago 13 day(s) ago

Chat2DB

22.7k Java Apache-2.0

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

1 1 year(s) ago 5 day(s) ago

anything-llm

43.6k JavaScript MIT

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

1 1 year(s) ago 5 day(s) ago

deep-research

14.6k TypeScript MIT

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

1 3 month(s) ago 1 month(s) ago

cherry-studio

24.7k TypeScript NOASSERTION

🍒 Cherry Studio is a desktop client that supports for multiple LLM providers.

1 11 month(s) ago 14 day(s) ago

chatbox

34.2k TypeScript GPL-3.0

User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)

1 2 year(s) ago 22 day(s) ago

vectordb-recipes

758 Jupyter Notebook Apache-2.0

High quality resources & applications for LLMs, multi-modal models and VectorDBs

1 1 year(s) ago 6 day(s) ago

DeepClaude

2.5k Python

Unleash Next-Level AI! 🚀 💻 Code Generation: DeepSeek r1 + Claude 3.7 Sonnet - Unparalleled Performance! 📝 Content Creation: DeepSeek r1 + Gemini 2.5 Pro - Superior Quality! 🔌 OpenAI-Compatible. 🌊 Streaming & Non-Streaming Support. ✨ Experience the Future of AI – Today! Click to Try Now! ✨

1 3 month(s) ago 23 day(s) ago

code-review-gpt

1k TypeScript MIT

Code review powered by LLMs (OpenAI GPT4, Sonnet 3.5) & Embeddings ⚡️ Improve code quality and catch bugs before you break production 🚀 Lives in your Github/GitLab/Azure DevOps CI

1 1 year(s) ago 23 day(s) ago

langui

2.9k HTML MIT

UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.

1 1 year(s) ago 3 day(s) ago

browser-use

58.5k Python MIT

Make websites accessible for AI agents

1 6 month(s) ago 9 day(s) ago

ragflow

49.8k TypeScript Apache-2.0

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

1 1 year(s) ago 17 day(s) ago

LocalAI

32.4k Go MIT

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

1 2 year(s) ago 2 day(s) ago

xiaozhi-esp32

12.1k C++ MIT

Build your own AI friend

1 8 month(s) ago 10 day(s) ago

khoj

28.8k Python AGPL-3.0

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

1 3 year(s) ago 18 day(s) ago

code2prompt

5.5k MDX MIT

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

1 1 year(s) ago 18 day(s) ago

scuda

1.7k C++ Apache-2.0

SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

1 8 month(s) ago 12 day(s) ago

Jobs_Applier_AI_Agent_AIHawk

28.1k Python AGPL-3.0

AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

1 9 month(s) ago 2 day(s) ago