langfuse/langfuse
🪢 Open source LLM engineering platform. Observability, metrics, evals, prompt management, testing, prompt playground, datasets, LLM evaluations -- 🍊YC W23 🤖 integrate via Typescript, Python / Decorators, OpenAI, Langchain, LlamaIndex, Litellm, Instructor, Mistral, Perplexity, Claude, Gemini, Vertex
Language:TypeScript
Total stars: 3172
Stars trend:
27 Apr 2024
7am ▏ +1
8am +0
9am ▏ +1
10am ▎ +2
11am █▍ +11
12pm █▎ +10
1pm ▋ +5
2pm █▏ +9
3pm █▋ +13
4pm █▏ +9
5pm ▉ +7
6pm █ +8
#typescript
#analytics, #evaluation, #gpt, #langchain, #largelanguagemodels, #llamaindex, #llm, #llmagent, #llmframework, #llmops, #monitoring, #observability, #opensource, #openai, #playground, #promptengineering, #promptmanagement, #selfhosted, #ycombinator

pezzolabs/pezzo
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
Language:TypeScript
Total stars: 2036
Stars trend:
10 Jul 2024
10pm ▏ +1
11pm +0
11 Jul 2024
12am +0
1am +0
2am ▎ +2
3am ████ +32
4am ██▏ +17
5am ███ +24
#typescript
#ai, #devtools, #gpt3, #gpt4, #hacktoberfest, #javascript, #langchain, #llm, #llmops, #monitoring, #nestjs, #nodejs, #observability, #openai, #platform, #prompt, #promptengineering, #promptmanagement, #python, #typescript

Helicone/helicone
🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23
Language:TypeScript
Total stars: 2410
Stars trend:
20 Dec 2024
9am ▏ +1
10am +0
11am █▍ +11
12pm █▍ +11
1pm █▏ +9
2pm ▉ +7
3pm ▌ +4
4pm █▏ +9
5pm █▏ +9
6pm ▍ +3
7pm ▍ +3
8pm █▏ +9
#typescript
#agentmonitoring, #analytics, #evaluation, #gpt, #langchain, #largelanguagemodels, #llamaindex, #llm, #llmcost, #llmevaluation, #llmobservability, #llmops, #monitoring, #opensource, #openai, #playground, #promptengineering, #promptmanagement, #ycombinator

Agenta-AI/agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Language:Python
Total stars: 2418
Stars trend:
12 Apr 2025
3pm ▎ +2
4pm +0
5pm +0
6pm █▊ +14
7pm █▋ +13
8pm █ +8
9pm ▋ +5
10pm ▉ +7
11pm ▊ +6
13 Apr 2025
12am █ +8
1am █▏ +9
2am ▍ +3
#python
#llmasajudge, #llmevaluation, #llmframework, #llmmonitoring, #llmobservability, #llmplatform, #llmplayground, #llmtools, #llmopsplatform, #promptengineering, #promptmanagement, #ragevaluation