InftyAI

All

13 repositories

llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes huggingface llm modelscope llamacpp vllm llm-inference text-generation-inference sglang
Go
•
Apache License 2.0
•10•35•42•0•Updated Dec 26, 2024Dec 26, 2024
Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome
9•33•0•0•Updated Dec 16, 2024Dec 16, 2024
Manta
Public
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•2•13•13•1•Updated Dec 6, 2024Dec 6, 2024
llmboard
Public
ChatUI for LLMs on llmaz.
dashboard llm llmops
Python
•
Apache License 2.0
•5•3•1•0•Updated Nov 18, 2024Nov 18, 2024
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3 gcs minio object-store
Python
•
MIT License
•2•2•3•0•Updated Nov 11, 2024Nov 11, 2024
scheduler-plugins
Public
Scheduler plugins designed for smart scheduling with llmaz.
Go
•1•3•0•0•Updated Oct 28, 2024Oct 28, 2024
.github
Public
1•0•0•0•Updated Oct 23, 2024Oct 23, 2024
community
Public
The InftyAI community.
Apache License 2.0
•1•0•0•0•Updated Oct 23, 2024Oct 23, 2024
website
Public
Website and Blogs.
blog website
HTML
•
MIT License
•1•1•2•0•Updated Sep 23, 2024Sep 23, 2024
template-repo
Public
A template repo.
Apache License 2.0
•1•0•0•0•Updated Sep 18, 2024Sep 18, 2024
llmaz-helm
Public
Helm installation for llmaz.
inference helm-chart llm llmops llmaz
Smarty
•1•0•1•0•Updated Sep 11, 2024Sep 11, 2024
llmlite
Public
🌵 A library helps to communicate with all kinds of LLMs consistently.
llmops
Python
•
MIT License
•2•15•18•0•Updated Jul 5, 2024Jul 5, 2024
PR-Copilot
Public
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•2•2•0•Updated Jun 29, 2024Jun 29, 2024