Skip to content

Commit

Permalink
Merge pull request #29 from kerthcet/cleanup/rename
Browse files Browse the repository at this point in the history
Remove unnecessary files
  • Loading branch information
InftyAI-Agent authored Sep 18, 2024
2 parents a5b8379 + 18d6e43 commit ba5ccbb
Show file tree
Hide file tree
Showing 33 changed files with 1,736 additions and 1,911 deletions.
10 changes: 10 additions & 0 deletions .github/workflows/kube-workflow-init.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
name: Initialization Workflow

on:
workflow_dispatch:

jobs:
init:
uses: kerthcet/github-workflow-as-kube/.github/workflows/[email protected]
secrets:
AGENT_TOKEN: ${{ secrets.AGENT_TOKEN }}
21 changes: 21 additions & 0 deletions .github/workflows/kube-workflow.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
name: Event Workflow

on:
issues:
types:
- opened
issue_comment:
types:
- created
pull_request_target:
types:
- opened
- synchronize
- labeled
- unlabeled

jobs:
event-handler:
uses: kerthcet/github-workflow-as-kube/.github/workflows/[email protected]
secrets:
AGENT_TOKEN: ${{ secrets.AGENT_TOKEN }}
File renamed without changes.
5 changes: 5 additions & 0 deletions OWNERS
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
approvers:
- kerthcet

reviewers:
- kerthcet
47 changes: 7 additions & 40 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,50 +1,17 @@
# Llmaz
# Console for LLMAZ

**Llmaz**, pronounced as `/lima:z/`, is a building block for users to build their own LLM from A to Z. **We're the aborigines of Kubernetes.**
A dashboard for [llmaz](https://github.com/InftyAI/llmaz) to interact with LLM workloads.

This is mostly driven by several people who has great enthusiasm about AI at spare time, if you're one of this kind of people, please join us.
## How to deploy

🚀 All kinds of contributions are welcomed ! Please follow [Contributing](/CONTRIBUTING.md).
Run `make launch` then visit `http://localhost:7860` for Console.

## 🪂 How to run

### Prerequisites

- [Helm](https://helm.sh/)
- [Kind](https://kind.sigs.k8s.io/)

### Install

```shell
git clone https://github.com/InftyAI/Llmaz.git
kind create cluster # ignore this if you already have a Kubernetes cluster
helm install llmaz Llmaz/deploy/llmaz --create-namespace --namespace llmaz
kubectl port-forward svc/llmaz 7860:7860
```

*Visit <http://localhost:7860> for WebUI*

![webui](./images/webui.jpg)

## ✨ Features

- Foundational model management
- Prompt management
- Supervised Fine Tuning
- Model Serving
- Self-Instruct
- Dataset management
- RLHF
- Evaluation
- AI applications, RAG, Chatbot, etc.
- ...

Still under development, **Let's see what will happen !**
![console](./docs/asserts/preview.jpg)

## 👏 Contributors

Thanks to all these contributors. You're the heroes.

<a href="https://github.com/InftyAI/Llmaz/graphs/contributors">
<img src="https://contrib.rocks/image?repo=InftyAI/Llmaz" />
<a href="https://github.com/InftyAI/llmaz-webui/graphs/contributors">
<img src="https://contrib.rocks/image?repo=InftyAI/llmaz-webui" />
</a>
File renamed without changes.
1 change: 0 additions & 1 deletion llmaz/serves/chatbot.py → console/serve/chatbot.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@
# from llmlite.apis import ChatLLM
import torch


Expand Down
2 changes: 1 addition & 1 deletion llmaz/serves/serve.py → console/serve/serve.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
from llmaz.serves.chatbot import Chatbot
from console.serve.chatbot import Chatbot


class Serve:
Expand Down
File renamed without changes.
2 changes: 1 addition & 1 deletion llmaz/webui/engine.py → console/webui/engine.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
from llmaz.serves.serve import Serve
from console.serve.serve import Serve


class Engine:
Expand Down
10 changes: 5 additions & 5 deletions llmaz/webui/webui.py → console/webui/webui.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,16 +3,16 @@

import gradio as gr

from llmaz.webui.engine import Engine
from llmaz.webui.webui_serving import create_serving_webui
from llmaz.webui.webui_finetune import create_finetune_webui
from llmaz.webui.webui_prompt import create_prompt_webui
from console.webui.engine import Engine
from console.webui.webui_serving import create_serving_webui
from console.webui.webui_finetune import create_finetune_webui
from console.webui.webui_prompt import create_prompt_webui


def launch_webui() -> gr.Blocks:
engine = Engine()

with gr.Blocks(title="Llmaz") as blocks:
with gr.Blocks(title="Console") as blocks:
# Serving Tab
create_serving_webui(engine)
# Prompt Tab
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
import gradio as gr

from llmaz.webui.engine import Engine
from console.webui.engine import Engine


def create_finetune_webui(engine: Engine) -> gr.Tab:
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
import gradio as gr

from llmaz.webui.engine import Engine
from console.webui.engine import Engine


def create_prompt_webui(engine: Engine) -> gr.Tab:
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
import gradio as gr
from llmlite.apis import ChatMessage

from llmaz.webui.engine import Engine
from console.webui.engine import Engine


loaded = False
Expand Down
23 changes: 0 additions & 23 deletions deploy/llmaz/.helmignore

This file was deleted.

24 changes: 0 additions & 24 deletions deploy/llmaz/Chart.yaml

This file was deleted.

22 changes: 0 additions & 22 deletions deploy/llmaz/templates/NOTES.txt

This file was deleted.

62 changes: 0 additions & 62 deletions deploy/llmaz/templates/_helpers.tpl

This file was deleted.

61 changes: 0 additions & 61 deletions deploy/llmaz/templates/deployment.yaml

This file was deleted.

28 changes: 0 additions & 28 deletions deploy/llmaz/templates/hpa.yaml

This file was deleted.

Loading

0 comments on commit ba5ccbb

Please sign in to comment.