Skip to content

Commit

Permalink
init
Browse files Browse the repository at this point in the history
  • Loading branch information
truskovskiyk committed Jun 9, 2024
1 parent 06c0e69 commit b6152e7
Show file tree
Hide file tree
Showing 6 changed files with 178 additions and 174 deletions.
3 changes: 1 addition & 2 deletions .github/workflows/ci.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@ on:
push:
branches:
- main
- migrate-to-github-registry-for-docker-images

jobs:
container:
Expand All @@ -28,7 +27,7 @@ jobs:
id: meta
uses: docker/metadata-action@9ec57ed1fcdbf14dcef7dfbe97b2010124a938b7
with:
images: ghcr.io/kyryl-opens-ml/fine-tune-llm-in-2024
images: ghcr.io/kyryl-opens-ml/rlfh-dagster-modal

# See explanation: https://github.com/orgs/community/discussions/25678
- name: Clean disk
Expand Down
4 changes: 2 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -12,5 +12,5 @@ RUN mkdir -p $DAGSTER_HOME
ENV PYTHONPATH /app
RUN ln -s /usr/bin/python3 /usr/bin/python

COPY text2sql_training text2sql_training
CMD dagster dev -f text2sql_training/llm_rlhf.py -p 3000 -h 0.0.0.0
COPY rlhf_training rlhf_training
CMD dagster dev -f rlhf_training/llm_rlhf.py -p 3000 -h 0.0.0.0
30 changes: 0 additions & 30 deletions README copy.md

This file was deleted.

12 changes: 11 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,14 @@ pip install --upgrade \
pip install ninja packaging
MAX_JOBS=4 pip install flash-attn --no-build-isolation
```
docker build -t rlfh-dagster-modal:latest .
docker tag rlfh-dagster-modal:latest ghcr.io/kyryl-opens-ml/rlfh-dagster-modal:latest
docker push ghcr.io/kyryl-opens-ml/rlfh-dagster-modal:latest
echo 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 | docker login ghcr.io -u truskovskiyk --password-stdin
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
```


Loading

0 comments on commit b6152e7

Please sign in to comment.