Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

merge transformers into main #8

Merged
merged 39 commits into from
Aug 22, 2024
Merged

merge transformers into main #8

merged 39 commits into from
Aug 22, 2024

Conversation

plutonium-239
Copy link
Owner

No description provided.

@plutonium-239
add llm trial code
3893c6c 
(cherry picked from commit fa690bb)
@plutonium-239
transformers.Conv1D
f970dfe 
(cherry picked from commit edf5159)
@plutonium-239
fix inputs for transformers
9a9801d 
(cherry picked from commit 04a075e)
@plutonium-239
minor
5a34b84 
(cherry picked from commit 84ac560)
@plutonium-239
directly pass input embeddings
e3e5476 
(cherry picked from commit e5bcc8f)
@plutonium-239
format
281866f 
(cherry picked from commit 04dcbb9)
@plutonium-239
replace transformers.Conv1D with MemSaveLinear
f0aa31f 
(cherry picked from commit ce1ec40)
@plutonium-239
replace transformers.Conv1D with MemSaveLinear
63a4f7c 
(cherry picked from commit ad09f00)
@plutonium-239
add vit, torch vanilla transformer to experiment models
80d4270 
(cherry picked from commit 269ab70)
@plutonium-239
change estimate - add transformer as architecture
e5f728d 
(cherry picked from commit 3bfde12)
@plutonium-239
improve transformers config handling
c6f8c8e 
(cherry picked from commit fda3b1f)
@plutonium-239
minor
c471abc 
(cherry picked from commit c443c18)
@plutonium-239
various fixes + formatting
b470f16 
(cherry picked from commit 14e532e)
@plutonium-239
add many hf models
0641fe9 
minor

(cherry picked from commit 53b41c2)
@plutonium-239
demo add transformers
d55c3db 
(cherry picked from commit 14613c5)
@plutonium-239
change from lambdas inside loop to functool.partials
f30f8e2 
(cherry picked from commit a4ab2bd)
@plutonium-239
fix for encoder-decoder models + avoid loading transformers in `memsa…
b92ee08 
…ve_torch.nn`

(cherry picked from commit 9084a25)
@plutonium-239
format + minor
30f8ed6 
(cherry picked from commit 2d64730)
@plutonium-239
fix "Do not use mutable data structures for argument defaults"
420c027 
(cherry picked from commit 52993fb)
@plutonium-239
fix
d519e34 
(cherry picked from commit b5424c6)
@plutonium-239
minor
f690d13 
(cherry picked from commit dc3a7e8)
@plutonium-239
lm_head is non trainable
d7622d1 
(cherry picked from commit 3f7891a)
@plutonium-239
misc fixes, code for making latex table
02ed7fa 
(cherry picked from commit ec4564a)
@plutonium-239
qol
13897da 
(cherry picked from commit 336a5d5)
@plutonium-239
fix for different model dtypes
9b8e7f5 
(cherry picked from commit 6f86fb5)
@plutonium-239
adjust batch size for mistral-7b
b9d31cc 
(cherry picked from commit c0ad551)
@plutonium-239
minor: correct cache_kws
8c281f6 
(cherry picked from commit a000fc4)
@plutonium-239
minor printing changes
69d2bd1 
(cherry picked from commit 4f3e039)
@plutonium-239
update optional deps
d12a2d9 
(cherry picked from commit 8853a5e)
@plutonium-239
minor
f976b61 
(cherry picked from commit c14c4e6)
@plutonium-239
new implementation of dropout
b057db2 
(cherry picked from commit 657e708)
@plutonium-239
adding llama3 and phi3
f256f93 
(cherry picked from commit 35da149)
@plutonium-239
refactor cases to refer to a central location
7cde54b 
(cherry picked from commit 1f9fb45)
@plutonium-239
format + prep for merge
51537c6 
(cherry picked from commit c444edd)
@plutonium-239
minor fixes
9ae8507 
(cherry picked from commit c5b7716)
@plutonium-239
add VLM architecture in estimate, refactor cases to refer to a centra…
b36baa6 
…l location

(cherry picked from commit 1f9fb45)
@plutonium-239
format + prep for merge
3d5ec71 
(cherry picked from commit c444edd)
@plutonium-239
Merge branch 'transformers' into vlms
b78d341
@plutonium-239
Merge pull request #7 from plutonium-239/vlms
4d489fa 
merge vlms into transformers
@plutonium-239 plutonium-239 merged commit 1fa42dc into main Aug 22, 2024
0 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@plutonium-239