[DRAFT] s-quark support #1154

calad0i · 2024-12-17T11:01:11Z

Description

Preliminary support for the s-quark package. Adds corresponding handlers, bit-exact optimizer, and layer implementations.

Type of change

New frontend

Tests

N/A at the moment, not possible w/o test env update.

Checklist

I have read the guidelines for contributing.
I have commented my code, particularly in hard-to-understand areas.
I have made corresponding changes to the documentation.
My changes generate no new warnings.
I have installed and run pre-commit on the files I edited or added.
I have added tests that prove my fix is effective or that my feature works.

switch to pyproject.toml include pyproject.toml after install

calad0i added 20 commits December 15, 2024 06:20

import converter dependencies lazily

ef20647

make tf and qkeras optionl, stop assuming keras is tf.keras

028b4d0

less mandatory dependency

72eb053

fix dsp_aware_pruning test import path

63af2ac

fix broken setup.cfg after rebase, rm pyparsing

c11dddb

purge qkeras workaround

d9aaa1a

switch to pyproject.toml

4854423

switch to pyproject.toml include pyproject.toml after install

format

06f9cda

rm useless flake8 config in pyprject.toml

014c1db

Add hint on import failure

d3c8881

leftover

738e5b0

rm setup.py from manifest

bc7778b

manifest fix 2

b76b5cb

keras v3 object based parser

b7f60f5

sequential and i/o tensor name parsing fix

a7206b4

support activation layers

1605f96

consistent v2 weight reader behavior

a8aa489

add v3 conv handlers

eafe8b9

add test

6b8a44c

pre-commit fix

3f8acb5

calad0i force-pushed the s-quark-pr branch from 61af151 to 7d62e1a Compare December 17, 2024 11:04

calad0i changed the title ~~[DRAFT] s-quaark support~~ [DRAFT] s-quark support Dec 17, 2024

calad0i added 8 commits December 17, 2024 13:49

revert keras v2 converter

d2ccfb4

make reshape handler compatiable with keras v3

0334960

add general transpose for vivado/vitis

074b4b6

general einsum support for io_parallel and latency

29674db

add tests for einsumdense

1fb23b9

keras v3 converter clean-up

5489803

add symbolic quantized interval

5e18781

preliminary bit-exact precision derivation opt pass

02ff0c3

calad0i added 29 commits December 17, 2024 13:56

fix lazy import in handler

9326ad5

cleanup einsum handler

0cde312

cleanup einsum handler

b97d01e

more granular control over softmax for vivado

c34abbe

properly propagate inv/exp_table_size

7ea6310

support bit-exact softmax for stable impl

0ecd12e

bit-exact softmax fix and leftovers

fdfaac5

softmax table fixer update

3f4c642

support input scaler in softmax

bf99e83

support multidim parallel softmax

b925bc8

fuse quantizer when possible

c611c77

partial activation, fix input precision in SAT mode

b7975fa

fix padded convXd precition derivation rule

3d1431e

add unary lut support

f97d4d8

fix bit-exact corner case introduced by reverse flow

61e76a2

general data_t inference

e50e731

softmax compatbility

4a6b0b5

fix typo in einsum handler

a6128ae

fix more typos

5190c33

MHA 🎉

9cdb67c

fix einsum and softmax template typos

5bcae96

assert einsum ops doesnot include direct sum operation

d780de2

style

e3cef20

fix mha layer indexing

2bcf9e7

switch to model opt

c426ddc

pooling layers

a749c27

handle stray inputs

0317b5b

fix pooling layer accum_t

b38420d

bit-exact concatenate

a2d6e1a

calad0i force-pushed the s-quark-pr branch from 7d62e1a to a2d6e1a Compare December 17, 2024 13:57

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[DRAFT] s-quark support #1154

[DRAFT] s-quark support #1154

calad0i commented Dec 17, 2024

[DRAFT] s-quark support #1154

Are you sure you want to change the base?

[DRAFT] s-quark support #1154

Conversation

calad0i commented Dec 17, 2024

Description

Type of change

Tests

Checklist