Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make numpy, pandas, polars, and pyarrow extras #5

Closed
wants to merge 62 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
8135891
Merge feature-store-api
aversey Jul 2, 2024
fab4b95
Merge machine-learning-api
aversey Jul 2, 2024
c16dab6
Merge remote-tracking branch 'feature-store-api/master' into the-merge
aversey Jul 5, 2024
f4f1411
Merge remote-tracking branch 'machine-learning-api/main' into the-merge
aversey Jul 5, 2024
0570551
Move hsfs/python/hsfs to python/hsfs
aversey Jul 3, 2024
a653306
Move hsml/python/hsml to python/hsml
aversey Jul 3, 2024
d5dff4c
Move hsfs GitHub Actions
aversey Jul 2, 2024
97e15df
Merge the rest of hsfs GitHub Actions
aversey Jul 2, 2024
5d198d4
Merge hsml GitHub Actions
aversey Jul 2, 2024
70a611d
Skip test_login until Robin is back
aversey Jul 11, 2024
5a0f8af
Fix python workflow
aversey Jul 11, 2024
fa88a6f
Rename workflows
aversey Jul 11, 2024
2124442
Make no-opt tests run only after ruff-check
aversey Jul 11, 2024
23fb7a1
Renames in python workflow
aversey Jul 11, 2024
780853a
Move hsml/python/hsml to python/hsml
aversey Jul 3, 2024
9525512
Move hsfs/python/hsfs to python/hsfs
aversey Jul 3, 2024
5003f8b
Move tag.py, inode.py
aversey Jul 5, 2024
cc5e622
Move tags_api.py
aversey Jul 5, 2024
f0d4928
Adapt tag.py to the move to hopsworks
aversey Jul 5, 2024
3e621ee
Adapt tags_api to the move to hopsworks
aversey Jul 5, 2024
fa636bb
Create aliases for tags, inode, tags_api
aversey Jul 5, 2024
0d7b17f
Fix circular dependency error on import hsfs
aversey Jul 5, 2024
20a520e
Merge hsfs pyproject.toml
aversey Jul 3, 2024
5789e4a
Merge hsml pyproject.toml
aversey Jul 3, 2024
e8c389d
Remove hsfs and hsml pyproject.toml
aversey Jul 3, 2024
87fe8a6
Fix pyarrow import error
aversey Jul 3, 2024
ecb249c
Fix pyproject "dev" extra
aversey Jul 3, 2024
a26310f
Fix "dev-no-opt" extra
aversey Jul 3, 2024
c22b41b
Move Java code of hsfs
aversey Jul 2, 2024
723934f
Remove redundant hsml Java-related files
aversey Jul 2, 2024
c1c75ec
Move hsml tests to hopsworks
aversey Jul 3, 2024
2abd5a2
Move hsfs tests to hopsworks
aversey Jul 3, 2024
3cf1ff3
Merge conftest
aversey Jul 3, 2024
65c03e5
Move hsfs test fixtures
aversey Jul 3, 2024
1e76893
Merge the rest of hsfs tests
aversey Jul 3, 2024
56413cd
[FSTORE-1458] Move locust_benchmark of hsfs
aversey Jul 2, 2024
15e19b6
Move hosts_api from hsfs
aversey Jul 3, 2024
34d1d92
Add hosts_api alias to hsfs
aversey Jul 3, 2024
5dd04ae
Merge variable_api of hsfs
aversey Jul 3, 2024
7071c9c
Merge project_api of hsfs
aversey Jul 3, 2024
95a08e9
Ruff project_api
aversey Jul 3, 2024
9b758c3
Fix client/external so that Project API get_client works
aversey Jul 3, 2024
49d57fa
Fix Project API docs
aversey Jul 3, 2024
81d0d2b
Add docs to variable_api
aversey Jul 3, 2024
7946d6a
Ruff client/external.py
aversey Jul 3, 2024
46bbcf4
Fix circular import error in docgen
aversey Jul 5, 2024
90ce2f2
Renames in workflows
aversey Jul 11, 2024
acf485b
Fix test_model
aversey Jul 11, 2024
9a090a3
Attempt to solve circular dependency problem with model_fixtures
aversey Jul 11, 2024
b37d225
[HWORKS-1048] Support multiple modularized project environments (#213)
robzor92 Jul 5, 2024
6280332
[FSTORE-1285] Model Dependent Transformation Functions (#206)
manu-sj Jul 11, 2024
1848cd8
Merge branch 'master' of github.com:logicalclocks/feature-store-api i…
aversey Jul 11, 2024
7ae1176
Merge branch 'the-merge-python-hsfs' into the-merge-complete
aversey Jul 11, 2024
20c9daf
Merge branch 'the-merge-python-hsml' into the-merge-complete
aversey Jul 11, 2024
b16c95b
Move hopsworks_udf
aversey Jul 11, 2024
2ff44ac
Fix circular import of UDF
aversey Jul 11, 2024
6203644
Fix typechecked not found error
aversey Jul 11, 2024
602b21a
test_transformation_function_attached was removed by Manu in PR 1308 …
aversey Jul 11, 2024
1cd5cf2
Merge branch 'main' into the-merge-complete
aversey Jul 11, 2024
ec3ac94
Fix docgen circular import
aversey Jul 11, 2024
c936075
Follow-up fix
aversey Jul 11, 2024
e1e72c9
Move typing-only imports under if TYPE_CHECKING
aversey Jul 12, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
8 changes: 4 additions & 4 deletions .github/workflows/java-ut.yml → .github/workflows/java.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ name: java
on: pull_request

jobs:
unit_tests_utc:
name: Java Unit Tests
unit_tests:
name: Unit Tests
runs-on: ubuntu-latest

steps:
Expand Down Expand Up @@ -32,8 +32,8 @@ jobs:
working-directory: ./java
run: mvn clean test

unit_tests_local:
name: Java Unit Tests (Local TZ)
unit_tests_local_tz:
name: Unit Tests (Local TZ)
runs-on: ubuntu-latest

steps:
Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
name: mkdocs-master
name: mkdocs-main

on: pull_request

jobs:
publish-master:
publish-main:
runs-on: ubuntu-latest

steps:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/mkdocs-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,7 @@ jobs:
run: |
git config --global user.name Mike
git config --global user.email [email protected]

- name: mike deploy docs
run: |
mike deploy ${{ env.RELEASE_VERSION }} ${{ env.MAJOR_VERSION }} -u --push
Expand Down
29 changes: 0 additions & 29 deletions .github/workflows/optional-dependency.yml

This file was deleted.

59 changes: 36 additions & 23 deletions .github/workflows/python-lint.yml → .github/workflows/python.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,8 +45,8 @@ jobs:
ALL_CHANGED_FILES: ${{ steps.get-changed-files.outputs.all_changed_files }}
run: ruff format $ALL_CHANGED_FILES

unit_tests_ubuntu_utc:
name: Unit Testing (Ubuntu)
unit_tests:
name: Unit Tests
needs: lint_stylecheck
runs-on: ubuntu-latest
strategy:
Expand All @@ -73,12 +73,34 @@ jobs:
run: python --version

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
run: pytest python/tests

unit_tests_ubuntu_pandas:
name: Unit Testing (Ubuntu) (Pandas 1.x)
unit_tests_no_opt:
name: Unit Tests (No Optional Dependencies)
needs: lint_stylecheck
runs-on: ubuntu-latest

steps:
- name: Set Timezone
run: sudo timedatectl set-timezone UTC

- uses: actions/checkout@v4
- name: Copy README
run: cp README.md python/

- uses: actions/setup-python@v5
name: Setup Python
with:
python-version: "3.10"
cache: "pip"
cache-dependency-path: "python/setup.py"
- run: pip install -e python[python,dev-no-opt]

- name: Run Pytest suite
run: pytest python/tests

unit_tests_pandas1:
name: Unit Tests (Pandas 1.x)
needs: lint_stylecheck
runs-on: ubuntu-latest

Expand All @@ -102,12 +124,10 @@ jobs:
run: python --version

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
run: pytest python/tests

unit_tests_ubuntu_local:
name: Unit Testing (Ubuntu) (Local TZ)
unit_tests_local_tz:
name: Unit Tests (Local TZ)
needs: lint_stylecheck
runs-on: ubuntu-latest

Expand All @@ -131,12 +151,10 @@ jobs:
run: python --version

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
run: pytest python/tests

unit_tests_ubuntu_typechecked:
name: Typechecked Unit Testing (Ubuntu)
unit_tests_typechecked:
name: Unit Tests (Typechecked)
needs: lint_stylecheck
runs-on: ubuntu-latest

Expand All @@ -155,13 +173,12 @@ jobs:

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
HOPSWORKS_RUN_WITH_TYPECHECK: "true"
run: pytest python/tests
continue-on-error: true

unit_tests_windows_utc:
name: Unit Testing (Windows)
unit_tests_windows:
name: Unit Tests (Windows)
needs: lint_stylecheck
runs-on: windows-latest

Expand All @@ -185,12 +202,10 @@ jobs:
run: python --version

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
run: pytest python/tests

unit_tests_windows_local:
name: Unit Testing (Windows) (Local TZ)
unit_tests_windows_local_tz:
name: Unit Tests (Windows) (Local TZ)
needs: lint_stylecheck
runs-on: windows-latest

Expand All @@ -217,6 +232,4 @@ jobs:
run: pip freeze

- name: Run Pytest suite
env:
ENABLE_HOPSWORKS_USAGE: "false"
run: pytest python/tests
15 changes: 0 additions & 15 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,6 @@ coverage.xml
.hypothesis/
.pytest_cache/
.ruff_cache/
bigquery.json
metastore_db/

# Translations
*.mo
Expand All @@ -73,9 +71,6 @@ instance/
# Sphinx documentation
docs/_build/

# Mike Javadoc
docs/javadoc

# PyBuilder
target/

Expand Down Expand Up @@ -133,13 +128,3 @@ target/

# mkdocs intemediate files
docs/generated

# Test artifacts
keyFile.json

# delombok dir
delombok

# dev scripts dir
dev_scripts/
dev_tools/
Loading
Loading