Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check that the Java / Scala package is installed when needed #244

Closed
wants to merge 1 commit into from

Conversation

EnricoMi
Copy link
Contributor

Provides a meaningful error message when user accesses a spark extension function in Python that requires the Java / Scala package:

RuntimeError: Java / Scala package not found! You need to add the spark-extension package to your PySpark environment: https://github.com/G-Research/spark-extension#python

Before, the error was:

TypeError: 'JavaPackage' object is not callable

Improves #242

Copy link

Test Results

   631 files  +  117     631 suites  +117   1h 45m 6s ⏱️ + 16m 13s
   499 tests ±    0     499 ✅ ±    0   0 💤 ±0  0 ❌ ±0 
19 419 runs  +3 899  19 355 ✅ +3 899  64 💤 ±0  0 ❌ ±0 

Results for commit 47f0eb8. ± Comparison against base commit cdcf650.

@EnricoMi EnricoMi closed this Aug 15, 2024
github-merge-queue bot pushed a commit that referenced this pull request Aug 16, 2024
Provides a meaningful error message when user accesses a spark extension
function in Python that requires the Java / Scala package:

RuntimeError: Java / Scala package not found! You need to add the Maven
spark-extension package to your PySpark environment:
https://github.com/G-Research/spark-extension#python

Before, the error was:

    TypeError: 'JavaPackage' object is not callable

Improves #242
Supersedes #244
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant