-
Notifications
You must be signed in to change notification settings - Fork 82
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add LIST_ENVIRONMENT_DATASETS permission for listing shared datasets and cleanup unused code #1719
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor thing: more about refactoring
context = get_context() | ||
if group_uri not in context.groups: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This condition (or the similar ones) is widely used.
May be we can make a decorator out of it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@staticmethod | ||
@ResourcePolicyService.has_resource_permission(GET_DATASET) | ||
@is_feature_enabled('modules.s3_datasets.features.metrics_data') | ||
def list_profiling_runs(uri): | ||
with get_context().db_engine.scoped_session() as session: | ||
return DatasetProfilingRepository.list_profiling_runs(session, uri) | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if removing here - should we not remove def list_profiling_runs(session, dataset_uri)
from dataall/backend/dataall/modules/s3_datasets/db/dataset_profiling_repositories.py
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done, cleaned up!
@staticmethod | ||
def get_table(uri: str): | ||
with get_context().db_engine.scoped_session() as session: | ||
return DatasetTableRepository.get_dataset_table_by_uri(session, uri) | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reverted, not sure why this was modified
if group_uri not in context.groups: | ||
raise exceptions.UnauthorizedOperation( | ||
action='LIST_ENVIRONMENT_GROUP_DATASETS', | ||
message=f'User: {context.username} is not a member of the team {group_uri}', |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: this is 1 example where we may not want to use input in output error message in the case of bad inputs being used to reflect back
This reverts commit 6c01162.
…and cleanup unused code (#1719) - Bugfix Added permission check on the list datasets API calls from the S3 shares module. Ensuring that only environment members can see environment shared datasets. ++ remove some unused code Please answer the questions below briefly where applicable, or write `N/A`. Based on [OWASP 10](https://owasp.org/Top10/en/). - Does this PR introduce or modify any input fields or queries - this includes fetching data from storage outside the application (e.g. a database, an S3 bucket)? - Is the input sanitized? - What precautions are you taking before deserializing the data you consume? - Is injection prevented by parametrizing queries? - Have you ensured no `eval` or similar functions are used? - Does this PR introduce any functionality or component that requires authorization? - How have you ensured it respects the existing AuthN/AuthZ mechanisms? - Are you logging failed auth attempts? - Are you using or adding any cryptographic features? - Do you use a standard proven implementations? - Are the used keys controlled by the customer? Where are they stored? - Are you introducing any new policies/roles/users? - Have you used the least-privilege principle? How? By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Feature or Bugfix
Detail
Added permission check on the list datasets API calls from the S3 shares module. Ensuring that only environment members can see environment shared datasets.
++ remove some unused code
Relates
Security
Please answer the questions below briefly where applicable, or write
N/A
. Based onOWASP 10.
fetching data from storage outside the application (e.g. a database, an S3 bucket)?
eval
or similar functions are used?By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.