sm-python-sdk test failures

[claytonparnell]

Seeing failures in sm-python-sdk tests, related to either no credentials, or no Docker daemon.

• <tests.unit.sagemaker.serve.builder.test_transformers_builder.TestTransformersBuilder testMethod=test_build_deploy_for_transformers_local_container_and_remote_container> - botocore.exceptions.NoCredentialsError: Unable to locate credentials
• <triton.test_server.TritonServerTests testMethod=test_start_invoke_destroy_local_triton_server_cpu> - FileNotFoundError: [Errno 2] No such file or directory: 'docker'
• <triton.test_server.TritonServerTests testMethod=test_start_invoke_destroy_local_triton_server_gpu> - FileNotFoundError: [Errno 2] No such file or directory: 'docker'

[aws-tianquaw]

Latest failures in 2.0-cpu image:

=========================== short test summary info ============================
FAILED tests/unit/sagemaker/image_uris/jumpstart/test_common.py::test_jumpstart_common_image_uri
FAILED tests/unit/sagemaker/model_uris/jumpstart/test_common.py::test_jumpstart_common_model_uri
FAILED tests/unit/sagemaker/script_uris/jumpstart/test_common.py::test_jumpstart_common_script_uri
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_build_negative_path_when_schema_builder_not_present
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_build_task_override_with_invalid_task_provided
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_djl_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_tei_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_tensor_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_tgi_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_torchserve_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_transformers_with_model
FAILED tests/unit/sagemaker/serve/builder/test_model_builder.py::TestModelBuilder::test_model_server_override_triton_with_model
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_build_deploy_for_tei_local_container_and_remote_container
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_image_uri_override
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_build_deploy_for_transformers_local_container_and_remote_container
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_failure_hf_md
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_image_uri_override
FAILED tests/unit/sagemaker/serve/detector/test_image_detector.py::TestImageDetector::test_detect_latest_downcast_xgb
FAILED tests/unit/sagemaker/serve/model_server/tei/test_server.py::TeiServerTests::test_start_invoke_destroy_local_tei_server
FAILED tests/unit/sagemaker/serve/model_server/triton/test_server.py::TritonServerTests::test_start_invoke_destroy_local_triton_server_cpu
FAILED tests/unit/sagemaker/serve/model_server/triton/test_server.py::TritonServerTests::test_start_invoke_destroy_local_triton_server_gpu
FAILED tests/unit/sagemaker/serve/utils/test_hardware_detector.py::test_total_inference_model_size_mib
= 22 failed, 8032 passed, 3778 skipped, 2 deselected, 3 xpassed, 3318 warnings

[claytonparnell]

Additional failure seen in 3.0 release (#511) - the pytest version pinned in test_requirements is not compatible with python 3.12. Installing newer pytest version leads to failures like

E               AttributeError: 'called_with' is not a valid assertion. Use a spec for the mock if 'called_with' is meant to be an attribute.
E               AttributeError: 'called_once_with' is not a valid assertion. Use a spec for the mock if 'called_once_with' is meant to be an attribute.. Did you mean: 'assert_called_once_with'?
...
= 52 failed, 7976 passed, 3778 skipped, 27 deselected, 3 xpassed, 7505 warnings in 1281.95s (0:21:21) =

[claytonparnell]

Seeing one failure (2.2.1

FAILED tests/unit/sagemaker/monitor/test_model_monitoring.py::test_data_quality_monitor_update_failure - AssertionError: assert 'data-quality-job-definition-2024-12-17-23-07-31-506' != 'data-quality-job-definition-2024-12-17-23-07-31-506'

Ran this one locally, it passed ~50% of local times. Seems flaky.