Add JetStream to MaxText container #3409

buildx failed with: ERROR: failed to solve: process "/bin/sh -c <<\"EOF\" bash -ex\ngit-clone.sh ${URLREF_JETSTREAM} ${SRC_PATH_JETSTREAM}\necho \"-r ${SRC_PATH_JETSTREAM}/requirements.txt\" >> /opt/pip-tools.d/requirements-jetstream.in\nEOF" did not complete successfully: exit code: 1

amd64 / test-levanter / levanter-V100-unit-test

Process completed with exit code 1.

amd64 / test-jetstream / jetstream-V100-unit-test

Process completed with exit code 1.

amd64 / test-levanter / levanter-A100-unit-test

Process completed with exit code 1.

amd64 / test-te-multigpu / te-multi-gpu (2) / te-2GPU

Process completed with exit code 1.

amd64 / test-te-multigpu / te-multi-gpu (4) / te-4GPU

Process completed with exit code 1.

amd64 / test-te-multigpu / te-multi-gpu (8) / te-8GPU

Process completed with exit code 1.

amd64 / test-upstream-pax / test-upstream-pax-outcome

Process completed with exit code 1.

amd64 / test-upstream-t5x / test-upstream-t5x-outcome

Process completed with exit code 1.

amd64 / test-jetstream / jetstream-A100-unit-test

Process completed with exit code 1.

amd64 / test-rosetta-pax / rosetta-pax-single-node-dropout-te (1, 8, 1, 1)

The job running on runner GitHub Actions 99 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-single-node-dropout-te (1, 8, 1, 1)

The operation was canceled.

amd64 / test-rosetta-pax / single-process-multi-device-te (1, 8, 1, 1)

The job running on runner GitHub Actions 455 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / single-process-multi-device-te (1, 8, 1, 1)

The operation was canceled.

amd64 / test-rosetta-pax / single-process-evaluation-te (1, 8, 1, 1)

The job running on runner GitHub Actions 189 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / single-process-evaluation-te (1, 8, 1, 1)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 1)

The job running on runner GitHub Actions 193 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 1)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (5B_fused_attn_0, 1, 1, 8, 1, 2, --model-type 5B --disable-fused-attn)

The job running on runner GitHub Actions 132 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (5B_fused_attn_0, 1, 1, 8, 1, 2, --model-type 5B --disable-fused-attn)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (1, 8, 1, 1)

The job running on runner GitHub Actions 124 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (1, 8, 1, 1)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (4DP1FSDP2TP1PP_TE, 1, 4, 1, 2, 4)

The job running on runner GitHub Actions 465 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (4DP1FSDP2TP1PP_TE, 1, 4, 1, 2, 4)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 2)

The job running on runner GitHub Actions 10 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 2)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (5B_fused_attn_1, 1, 1, 8, 1, 2, --model-type 5B)

The job running on runner GitHub Actions 328 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (5B_fused_attn_1, 1, 1, 8, 1, 2, --model-type 5B)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (1DP1FSDP1TP1PP_TE, 1, 1, 1, 1, 4)

The job running on runner GitHub Actions 387 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (1DP1FSDP1TP1PP_TE, 1, 1, 1, 1, 4)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (1DP8FSDP1TP1PP_TE, 1, 1, 8, 1, 4)

The job running on runner GitHub Actions 57 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (1DP8FSDP1TP1PP_TE, 1, 1, 8, 1, 4)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (8DP1FSDP1TP1PP_TE, 1, 8, 1, 1, 4)

The job running on runner GitHub Actions 90 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (8DP1FSDP1TP1PP_TE, 1, 8, 1, 1, 4)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (16DP1FSDP1TP1PP_TE, 1, 16, 1, 1, 4)

The job running on runner GitHub Actions 30 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (16DP1FSDP1TP1PP_TE, 1, 16, 1, 1, 4)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (1, 4, 1, 2)

The job running on runner GitHub Actions 125 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node (1, 4, 1, 2)

The operation was canceled.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (LLaMA_eval_TE, 1, 1, 8, 1, 4, true, --model-type LLaMA70BProxy --evalu...

The job running on runner GitHub Actions 93 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / rosetta-pax-multi-node-te (LLaMA_eval_TE, 1, 1, 8, 1, 4, true, --model-type LLaMA70BProxy --evalu...

The operation was canceled.

amd64 / test-rosetta-pax / single-process-multi-device-te (1, 1, 2, 4)

The job running on runner GitHub Actions 478 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-pax / single-process-multi-device-te (1, 1, 2, 4)

The operation was canceled.

amd64 / test-rosetta-pax / test-pax-rosetta-sitrep / sitrep

Process completed with exit code 2.

amd64 / test-rosetta-pax / test-pax-rosetta-outcome

Process completed with exit code 2.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (8, 1)

The job running on runner GitHub Actions 253 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (8, 1)

The operation was canceled.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (1, 1)

The job running on runner GitHub Actions 38 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (1, 1)

The operation was canceled.

amd64 / test-rosetta-t5x / multi-gpu-multi-node (2N2G_te-0, 2, 2, --enable-te 0)

The job running on runner GitHub Actions 306 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / multi-gpu-multi-node (2N2G_te-0, 2, 2, --enable-te 0)

The operation was canceled.

amd64 / test-rosetta-t5x / vit-single-process-multi-device (8)

The job running on runner GitHub Actions 307 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / vit-single-process-multi-device (8)

The operation was canceled.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (8, 2)

The job running on runner GitHub Actions 239 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (8, 2)

The operation was canceled.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (1, 2)

The job running on runner GitHub Actions 73 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / vit-multi-gpu-multi-node (1, 2)

The operation was canceled.

amd64 / test-rosetta-t5x / multi-gpu-multi-node (2N8G-te-1, 8, 2, --gin.train/utils.DatasetConfig.pack=False --gin.train_eva...

The job running on runner GitHub Actions 143 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / multi-gpu-multi-node (2N8G-te-1, 8, 2, --gin.train/utils.DatasetConfig.pack=False --gin.train_eva...

The operation was canceled.

amd64 / test-rosetta-t5x / single-process-multi-device (1P1G_te-0, 1, --enable-te 0)

The job running on runner GitHub Actions 36 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / single-process-multi-device (1P1G_te-0, 1, --enable-te 0)

The operation was canceled.

amd64 / test-rosetta-t5x / single-process-multi-device (1P8G_te-1, 8, --gin.train/utils.DatasetConfig.pack=False --gin.train...

The job running on runner GitHub Actions 349 has exceeded the maximum execution time of 360 minutes.

amd64 / test-rosetta-t5x / single-process-multi-device (1P8G_te-1, 8, --gin.train/utils.DatasetConfig.pack=False --gin.train...

The operation was canceled.

amd64 / test-rosetta-t5x / test-t5x-rosetta-sitrep / sitrep

Process completed with exit code 2.

amd64 / test-rosetta-t5x / test-t5x-rosetta-outcome

Process completed with exit code 2.

publish-containers (upstream-t5x, mock-jax, 900, ghcr.io/nvidia/jax-toolbox-internal:11278706922-... / publish

Connect Timeout Error

publish-containers (upstream-pax, mock-jax-mealkit, 500, ghcr.io/nvidia/jax-toolbox-internal:1127... / publish

Process completed with exit code 1.

publish-containers (upstream-t5x, mock-jax, 900, ghcr.io/nvidia/jax-toolbox-internal:11278706922-... / publish

No files were found with the provided path: final-upstream-t5x.md. No artifacts will be uploaded.

publish-containers (upstream-pax, mock-jax-mealkit, 500, ghcr.io/nvidia/jax-toolbox-internal:1127... / publish

No files were found with the provided path: mealkit-upstream-pax.md. No artifacts will be uploaded.

Artifacts

Produced during runtime

Name	Size
artifact-base-build-amd64	568 Bytes
artifact-base-build-arm64	566 Bytes
artifact-equinox-build-amd64	569 Bytes
artifact-final-report	6.77 KB
artifact-gemma-build-amd64	561 Bytes
artifact-jax-build-amd64	553 Bytes
artifact-jax-build-arm64	554 Bytes
artifact-levanter-build-amd64	572 Bytes
artifact-levanter-build-arm64	573 Bytes
artifact-maxtext-build-amd64	568 Bytes
artifact-maxtext-build-arm64	473 Bytes
artifact-maxtext-test	670 Bytes
artifact-pax-build-amd64	568 Bytes
artifact-pax-build-arm64	568 Bytes
artifact-rosetta-build-pax-amd64	582 Bytes
artifact-rosetta-build-pax-arm64	583 Bytes
artifact-rosetta-build-t5x-amd64	586 Bytes
artifact-rosetta-build-t5x-arm64	585 Bytes
artifact-t5x-build-amd64	568 Bytes
artifact-t5x-build-arm64	568 Bytes
artifact-triton-build-amd64	565 Bytes
artifact-upstream-pax-mgmn-test	2.78 KB
artifact-upstream-t5x-mgmn-test	2.12 KB
artifact-workflow-metadata	277 Bytes
bumped-manifest	71.3 KB
final-base	254 Bytes
final-equinox	263 Bytes
final-gemma	257 Bytes
final-jax	251 Bytes
final-levanter	265 Bytes
final-maxtext	263 Bytes
final-pax	251 Bytes
final-t5x	251 Bytes
final-triton	259 Bytes
final-upstream-pax	276 Bytes
gemma-unit-test-A100	4.08 KB
gemma-unit-test-V100	2.74 KB
jax-unit-test-A100	17.5 KB
jax-unit-test-V100	17.7 KB
jetstream-unit-test-A100	2.47 KB
jetstream-unit-test-V100	2.48 KB
levanter-unit-test-A100	6.9 KB
levanter-unit-test-V100	6.92 KB
mealkit-equinox	272 Bytes
mealkit-gemma	265 Bytes
mealkit-jax	261 Bytes
mealkit-levanter	275 Bytes
mealkit-maxtext	271 Bytes
mealkit-pax	261 Bytes
mealkit-t5x	261 Bytes
mealkit-triton	269 Bytes
mealkit-upstream-t5x	286 Bytes
nsys-jax-unit-test-A100	30.3 MB
nsys-jax-unit-test-V100	16.1 MB
pallas-unit-test-A100	7.51 KB
pallas-unit-test-V100	7.37 KB
te-2GPU	8.41 KB
te-4GPU	8.44 KB
te-8GPU	8.5 KB
te-multigpu-test	528 Bytes
te-unit-test-A100	488 KB
te-unit-test-V100	241 KB
triton-unit-test-A100	4.87 KB
triton-unit-test-V100	4.88 KB
upstream-maxtext-11278706922-1DP1FSDP1TP1PP	13.8 KB
upstream-maxtext-11278706922-1DP1FSDP8TP1PP	19.4 KB
upstream-maxtext-11278706922-1DP2FSDP4TP1PP_single_process	14 KB
upstream-maxtext-11278706922-1DP4FSDP2TP1PP	19.2 KB
upstream-maxtext-11278706922-1DP8FSDP1TP1PP	19.5 KB
upstream-maxtext-11278706922-2DP2FSDP2TP1PP	19.4 KB
upstream-maxtext-11278706922-4DP2FSDP2TP1PP	25.1 KB
upstream-maxtext-metrics-test-log	1.86 KB
upstream-pax-11278706922-16DP1FSDP1TP1PP	780 KB
upstream-pax-11278706922-1DP1FSDP1TP1PP	141 KB
upstream-pax-11278706922-1DP2FSDP4TP1PP_single_process	142 KB
upstream-pax-11278706922-1DP8FSDP1TP1PP	420 KB
upstream-pax-11278706922-2DP1FSDP1TP4PP	294 KB
upstream-pax-11278706922-2DP1FSDP2TP4PP	537 KB
upstream-pax-11278706922-4DP1FSDP2TP1PP	420 KB
upstream-pax-11278706922-8DP1FSDP1TP1PP	422 KB
upstream-pax-11278706922-8DP1FSDP1TP1PP_eval	108 KB
upstream-pax-11278706922-8DP1FSDP1TP1PP_single_process	142 KB
upstream-pax-11278706922-LLaMA_eval	238 KB
upstream-pax-metrics-test-log	7.12 KB
upstream-t5x-11278706922-1P2G_fmha	5.05 MB
upstream-t5x-11278706922-1P8G	5.14 MB
upstream-t5x-11278706922-8G2N	5.25 MB
upstream-t5x-11278706922-8G2N_fmha	5.17 MB
upstream-t5x-metrics-test-log	8.66 KB

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add JetStream to MaxText container #3409

Summary

Add JetStream to MaxText container #3409

Jobs

Run details

ci.yaml

Annotations

Artifacts