v0.17.0

First ClearML Server Release!

Features

• New profile page layout
• Move knowledge resource to UI top bar
• Add complete experiment full screen view
• Add scalar results split/grouped view
• Add experiment active duration custom column to experiment table
• Improve comparison experiment consistency in plots for experiment name and color
• Improve project last update time: updated whenever an experiment or model in the project is updated
• Improve table multi-select UX: shift+mouse-click allegroai/clearml#61
• Add experiment parent to experiment details INFO tab
• Improve UI experiment archiving: Archiving queued experiments automatically dequeues them
• Improve experiment comparison: use available screen width
• Add debug sample history tracking allegroai/clearml#81
• Replace "Download" action with "Copy to Clipboard" for local files
• Add ClearML usage tips
• Add Task and Model, Clone and /Move-to allow creating new project on the fly
• Add support for all S3/minio special character (%) encoding cases
• Add API for filter by parent
• Improve browser-search to find data not visible in uncommitted changes/installed packages window
• Improve Task artifacts optimization
• Upgrade plotly to 1.57.1
• Rename Log tab to Console

Bug Fixes

• Fix HiDPI table issues
• Fix results/plots not scaling properly allegroai/clearml#247
• Fix experiment comparison:
  • Cannot compare regular Tasks to example Tasks
  • Cannot unhide scalars
  • Scalars wall time view and relative view will not auto-refresh
• Fix log scrolling in Chrome
• Fix UI adds to plots legend labels unnecessary task ID string allegroai/clearml#247
• Fix parallel coordinates: dimensions are not sorted by value
• Fix scalar auto color selection provides too similar colors
• Fix reordering a custom column does not restore column location
• Fix uncommitted changes - not possible to copy the entire text
• Fix queues wait time graph base should be 0, not in the middle.
• Fix plots view - "No Data" shown for a moment when changing experiments
• Fix adding new tag during auto-refresh
• Fix hide empty input model on non draft experiment
• Fix experiment/model table - name column restores to default size after opening and closing info
• Fix double click resizer should auto fit column

v0.16.1

IMPORTANT: if you're currently using v0.15.1 or earlier versions, upgrading to this version requires manual data migration

Bug Fixes

• Fix model page issue causing N/A to show after switching tabs (Slack thread)
• Removed experiments comparison limit (only 10 were allowed). Limit is now 100, configurable using services.tasks.multi_task_histogram_limit (Slack thread)
• Fix scalar plots sometimes not calculated by the server in lower iteration values (Slack thread)
• Fix error while retrieving experiment log when only a few lines were reported #59
• Update Fixed User full-name on restart (Slack thread)
• Fix project ordering issue
• When loading plots, display a spinner and don't show "no data"
• Improve logging to provide more coherent ElasticSearch connection status in server log

Docker image can be found here:

docker pull allegroai/trains:0.16.1

v0.16.0

IMPORTANT: upgrading to this version requires manual data migration

Features

• Add experiment hyperparameter grouping
  • HYPER PARAMETERS tab renamed to CONFIGURATIONS
  • CONFIGURATIONS tab contains the sections USER PROPERTIES, HYPER PARAMETERS, CONFIGURATION OBJECTS
  • Add user properties group. Key-value pairs always editable (USER PROPERTIES section)
  • Add command line options group - argparse and older experiments parameters (CONFIGURATIONS/HYPER PARAMETERS/Args)
  • Add TensorFlow definitions group (CONFIGURATIONS/HYPER PARAMETERS/TF_DEFINE)
  • Add environment variables group (CONFIGURATIONS/HYPER PARAMETERS/Environment)
• Improve experiment model configuration
  • Model design is in the ARTIFACTS tab
  • Experiment model description is in the CONFIGURATIONS OBJECTS section in the CONFIGURATIONS tab
• Improve experiment comparison
  • In hyperparameter parallel coordinate comparison, hover over an experiment name to highlight it on plot allegroai/clearml#53
  • Remove fields providing no additional information from comparison
• Improve the model framework filter. Filter contains only frameworks used by models in the project
• Add support for text debug samples in the DEBUG SAMPLES section in the RESULTS tab
• Add legend on/off toggle control for every plot
• Add clear button for text areas #42
• Reinstate the bottom bar Archive button
• Add Trains community links to left bar
• Add Hi-DPI display support
• Add debug.ping endpoint for simple health monitoring
• Add support for field exclusion in *.get_all endpoints
• Move to ElasticSearch 7. Requires manual data migration

Bug Fixes

• Auto-fit column width on column resize double click
• Allow top-bar search if fewer than three characters are entered and Enter is pressed

Docker image can be found here:

docker pull allegroai/trains:0.16.0

v0.15.1

Bug Fixes

• Fix experiment clone dialog resets while typing #44
• Fix image-only plots are not displayed allegroai/clearml#140
• Fix last item in plots list is hidden
• Fix input model edit view contains a redundant save button
• Fix credentials popup shows incorrect URL for fileserver
• Fix experiment description does not allow multiple lines
• Fix tags filter ("No tags" selection, display only tags available for the project)
• Fix can't save empty model configuration
• Fix add tag dialog doesn't close after adding a tag
• Show active column filters for values even when values are unavailable in current project
• Fix project selection resets when cloning an experiment
• Fix several broken icons
• Fix can't add tags in Results view
• Add warning when deleting a model/experiment tag
• New icons for experiment/task types

Docker image can be found here:

docker pull allegroai/trains:0.15.1

v0.15.0

Features

• Trains WebApp code is now publicly available in the Trains Web repository. See Trains Web v0.15.0 for the WebApp code included in this server release
• Add support for debug media (images, audio, video) allegroai/clearml#120
• Add experiment and model tag management allegroai/clearml#46
• Add support for more task types (see Trains v0.15.0 and Trains Agent v0.15.0 for related support and services mode)
• Experiment comparison
  • Add Last / Max (maximal) / Min (minimal) scalar values to parallel coordinates in experiment comparison allegroai/clearml#131
  • Add deep comparison support to experiment comparision, including uncommitted changes by file with line diff and search of all text
• Enhance table columns
  • Add dynamic column ordering to the experiments and models tables
  • Add the User column to the experiments table
  • Add the Description to experiments and models tables
  • Add double click to table column resizers for column width reset
  • Add column customization to the models table
• Add support for saving and sharing customized model table URLs by embedding table customizations in the URL
• Add a popup text editor for all text areas
• Move resource monitoring plots after the metrics plots in the experiment results SCALARS tab
• Add support for the clear_all parameter in tasks.reset to improve Trains SDK Task reuse
• Unify experiments table and comparison auto-refresh (switching between table and comparison auto refresh setting did not change)
• Add a cancel button to all text searches
• Improve the experiment / details panel split to 75% / 25%
• Infrastructure
  • Update pymongo and mongoengine to their latest versions
  • Improve mongo performance by eliminating non-indexed queries
  • Upgrade WebApp to Angular 9
  • Use native javascript instead of date-fns
• Add survey invitation popup

Bug Fixes

• Fix experiment comparison issues
  • Scalar comparison type does not reflect displayed comparison #40
  • Comparison animations overlapping other fields
  • Cannot choose a metric after clearing it in experiment comparison parallel coordinates
  • Adding a dimension without a value removes all lines in experiment comparison parallel coordinates
• Fix experiment view issues
  • Custom URL gets erased when clicking on any tab on experiment
  • All experiments re-fetched when navigating through tabs of an experiment
  • Input and output models configuration box sizes differs in the experiments ARTIFACTS tab
  • Changing experiment table / details pane split redraws scalars and plots
  • Wrong download URL shown for S3 artifact links with special characters
• Fix experiment results view issues
  • Browser zoom breaks labels (Ctrl + / Ctrl - / mouse wheel) in experiment results SCALARS tab allegroai/clearml#127
  • Debug image name not shown if file cannot be loaded
  • minio images with spaces in the path not displaying correctly
  • Plots should use the full panel space
  • Plot relative time displaying incorrectly in experiment results SCALARS tab
  • Wall time display in local time in experiment results SCALARS tab
• Fix experiment table issues
  • Hyper parameters sorted as strings, not as numbers allegroai/clearml#124
  • Prevent auto refresh reordering when the details panel is open
  • Table resizing made the preferences wheel to jump over titles
• Fix experiment reset when both the input and output model are the same causes model deletion
• Fix experiment clone not working if the input model was deleted
• Fix missing trash icon (delete) if a custom column title is too long
• Fix display of aborted tasks in the recent experiments on the Homepage

Docker image can be found here:

docker pull allegroai/trains:0.15.0

v0.14.2

Features and Bug Fixes

• Add survey invitation popup
• Fix misaligned titles in experiment results, scalars and plots (RESULTS tab, SCALARS and PLOTS sub-tabs)
• Fix parallel coordinates comparison in comparing experiments (adding dimension with no values removes all lines)
• Fix resizing the experiments tables window (the preferences wheel jumped over the titles)
• Fix the browser zoom (CTRL +, CTRL -, and mouse wheel) in experiment results, scalars (RESULTS tab, SCALARS sub-tab) allegroai/clearml#127

Docker image can be found here:

docker pull allegroai/trains:0.14.2

v0.14.1

Features

• Support default Trains Server Kubernetes Helm ports in WebApp

Bug Fixes

• Fix switching scalar plots between linear and logarithmic views allegroai/clearml#75
• Do not reset view filtering when switching tabs in experiment view

Docker image can be found here:

docker pull allegroai/trains:0.14.1

v0.14.0

Features

• Add debug image viewing for an unlimited number of iterations, filtering by metric, and comparing debug images for different iterations
• Add debug image view zoom, fit to screen, resize, hover coordinates allegroai/clearml#68
• Add support for table plot format (pandas, csv etc. stored as plot events) in experiment results Plots section
• Allow switching scalar plots between linear and logarithmic views allegroai/clearml#75
• Add scalar minimums and maximums to experiments comparison
• Allow opening HTML artifact files in the browser
• Add Web-App notification for version updates
• Add toggle button between full screen and standard views when showing experiment results tab
• Add "load more" button in global search results

Bug Fixes

• Fix dialog elements to be accessible in non-100% screen scale allegroai/clearml#89
• Fix custom columns in experiments table not properly loaded from browser store allegroai/clearml#106
• Fix issue with showing 2D graphs containing sub-plots allegroai-trains #slack
• Allow editing model description
• Allow editing experiment uncommitted changes and installed packages separately
• Fix issues with vertical scrolling of experiment logs
• Allow deleting an input model from a draft experiment
• Fix issue with image plots sometimes not visible in experiments comparison

Docker image can be found here:

docker pull allegroai/trains:0.14.0

v0.13.0

Features and Bug Fixes

• Add parallel coordinates hyper-parameter comparison, available under Compare Experiments -> Hyper Parameters -> Parallel Coordinates (in the drop-down) allegroai/clearml#53
• Add encoding of experiment table view settings in URL to allow sharing using browser URL copy/paste
• Add loguru (ANSI color) support allegroai/clearml#29
• Add support for special characters in hyper-parameter keys (white-spaces, . and $) allegroai/clearml#69
• Add optional anonymous daily usage statistics (help us improve Trains Server):
  • Disabled by default
  • Requires user opt-in
  • Single averages report per day
  • Reports average load metrics per day (CPU/memory)
  • Reports average workload per day (amount and average duration of queues, agents and experiments)
• Improve experiment table filtering indication
• Improve model view to allow navigating to its generating experiment
• Fix experiment comparison to distinguish between experiments with the same name allegroai/clearml#52
• Fix Web UI compare plots bug allegroai/clearml#55, allegroai/clearml#73

Docker image can be found here:

docker pull allegroai/trains:0.13.0

v0.12.1

Minor bug fixes and improvements

• Add resource monitoring
• Fix Web UI compare plots bug #55
• Improve server upgrade checks/messages

Docker image can be found here:

docker pull allegroai/trains:0.12.1