Release Notes

v1.2

New Features

• Create a new tale populated with data by passing DOI using Dashboard’s “add new tale” modal – ngx-dashboard#281.

• Allow to upload entire folders to Home / Workspace via Dashboard – ngx-dashboard#268.

• Allow anonymous access to public Tales – ngx-dashboard#277, wt_versioning#45.

• Allow to view logs from running Instances – ngx-dashboard#311, girder_wholetale#557, instance_logger.

• Publicly available Docker Registry with Tale images – girder_wholetale#551.

• Support for OpenICPSR as a data provider – girder_wholetale#543.

• Create a new Tale from a specific version – ngx-dashboard#280, wt_versioning#43, girder_wholetale#536.

• Add access to advanced Tale configuration via Metadata tab – ngx-dashboard#274, ngx-dashboard#275, girder_wholetale#538.

• Improved Home/Workspace/Run performance by using NFS mounts – gwvolman#175, gwvolman#172.

• Tale catalog search is now case insensitive and includes category field – ngx-dashboard#278.

• Increase the amount of metadata stored with registered external resources – girder_wholetale#542.

• Allow to cancel long running jobs (image build, recorded run) – girder_wholetale#565, ngx-dashboard#310, gwvolman#177.

• Add metrics/actions tracking – girder_wholetale#564, gwvolman#186.

• Update repo2docker to 2022.10 and add support for Julia based images in WholeTale – repo2docker#6, repo2docker_wholetale#47.

Bugfixes

• Improved notifications handling – ngx-dashboard#291.

• Fixed file manager showing content not matching the selected tab – ngx-dashboard#265.

• FUSE DMS now properly handles empty files – girderfs#35.

• Autocreate parent directories during item/file upload – virtual_resources#20.

• Pull docker image before executing a recorded run – gwvolman#173.

• Improve error handling in Analyze in WT – ngx-dashboard#279.

• Respect repo2docker version on Tale import – girder_wholetale#549.

• Improve Dataverse DOI resolution – girder_wholetale#546.

• Fix for Dataverse DOI missing ORCID info – girder_wholetale#541.

• Improve import by using direct file access rather than WebDAV – girder_wholetale#545.

• Properly mount environment definition in the exported run-local.sh script – girder_wholetale#540.

• Fix login via OAuth2 providers other than Globus – girder_wholetale#537.

• Allow unauthenticated read access to docker registry from tasks – gwvolman#183.

• Improve error logging in Recorded Runs – gwvolman#184.

• Remove the use of deprecated method from packaging – gwvolman#187.

• Minor UI fixes – ngx-dashboard#300, ngx-dashboard#302.

• Fix the expiration period for Recorded Run related tokens – girder_wholetale#561, wt_versioning#49.

• Fix server error while trying to access non-existing virtual folder – virtual_resources#21.

• Improve detection of Instance readiness – girder_wholetale#563.

• Prevent re-registration of external data files – girder_wholetale#556.

• Fix issue with building image for Recorded Runs – gwvolman#188

• Prevent a situation where manifest doesn’t have image tag – girder_wholetale#558.

• Don’t try to update a notification that doesn’t exist – girder_wholetale#560.

• Prevent an unauthenticated user from accidentally accessing the Interact tab – ngx-dashboard#301.

v1.1

New Features

• Recorded runs (lite) using ReproZip and Docker stats – girderfs#29, girderfs#27, gwvolman#151, gwvolman#155, gwvolman#156, gwvolman#161, gwvolman#164, gwvolman#171, wt_versioning#27, wt_versioning#29, wt_versioning#30, wt_versioning#31, wt_versioning#34, wt_versioning#35, wt_versioning#38, wt_versioning#39, wt_versioning#41, ngx-dashboard#243.

• Support for installing custom STATA packages via install.do – gwvolman#154, repo2docker_wholetale#26.

• Improved image build performance/caching – gwvolman#158, gwvolman#160, repo2docker_wholetale#21.

• Updated XPRA-based envs for Stata and Matlab – repo2docker_wholetale#22, repo2docker_wholetale#24, repo2docker_wholetale#26, repo2docker_wholetale#29, repo2docker_wholetale#33, repo2docker_wholetale#37, repo2docker_wholetale#40.

• Remote iframe support for RStudio/Jupyter – repo2docker_wholetale#38.

• DERIVA integration – girder_wholetale#510, girder_wholetale#519, girder_wt_data_manager#51, wt_home_dirs#33.

• Add ability to register raw data from zip/bdbag – girder_wholetale#497, girder_wholetale#517.

• API changes for CORE2

  • Add ability to relinquish ownership – girder_wholetale#504, girder_wholetale#506, girder_wholetale#508.

  • Remote iframe support for RStudio/Jupyter (configuration change).

  • Better handling for auth originating from an external domain – girder_wholetale#511, girder_wholetale#512.

• Add ability to import non-tale datasets from Zenodo – girder_wholetale#501, girder_wholetale#516.

• DataONE publishing improvements – gwvolman#167, gwvolman#168, gwvolman#169.

• Better support for storing SSH credentials in Home – girderfs#30.

• Support for accessing private external data with user credentials – girder_wt_data_manager#47, girder_wholetale#465, girder_wholetale#531, girder_wholetale#528.

• Automatic checksum validation of external data – girder_wt_data_manager#54, girder_wt_data_manager#53, girder_wholetale#524.

• Ability to preview Tales for specific versions – wt_versioning#24, wt_versioning#37, ngx-dashboard#218.

• Allow to specify a subset of dataset during import via path – girder_wholetale#520.

• New version of WT vocabulary has been published – girder_wholetale#533.

Bugfixes

• UI fixes:

  • Properly space files in file browser for Chrome >= 91.x – ngx-dashboard#206

  • Interact tab autoupdates when container starts – ngx-dashboard#217

  • Display instances created from shared Tales in the running Tales panel – ngx-dashboard#228

  • Fix encoding in AinWT parameters – ngx-dashboard#252, ngx-dashboard#263

  • Minor improvements – ngx-dashboard#242, ngx-dashboard#257, ngx-dashboard#262, ngx-dashboard#264

• Properly preserve computation environment during import/export – girder_wholetale#515

• Better error reporting for WT FUSE – girderfs#31

• Refactor of WT FUSE – girderfs#26

• DMSFS thread safety improvements – girderfs#33

• Fix “exact name” search for virtual resource – virtual_resources#17

• Raise exception during rename if folder/item with the same name exists – virtual_resource#19

• Avoid hardcoding docker volumes mount point – gwvolman#163

• Prevent publishing the same Tale twice – gwvolman#170

• WT DMS now uses requests – girder_wt_data_manager#49

• Handle gzipped transfers in DMS – girder_wt_data_manager#52

• Correctly handle external data in exported bags – girder_wholetale#518, girder_wholetale#525

• Fix cleaning Tale data upon removal – wt_versioning#28, wt_versioning#33, wt_versioning#36, wt_home_dirs#34, girder_wholetale#499

• Provider specific fixes:

  • Dataverse

    • Port to requests and minor fixes – girder_wholetale#500

    • Utilize more metedata for creating Tales during import – girder_wholetale#464

  • DataONE

    • Use proper headers for access data – girder_wholetale#522

    • Fix integration for AinWT – girder_wholetale#532

  • Globus

    • Don’t assume type of unique id dataset uses – girder_wholetale#526

• Fix build issues in R/Rocker images – repo2docker_wholetale#27, repo2docker_wholetale#32, repo2docker_wholetale#39

v0.9

Features:

• Support for storing and using third party API keys from Zenodo, Dataverse, and DataONE

• Support for registering data from Zenodo

• Added support for publishing and importing Tales to and from Zenodo

v0.8

Features:

• A re-designed main page for the dashboard

• A new, unified, notification system

• Support for Dataverse hierarchy

• Added ability to change compute environments

v0.6

Features:

• Restructured Dashboard “Run” view

• Tale workspace support

• Ability to add/remove data to a running Tale (note: removed Data panel from Run and Compose views)

• Change to registered data model (note: now limits operations on external datasets)

• Analyze in WT support for DataONE

Bugfixes:

• Handle failures of Dataverse installation list

• Fixed issue when registering data from Globus (MDF)

• Detection/correction of internal-state desync (“blue screen”)

• Fix for Running git clone in home

v0.5

This release includes the following features. Note that with this release we’re adopting detailed release notes:

Refactor of data registration framework:

• Globus registration (whole-tale/girder_wholetale/165)

• Refactor DataONE lookup (whole-tale/girder_wholetale/177)

• Change to use DMS (whole-tale/girder_wholetale/168, whole-tale/gwvolman/30)

• Refactor task handling (whole-tale/girder_wholetale/170)

• Added Tale import support (whole-tale/girder_wholetale/173, whole-tale/gwvolman/32, whole-tale/dashboard/287)

Dataverse integration:

• Support ingest from Dataverse (whole-tale/girder_wholetale/175)

• External tools integration (whole-tale/girder_wholetale/180)

Minor changes/bug fixes:

• Optional DataMap parameters (whole-tale/girder_wholetale/178)

• Removed obsolete plugin config options (whole-tale/girder_wholetale/186)

• Lookup error handling (whole-tale/girder_wholetale/190)

• Chained redirects in DOI ( whole-tale/girder_wholetale/188)

• Add OPTIONS to methods allowed by DAV read privilege (whole-tale/wt_home_dirs/17)

• Propagate file size changes (whole-tale/wt_home_dirs/16)

• Login route handling (whole-tale/dashboard/300)

• Run Tale from view page (whole-tale/dashboard/pull/273)

• Local storage problem (whole-tale/dashboard/326)

• Allow manual configuration of Dataverse instances (whole-tale/girder_wholetale/182)

• Updated registration modal (whole-tale/dashboard/324)

• Re-enabled http check (whole-tale/girder_wholetale/181)

• Upgraded to Girder 2.5.0, no longer running as root

Deployment:

• Added DMS volume (whole-tale/terraform_deployment/38)

v0.4

This release includes the following features:

• Redesigned user interface based on user experience testing, including ability to access running tales directly (via iframes)

• Environmental variables can be passed to a running Tale, using containerConfig.environment (whole-tale/girder_wholetale#102, whole-tale/gwvolman@b4c068a0)

• Tales accept multiple sources as input data (whole-tale/girder_wholetale#98)

• WT Homes/Workspaces support moving data to other assetstores (whole-tale/wt_home_dirs#9)

• Improved monitoring and backup

v0.3

This release includes the following features:

• Automated deployment for development instances of WT

• HTTPS for frontends/Wildcard certificate support

• Migration process from GridFS to WebDav

v0.2

This release includes the following features:

• Home directories (WebDav)

• Backup of database and home directories

• Container repository of frontends

• Interface for creating new frontends

v0.1

This initial release includes the following features:

• User dashboard

• Ability to create and run tales

• Globus and ORCID authentication

• Globus, HTTP and DataONE ingestion

• Jupyter and RStudio frontends

• POSIX filesystem for remote data

• Scalable infrastructure as code