Skip to content

Release Notes

We release new versions of Calliope several times per week. The large releases are described below.

4.4093 p (22 January 2020)


  • Report group filters
    • Your can now filter the results on groups like Changes, New failures or Fixes.
  • Project profile tiles now have Summary and other group filters
    • Summary will show all changes since last run plus any repeating failures.


  • Automatically make a link out of URLs in a results description.
  • The profile/{id}/status endpoint shows more information on the status of the profile.
  • For JUnit XML besides checking for the <failure> element, we now also check for the failure="" attribute.
  • Added a search to the Gitlab repository selection.
  • Showing repository namespace instead of name. So it now includes the project a repository is in.


  • Optimize Fink reports for historical comparison.
  • Hide the graph on the profile overview page when no results have been uploaded.
  • Gitlab integration showing unclear warnings when the API token was invalid.
  • Changing Gitlab settings did not always change the ownership.
  • Download links not being updated when going to previous report.
  • Visual errors on the company invite panel.
  • If the uploaded file's Mime Type could not be found, it was not saved.
  • Combining Calliope Json files in an upload would overwrite each other.
  • Multiple issues in report Edit mode.
  • Result timeline not hidden when there is no history on the result.

4.4017 p (12 December 2019)

Performance improvement:

  • Some reports became (very) slow to load when a larger history was build up.
    • Performance improved significantly for these cases (From > 30 seconds down to 5 seconds or less)
  • Improved efficiency of loading a cached report. Once cached, loading the report is almost instant.

Bug fixes:

  • On the project overview page, reports would overflow frm its containers.
  • Icon missing for Burp reports

4.3999 p (10 December 2019)

New formatter:

Burp security reports

Reworked report details:

  • Moved elements to more logical and space efficient locations
  • Made the pie-chart clickable for filtering
  • Smoother animations and effects
  • Improved styling and positioning of elements

Bug fixes:

  • Issue where sometimes embedded datatables were not shown.
  • We assumed that a Cucumber file was always Base64 encoded.
  • Logs not showing on the report overview page anymore.
  • Improved file type detection performance

4.3874 p (29 October 2019)

New features

  • Automatically detect and set the user's timezone.
  • More graceful loading effect when switching between reports.


  • Report performance:
    • Update UUID primary keys to integer ID's.
    • More efficient looping through certain report objects.

Bug fixes

  • Report date jumping to a different time after page load.

4.3800 p (17 October 2019)

New features

  • Historical data:
    • Compared information to last uploaded report.
      • New / Fixed / New Failure / Changed / Failed x times
    • Historical timeline in the result details showing the last 5 results.
  • Status hash:
    • Besides the absolute status of a result (Passed / Failed / Etc.), we now generate a unique hash based on the Status, Exception name / backtrace / description. This way we can distinguish one failure from another.
  • Zaproxy:
    • Grouped results by method and url to prevent repeating issues on the same page.
    • Showing problem and solution in a more readable manner.

Other improvements

  • Better visual indication of container depth in report details.
  • Opened containers / results will stay opened when moving to next or previous report.
  • Better slide animations for opening and closing containers.
  • Updated the Stripe payments API.
  • Redesigned the company subscriptions page.
  • Super admins can now re-initialize, clear cache and pre-cache reports.
  • A lot of performance improvements when saving and updating reports.
    • Improvements barely noticeable due to the heavier load times for historical information.
  • Renamed the reports page to "Overview" in the breadcrumb.
  • Changed breadcrumb to show "Report details: {report date}" when on the report details page.
  • Sharing graphs by link is now an absolute link and will be remembered after logging in.
  • Reload report when closing edit mode to prevent caching issues.
  • Next / Previous report button now includes how much time ago it was.

Bug fixes

  • Timezone issues.
  • Copy to clipboard.
  • Reduced batch upload side to 1 for the manual uploader.
  • Scrolling and tooltip issue in the manual uploader.
  • Terms and conditions could be ignored by going to a different URL.
  • Errors for T&C were not displaying correctly.
  • "Removed UTF-8 characters" warning showing for every import.
  • Going to next report from report overview always brings you to the newest report.
  • Added a warning when trying to change your own role in a company.
  • Import bar disappearing when toggling certain filters on the report detail page.
  • Being able to select filters in the graph that show as disabled.
  • Some 404 pages didn't have styling.

4.3614 p (10 September 2019)


  • Improved report graph:
    • Added the possibility to toggle all lines.
    • Date range selector to show a bigger history (Free users have a limit of 30 reports)
    • You can now click a data point to go to the report detail page.
    • Other options: Full screen view, share link, download as image.
  • Go to next / previous report from report detail page.
  • Improved some form validations.
  • Many minor bug fixes.

4.3547 p (20 August 2019)


  • NEW FEATURE: Getting started wizard for companies and users.
    • This wizard will help you set up the basics of a workspace.
  • Reworked private workspace
    • All profiles of existing private workspaces are merged into 1 project.
    • Private workspace is always present in the left navigation.
  • Created a Demo company for everyone to see.
    • This way new or existing users can get inspired on how to use Calliope.
    • First visit to the Demo company will show a small tutorial.
  • You can now invite a user as a specific role.
  • Improved on page notifications.
  • Redesigned the left side menu.
  • Improved the dashboard pages.
    • Includes a better overview of what you can do when you log in.
  • Many small bug fixes and logic improvements.

4.3402 p (8 July 2019)


  • New formatters:
    • NUnit
    • XUnit
  • Improved the uploader:
    • Now shows upload progress.
    • Now shows processing status.
    • Added tooltips for more clarity.
    • Some styling improvements.
    • Added possibility to upload a blank report.
  • New feature: Auto-date, will look inside the report if it contains any timestamp and uses that.

4.3375 p (19 June 2019)


  • Uploader improvements:
    • Displays more information about your upload.
    • Included extra tabs with API call information.
    • Added hold shift functionality to quick upload.
  • Completely removed the old uploader
  • Multiple bug fixes.
  • Improved Zaproxy reporting.
  • Added toggle all results button to result view.

4.3343 p (19 June 2019)


  • NEW FEATURE: It is now possible to re-position your Projects and Profiles
  • Improved the manual uploader feature by adding more drop-able elements and a more seamless flow.

4.3220 p (29 May 2019)


  • NEW FORMAT: Fink link checker
  • NEW FORMAT: Calliope Json.
    • This means you can now copy your results to a new profile.
  • NEW FEATURE: Importing with the smart parameter.
    • For some formats we will try to improve the layering of results to make them more useful.
  • NEW FEATURE: Quick uploader now supports uploading multiple files (combined or separate).
  • NEW: Added info icons to multiple elements, to give more details about the functionality.
  • Multiple minor user experience improvements.
  • Multiple minor bug fixes.
  • Improved visibility of functions if there is no permission to use them.
  • Improved and clarified the API import docs:

4.3214 p (8 May 2019)


  • Improved some super admin functionality to be able to better manage the system.
  • Improved quick upload.
  • Disabled some functions for read only users instead of showing an error after using it.
  • Multiple minor bug fixes.
  • Edit report update:
    • Report dates are now editable.
    • Report OS, Platform & Build are now editable.
    • It's now possible to now add or remove containers.
    • It's now possible to now add or remove results.
    • Improved performance switching between edit mode and view mode.
  • Added an indicator of what filters are active on the report detail page.

4.3025 p (30 April 2019)


  • NEW: Multifile support (combine multiple files into 1 report).
  • UPDATE: Line chart updated to a filled chart.
  • UPDATE: Edit report:
    • You can now edit container and result titles.
    • Also result text fields are editable.
    • Now possible to upload new assets to a result.
    • Improved the design for saving files.
  • Many bug fixes.
  • Multiple Design / UX improvements.
  • Redesigned the view for a failed import.

4.3023 p (8 April 2019)


  • NEW: Quick upload, a form on your dashboard to easily upload results.
  • NEW: Report details action area, a more obveous area with all the options and settings for your report.
  • NEW: Edit mode for reports, instantly make the status of your report editable and change the results to how you want them.
  • NEW: We're now visibly showing the Calliope JSON format to download.
  • UX: Improved the report page layout to make it better usable for all viewports.

4.2905 p (27 Mar 2019)


  • Multiple minor bugfixes.
  • Multiple design fixes.
  • A number of security fixes.
  • Small performance improvements.
  • Prepared multiple functionalities for a larger update in the future.

4.2698 p (7 Feb 2019)


  • Report numbers now show as a flex-bar instead of static numbers.
  • Latest failures are now in the same design as the report details page.
  • Latest failures result now opens in a side pop-up.
  • Performance improvements by loading result data asynchronously.
  • Added some new API endpoints to prepare more asynchronous functions.

4.2478 p (15 Jan 2019)


  • New supported format: TestNG
  • Improved API endpoints, documentation and responses:
  • Reworked the way an import works:
  • OLD: Posting a faulty report results in an error response code.
  • NEW: Logs are generated during the import and attached to the report, resulting in a 202 - Accepted response code and the warnings attached.
  • Many bugfixes and small improvements to the user experience.

4.2307 p (29 Nov 2018)


  • Feature: You can now delete a report
  • Unified the email design.
  • Added runtime to history page
  • Showing runtime in minutes or hours when relevant (instead of always in seconds)
  • Multiple minor bugfixes

4.2281 p (09 Nov 2018)


  • New report detail slide popup
  • Added a 401 error page for unauthorized data
  • Improved maintenance window functionality
  • Multiple minor bugfixes

4.2246 p (06 Nov 2018)


  • Improved the error details on a failed uploaded report
  • Added possibility of XML reports to contain <testcase> as top level
  • Multiple minor bugfixes

4.2223 p (30 Oct 2018)


  • New and improved report details page
  • Added filters to the report detail page
  • Improved upload report modal
  • Improve error handling for unknown test result files
  • minor bugfixes

4.2148 p (22 Oct 2018)


  • Officially moved to the new results db structure for all pages
  • Final tweaks for the public launch
  • Improved breadcrumbs
  • Unifying upload API, dont import into the old db structure anymore
  • Minor bugfixes

3.2079 p (12 Oct 2018)


  • Launch of the new smart dashboard.
  • Integrated mailchimp newsletter functionality
  • Simplified terms and conditions page
  • Upgraded Mysql to latest version
  • Added maintenance page
  • Deeplink to subscription page
  • Minor bugfixes

3.1936 p (3 Oct 2018)


  • First release with Integrated credit card payments with subscriptions
  • Added Welcome email
  • Moved the smartboard out of the alpha to beta phase
  • Minor bugfixes

3.1831 p (27 Aug 2018)


  • Alpha version of the new profile history page
  • Implement live search for company selection
  • Adding Welcome email for new users that signup through the new landing page. Admins can trigger the welcome email through the account page of the user
  • Removing contact form functionality, this moves to the new landing page.
  • Display the number of total results in test result overview
  • Minor bugfixes

3.1366 p (22 Aug 2018)


  • Alpha version of the new profile history page
  • Implement live search for company selection
  • Adding db script to cleanup old unused test results
  • Adding support for screenshots in scenario outlines
  • Moving over to the latest chrome59 and FF54
  • Minor bugfixes

3.966 p (15 June 2018)


  • Implemented account management including role management within companies
  • Added Google sign in functionality
  • Use sc and wildcard cert for all environments
  • Update deployment readme
  • Minor bugfixes

2.798 p (12 Jul 2017)


  • Preparation for moving the application to the app subdomain to support separate commercial landing page for (dev, test and staging have the subdomains (app-dev, app-test, app-staging respectively)
  • Removing current landing page items.
  • Moving environments back to their own environment and not docker. We cannot configure each environment properly else.
  • Adding version and environment information in the footer
  • Rails 5 and docker requires mentioning which port to listen on, added to Dockerfile
  • Limit the logfile length in test result history, it takes too long to load if the output is very long. Added download link for cucumber output for normal users so you can still see the complete logfile


  • Give correct message when you disable a schedule
  • Stick with node 7.4. Node 8 fails to build the user api

2.697 (12 Jul 2016)


  • Big security upgrade to rails 5 and various bugfixes
  • Upgrade from Rails 2 to the newest Rails 5 framework
  • Start using Rails5 asset pipeline for images.
  • Support Chrome for regular users
  • Quick usability tweaks
  • Integration with bootstrap for if we want to change the UI


  • Remove old functions and code from perftest functionality
  • Remove typo in error message if no workers are found

1.457 (11 Feb 2016)


  • Creating the last stable release before moving to rails 5.
  • Improving integration with test execution backend


  • Links in sent email should always be https
  • Links in email should link to the current environment (e.g. staging, test, etc) and not production
  • Password reset doesnt work in some situations (already hotfixed on production)