Skip to content

Release Notes

We release new versions of Calliope regularly. The major releases are described below.

Join us on Slack and let us know what you think.

Upcoming features

  • Jira configuration of automated ticket creation
  • Simplification of on-boarding flow
  • Comparison of runtime on results
  • Simplified interface for Company overview and group pages

2022-05-24: Severities and migration of integration to company level

FEATURES:

  • Severity support for security reports
    • Added 2 severity charts to visualize current number of severities and a timeline showing change in severities
  • Possibility to sort report containers by title, severity, position or status

IMPROVEMENTS:

  • Overhaul of integrations more info here
    • Moved to Company level, so no need to add it all per profile
    • Added configurations for integrations
    • Important: Added a migrate options for easy migration of the old setup
  • Removed Slack-user principle
  • Added Slack integration to profile that subscribes to it
  • Improved notifications for profile ownership
  • Added the report tags to the report summary email
  • Changed the password fields to have a popover with the requirements that update while you type
  • Improved the encryption of secure data, handling API keys and webhooks like password
  • Improved tooltips of multiple charts
  • Improved profile history chart tooltip and better click-point of nodes

BUGFIXES:

  • Resolved an issue with report dates
  • Sorting in tables with empty columns
  • Fixed an issue with the group parent drop down
  • All results can be expanded even if there is no history or other data
  • Fixed a typo in failed imports in the profile tiles
  • Whitespaces around the Calliope logo are now not clickable
  • Fixed an issue with an empty TestNG report
  • Inverse icons on the expand/collapse all result button

2022-04-06: Webdriver IO support and multiple bugfixes

FEATURES:

IMPROVEMENTS:

  • Improved Mochawesome support for a WDIO variant.
  • Added password requirements preview to reset password field
  • Better accessibility to copying a profile ID
  • Upgrade to the latest Font Awesome icon set
  • The merge containers feature now also merges containers with results together, when possible

BUGFIXES:

  • Company information wizard step was not marked as completed when expected
  • User wizard contains invalid verify account link
  • User wizard link redirecting to a 404 page
  • Terms and condition page not showing as expected when already accepted the terms
  • Link should be disabled for read only as they can't see the target page
  • Resend invitation message not displayed
  • Mark all notifications as read button shows even though there is nothing to mark as read
  • GitLab play button functionality unclear when integration is set up
  • Quick upload files uploaded to wrong profile or wouldn't create a new profile
  • Report dates can be set in the future
  • Download profile graph button didn't work on Chrome
  • Report results container would scroll to the top when adding a new result in edit mode
  • On unexpected errors in the API endpoints JSON should be returned instead of HTML
  • Unable to delete a result asset in edit mode
  • Close results container tooltip would keep showing after clicking it, causing an infinite horizontal scrollbar
  • Issue opening a report container with exactly the same title as another one
  • Fix issue with invalid time saved for a report date

2022-03-10: Upgrades and bugfixes

IMPROVEMENTS:

  • Upgraded multiple software components to the latest stable versions to improve security, performance and compatibility.
  • Improved user flow after confirming account
  • Database reliability improvements

BUGFIXES:

  • Issue with user session not being remembered for longer than 1 day
  • Info panels on the dashboard page having different heights
  • Issue with manual uploader when cancelling and re-selecting a file
  • Invalid message displayed when limit reached using the manual uploader
  • Unclear requirements to complete the company information wizard step
  • NUnit link redirecting to the wrong docs page
  • Docs about finding profile ID had old screenshots
  • Deleting profiles with a large amount of reports would sometimes cause a server timeout

2022-02-02: Jira Integration

FEATURES:

  • Jira integration MVP
    • This will allow automatic link generation of jira ticket keys.
    • This is an MVP, meaning we will add more features around this integration, like automatically creating tickets from a report.
  • Profile Owner
    • A profile owner will be information with any unexpected failures in a profile. For example when the Jira integration fails.

IMPROVEMENTS:

  • Calliope JSON improvements:
    • Added support for screenshots through Base64 or attachment.
    • Added support for tags.
  • Report details page:
    • Removed beta badge from Edit Mode.
    • Added a details-button to every container to be able to see the full description and edit it.
    • Redesigned the delete, move up/down buttons.
    • Improved the layout on editing result details.
    • Added inline markdown support for container and result title.
    • Added tooltip when editing a markdown supported field that shows a preview of your text.
    • Added edit field for result duration.
  • Give more details about the send email summary button on the report page,

BUGFIXES:

  • Issue around text not becoming ellipses when it doesn't fit in a report container anymore.
  • NUnit was still using old metadata instead of custom tags.
  • No warning was displayed when refreshing page while having unsaved data.
  • Moderators were able to access the company wizard.
  • Sorting icons were not displayed on some data tables.
  • No view password option on the reset password form.
  • Empty value visible in timezone dropdown.
  • Company tags page not visible for read only members
  • User not automatically joining company after registering through invite.
  • Some old documentation pages still referred to ProjectId instead of GroupId
  • Some dropdown fields would not adjust width when resizing the browser window.
  • In some cases it would not be possible to delete a result.
  • Bootstrap tooltips not showing after something reloaded on the report details page.

2021-12-16: Semantic API import

FEATURES:

  • Semantic imports
    • Automatically create groups and profiles through the import api endpoint.
    • E.G. https://app.calliope.pro/api/v2/company/my-company/group/unit-tests/profile/development/import/junit
  • Support for short test cases in Gherkin using @auto_populate . More info here
  • Added documentation for PyTest.

IMPROVEMENTS:

  • Better support for comments in the Gherkin formatter.
  • Updated email layout generator to latest version improving the quality of emails.
  • Add more information to multiple authorization warnings to give a better understanding of the cause.
  • More readable styling for Copy fields.

BUGFIXES:

  • Groups and profiles without an ID causing errors on some pages.
  • Making a failed report public would cause some loading issues.
  • HTML in company name being rendered in some places.

2021-11-29: Report tags

FEATURES:

  • You can now add report tags to an import.
    • Added a company tags page to see all tags used in a company.
    • Added a tag details page, listing all reports that use the selected tag.
    • Added possibility to add/remove tags from existing reports.

IMPROVEMENTS:

  • Improved the user newsletter page to be able to subscribe/unsubscribe in a single click.
  • Greatly improved the support for Safari browsers.
  • Added documentation for better Robot Framework results.
  • Hide and disable a number of buttons that can't be used by read only users.
  • Moved invite company user form to a separate page.
  • Make <environment> tag optional for NUnit XML reports.

BUGFIXES:

  • Import message not escaping code correctly.
  • Error shows when sorting the reports table by profile.
  • Incorrect email when setting someone else's notification subscription to never.
  • Guest using public report could see the names of other groups and profiles within a company.
  • Multiple errors when a users' session has timed out.
  • Timezone issue on schedules and report date.
  • Better tooltip information on profiles when the name is shortened by ellipses.
  • When filtering informational, the no result-text would show empty.
  • Font style issue on runtime for reports table.
  • Fix in uploader trying to upload a report file to a sub-group.
  • Better handling of multiple edge-cases when a login session has timed-out navigating to a specific page.

2021-10-20: Robot Framework improved

FEATURES:

  • Robot Framework:
    • We now support screenshots.
    • When attaching the report.html and log.html referral links will keep working.
    • Completely zipping and uploading the results folder to Calliope will work.
    • Some fixes around showing invalid failures or passes.

IMPROVEMENTS:

  • Instead of saying "something went wrong" on a failed report, we now directly show the error message.
  • Add a failed-tag to a failed report.
  • Prioritize the passed status over a skipped status (so a container with passed and skipped results, will show as passed).
  • Changed color scheme for secondary buttons.
  • Multiple import messages are improved by adding documentation or clarification.
  • Fink will now show any 100 - 399 http-response as passed.
  • Upgraded Gherkin parser to latest version.
  • Add more details when multiple files fail during importing.
  • When the content of a description becomes too large, we now check if it's text, html or json and store it accordingly.
  • Registration form validation is now instant.

BUGFIXES:

  • Incorrect redirection registering successfully after a failed registration.
  • Javascript crashed when a browser would not support push notifications.
  • Mobile: Dropdown menu in sidebar would overflow screen width.
  • Mobile: Notification dropdown would overflow screen with when containing large content
  • Report filter icons overflow button when using more than 3 filters simultaneous.
  • Fixed some files not being found as attachment due to a front-slash vs back-slash issue.

2021-10-09: Security scans, Upgrades & bugfixes

FEATURES:

  • Added a security scan tile referring the user to our integrated security scanning service.
  • Gherkin formatter now supports comments.

IMPROVEMENTS:

  • Upgraded to the latest Bootstrap 5
  • Show container description as light text next to the container title.
  • Allow Markdown in container titles and result titles.
  • Make the Informational status editable and filterable.
  • Reworked the policy flow checking if someone is allowed visiting a page or doing an action.
  • Updated the flow if a limit is reached, by showing the create (group/profile) page with a diagram of the limits.
  • Cucumber formatter now support cases of using After Steps and multiple before/after elements for a single result.
  • Improved performance checking the validness of a file before trying to process it.
  • Update support for latest lighthouse version.
  • Improved warnings and errors when a file was incompatible for a formatter.
  • Show a specific warning when a Postman Collection is uploaded instead of test result.
  • When clicking the top navigation upload-button, it will now pre-select the current group/profile you're on.

BUGFIXES:

  • Multiple problems filtering and setting report elements to status Informational.
  • Issue profile/group page freezing when a latest report contains over 10000 results.
  • Close all open notification dialogues before opening another one.
  • Prevent Read Only users from seeing GitLab warnings.
  • Fix hover issue in status drop downs in edit mode.
  • Edge case getting a server ResultAsset::ImporterWarning warning instead of a more user friendly message.
  • More details in the warning message when someone uploads a HTML file.
  • Hide errors when a request was aborted.
  • Fix multiple typo's for old API endpoints or still using projects instead of groups.
  • Report page would show with containers and a critical error when there are no results.
  • Issue with hidden files in Mac generated zip files.
  • Issue not being able to delete your account if the email address contains a html-entity like < or &
  • Fixed JUnit to be more accepting of missing name attributes.
  • Long company names not showing inline where it should.
  • Error message not including the correct limit text.
  • Top navigation dropdown breaking when a company has more than 20 groups.
  • Sorting reports list by profile would show an error.
  • On the public sharing page, if a company has no website set, it would open an empty window.
  • Company overview page would show an empty space if a profile was created, but no report uploaded yet.
  • Redirect issue coming back from a create group page.
  • Going to a company without groups as read only user.

2021-09-31: Public reports

FEATURES:

IMPROVEMENTS:

  • Improved tag view on small reports, including latest and public if that's the case.
  • Gracefully catch case if a user session ends while in edit mode.
  • Stop considering all containers new when it's the first upload of a profile.
  • Updated version support for some formatters:
    • Burp: Add support for version 2.2
    • Lighthouse: Add support for version 7
    • Robot Framework: Add support for version 4
  • Inform how many containers were combined together when using the merge_containers option.

BUGFIXES:

  • Report tags not updating as expected when moving from one report to another.
  • Hide existing notification dialogues if a new one appears.
  • Email top navigation was not similar enough to the application.
  • Going from loading state to loaded state in the report view, there was a 1 pixel shove.
  • Fix Fink not being recognised as formatter if there is only 1 result.
  • Issue where Microsoft Office files (like .xls or .docx) are recognised as zip archives.
  • Issue uploading a corrupted empty zipfile.
  • Issue where UTC time was displayed instead of local time.
  • Quick upload icons overlapping form in between large and small screen width.
  • Make the create group button disabled if a user has no permissions to create a group.
  • Fix email notification preference link going to the wrong page.
  • Removed company image from email due to security risk on using external sources in the emails.
  • Breadcrumb icons overlapping dropdown icons instead of becoming ellipses.

2021-08-03 Recursive Grouping and Gherkin feature support

FEATURES:

  • NEW FORMATTER: Gherkin feature files:
    • Import your Gherkin feature files to Calliope to generate a blank report.
    • Supports a wide range of languages.
  • Projects has been replaced by groups and sub-groups:
    • Allows organising your projects in a more dynamic way.
    • Subgroup your profiles up to 6 levels deep.
  • Added documentation for implementing Knapsack Pro.

IMPROVEMENTS:

  • Breadcrumb items:
    • Spread more evenly and shows ellipses more naturally.
    • Better support for tablet and mobile view.
  • Reworked company overview:
    • Now shows all Groups and Profiles in 1 list.
    • Displays the latest report.
  • Improved the feedback while editing a report and your session expired.
  • Improved the feedback message when uploading only HTML reports.
  • Autofocussing input fields on profile and group settings.

BUGFIXES:

  • Fixed issue with report summary filter showing empty report.
  • Fixed issues around date/time not respecting the user's timezone.
  • Fixed an issue where users received a report email while the Slack notifications are set.
  • Fixed text cropping issues on the edit report page.
  • Increased security not allowing the system to redirect to any non-whitelisted addresses.
  • Issue with history not being compared and saved as expected when using multiple files.
  • Fixed login form elements still being clickable when sliding to the sign-up form.

2021-07-07: Asynchronous importing

FEATURES:

  • Asynchronous import processing
    • Faster response times for large imports.
    • Making Calliope prepared for more growth.
    • Shorting loading times due to predictive caching.
    • Updated report details page interface to display the progress of processing the report.
    • Added /report/{reportId}/status API endpoint to keep track of the processing status.
  • Invalidate user sessions on all devices when a user logs out manually.

IMPROVEMENTS:

  • Updated many dependencies to the latest versions.
  • Instead of escaping HTML, we now sanitize it, allowing basic, non-xss html.
  • Show a custom message when an empty zip file is imported.
  • Add an import warning message when a report file is older than 24 hours.
  • Show user icon in the import details dialog.
  • Changed minimum password length from 6 to 8 characters.
  • Allow longer project names.

BUGFIXES:

  • Company invite not being send the first time someone is invited.
  • Email icons not showing on GMail.
  • Long title text overflowing in results container.
  • Import messages sometimes overflowing out of its container.
  • Read only user was able to see the edit mode interface, but not save anything.
  • Deleting a large report could sometimes take a long time.
  • Javascript breaking when a browser does not support push notifications.
  • Notifications not always being send with the correct conditions.
  • Searching company member displays an error.
  • Fixed multiple typo's on the docs pages.
  • Uploading certain file types returned a 500 error instead of showing failing import messages.
  • Error pages were showing the zero in an error code not inline with the rest of the numbers.

2021-06-16: Bugfix release

IMPROVEMENTS:

  • Performance improvement on opening reports with containers that contain a lot of results.
  • Renamed 'Settings' to 'Information' in the company dropdown to make it consistent.
  • Improved readability of the 'members' page of companies on mobile.
  • Showing how many days are left until the next month for subscriptions.
  • Showing a message when there is an empty report uploaded.

BUGS:

  • Fixed a 404 error going to Gitlab integration.
  • Fixed Email layouts in Gmail.
  • Fixed breadcrumb on integration pages.
  • Fixed issues with JUnit report import dates.
  • Fixed issues with container status switching.
  • Fixed resizing issue on the Gitlab integration settings.
  • Fixed some HTML showing in active notifications.
  • Fixed error layout issues on the 'Reset password' page.
  • Fixed an issue with uploading empty JUnit reports.
  • Fixed an issue with the ignore_max_files_limit import option.

2021-06-06: GitHub & Travis CI support

FEATURES:

IMPROVEMENTS:

  • Deleting a company now also has a separate page explaining what is required to be able to delete it.
  • Some tables are now populated a-synchronously, to improve page load time.
  • Use Gravatars Identicon instead of the mystery person icon when not set.
  • Show parent container title in the result-container sidebar when showing the results.
  • Redesigned report result numbers showing in a more efficient manner.
  • Use SVG icons instead of PNG where possible.
  • Updated payment system:
    • We now make use of Stripe Checkout and Stripe Portal, leaving the subscription payment and management to them.
  • Reduced the font size in form elements to the same as all other fonts.
  • Added an extra indicator when a user has the read only role in a company.
  • Set maximum of scheduled profiles to once per 5 minutes.

BUGS:

  • Mobile view:
    • Better visibility of company name in dropdown.
    • Responsiveness of upload form breaks.
    • Text falling out of container.
    • Nothing happening when pressing send email summary.
    • Pressing share link on report page didn't work.
    • Fix breadcrumb menu dropdown tags displaying incorrect.
  • Multiple text-elements not dynamically showing ellipses when text is too long.
  • Import messages missing on report details page.
  • Fix for toggling containers created in edit mode in the same page load.
  • Report results number overflowing when going over 1999 results.
  • Subscription not being cancelled when payment was declined.
  • Robot Framework containers not always showing the correct data.

2021-03-24: Report assets

FEATURES:

  • Added report assets to the report view.
    • Also possible to add and delete them from edit mode.

IMPROVEMENTS:

  • Big rework on the layout of the reports pages:
    • Many of the buttons are now moved to the left-side navigation.
    • Moved os/platform/build to the report name as tags.
  • Better special character support (Upgraded from UTF8 to UTF8MB4)
  • Upgraded from Ruby 2.6 to 2.7
  • Better grouping by classname attribute of JUnit reports.
  • Combine containers and sub-containers if the sub-container only has 1 sub-container.
  • Documentation improvements:

BUGS:

  • Fixed issue with merge_containers that positions were not updated after merging
  • Fixed issue with JUnit and grouping containers by the classname.
  • Fixed not redirecting to the profile overview page after saving changes.
  • Invalid link to the Swagger documentation
  • Fixed full report button wrapping words.

2021-03-03: Lighthouse & Nessus support

FEATURES:

IMPROVEMENTS:

  • Better algorithm to decide if a container should be expanded automatically.
  • Added import option suppress_notifications to prevent a notification to be sent when importing a report.

BUGFIXES:

  • Copy text notification showing chain icon multiple times.
  • Not scrolling back up when going to different results container.
  • Results without a status should not display a history.
  • Some API endpoints returning a wrong url for the logs page.
  • Buttons in alerts having an underlined text.
  • Text color in alerts sometimes not readable due to lack of contrast.
  • File extension sometimes different from Mime Type. (XML Mime Type generated XLS extension)

2021-02-15: Following profiles

FEATURES

  • Created a generic notification method, allowing us to easily send simple messages to a user.
  • Profile followers overview page to see all company members who are following a profile.
    • As a moderator, you can now set another company member to follow a profile.
      • This will inform the user that they're now following a profile using the new generic notification method.

IMPROVEMENTS

  • Dropped support for TLSv1 to improve the security of a connection between browser and server.
    • This means that (very) old browser won't be able to access Calliope Pro: Chrome 21, Firefox 23, IE 10, Safari 6, Opera 12.0, iOS Safari 5.0
  • Dropped last bits of support for a legacy a-sync tasks runner.
  • Slack report status message showing a line on the left side, indicating a good (green), medium (orange) or bad (red) status.

BUGFIXES

  • Width of role dropdown in members page can become too small.
  • Form validation checkmark overlaps dropdown button in select fields.
  • An icon inside an avatar circle is not in the exact vertical center.
  • Scrollbar in notification dropdown showing, even when it's not exceeding the maximum height.
  • Long messages in the notifications drop down could break the maximum width causing a horizontal scrollbar.
  • Edge case where a notification could cause a page not to load anymore.
  • Issue with push notifications not being send.

2021-02-01: Slack integration

FEATURES

  • Completely reworked the notifications system adding many improvements and features:
    • Slack integration for Report notifications. (See docs)
    • Push notifications for Report notifications. (See docs)
    • Improved in-app notifications (Notification bell).
    • Added report notifications to the in-app notifications.
    • Created a dedicated notifications page to manage all your notifications.
  • Delete profile and project page instead of a simple are you sure? warning to prevent accidental deletions.
    • Allowing a quicker way to delete a project full with profiles.
  • Using Gravatar as avatar provider for the user icon.

IMPROVEMENTS

  • Improved the styling of emails.
    • Report notification now shows more and clearer information.
  • When reaching a limit, all moderators and above will receive a notification.
    • Instead of where previously it showed a constant warning under the notification bell.
  • When an import failed, the sender of the API call will always be notified.
    • This is to prevent an import failing for a longer time unknowingly.
  • Removed maximum height on report result fields, to prevent scrolling-in-scrolling windows.
  • Newman documentation
  • Added re-send button to invited user list.
  • Top navigation dropdown now goes over a notification dialogue instead of under it.

BUGFIXES

  • Some links not working when not clicking exactly on the text.
  • Being able to invite new members while the maximum users in a company limit has been reached.
  • Fixed edge case situation where an API call with Content-Type:multipart/form-data is done, but the content is send as a body causing a 500 server error.
  • Fixed some styling issues in the report numbers.
  • Fixed url location not being restored after logging in.
  • Fixed allowing some email addresses when inviting a user to a company that are not allowed when creating a new account.

Release archive

Release notes archive