Skip to content

Release Notes

We release new versions of Calliope regularly. The major releases are described below.

Join us on Slack and let us know what you think.

2022-12-16: Security updates and public report fixes

IMPROVEMENTS:

  • Updated various libraries and frameworks for security updates
  • Public profiles show more summary information

BUGFIXES:

  • Public profiles are now also working 3+ levels deep in groups

2022-10-14: Security updates and profile delete fix

IMPROVEMENTS:

  • Improve docker setup
  • Updated various libraries and frameworks for security updates

BUGFIXES:

  • Delete profile now also works when it has linked integrations

2022-05-24: Severities and migration of integration to company level

FEATURES:

  • Severity support for security reports
    • Added 2 severity charts to visualize current number of severities and a timeline showing change in severities
  • Possibility to sort report containers by title, severity, position or status

IMPROVEMENTS:

  • Overhaul of integrations more info here
    • Moved to Company level, so no need to add it all per profile
    • Added configurations for integrations
    • Important: Added a migrate options for easy migration of the old setup
  • Removed Slack-user principle
  • Added Slack integration to profile that subscribes to it
  • Improved notifications for profile ownership
  • Added the report tags to the report summary email
  • Changed the password fields to have a popover with the requirements that update while you type
  • Improved the encryption of secure data, handling API keys and webhooks like password
  • Improved tooltips of multiple charts
  • Improved profile history chart tooltip and better click-point of nodes

BUGFIXES:

  • Resolved an issue with report dates
  • Sorting in tables with empty columns
  • Fixed an issue with the group parent drop down
  • All results can be expanded even if there is no history or other data
  • Fixed a typo in failed imports in the profile tiles
  • Whitespaces around the Calliope logo are now not clickable
  • Fixed an issue with an empty TestNG report
  • Inverse icons on the expand/collapse all result button

2022-04-06: Webdriver IO support and multiple bugfixes

FEATURES:

IMPROVEMENTS:

  • Improved Mochawesome support for a WDIO variant.
  • Added password requirements preview to reset password field
  • Better accessibility to copying a profile ID
  • Upgrade to the latest Font Awesome icon set
  • The merge containers feature now also merges containers with results together, when possible

BUGFIXES:

  • Company information wizard step was not marked as completed when expected
  • User wizard contains invalid verify account link
  • User wizard link redirecting to a 404 page
  • Terms and condition page not showing as expected when already accepted the terms
  • Link should be disabled for read only as they can't see the target page
  • Resend invitation message not displayed
  • Mark all notifications as read button shows even though there is nothing to mark as read
  • GitLab play button functionality unclear when integration is set up
  • Quick upload files uploaded to wrong profile or wouldn't create a new profile
  • Report dates can be set in the future
  • Download profile graph button didn't work on Chrome
  • Report results container would scroll to the top when adding a new result in edit mode
  • On unexpected errors in the API endpoints JSON should be returned instead of HTML
  • Unable to delete a result asset in edit mode
  • Close results container tooltip would keep showing after clicking it, causing an infinite horizontal scrollbar
  • Issue opening a report container with exactly the same title as another one
  • Fix issue with invalid time saved for a report date

2022-03-10: Upgrades and bugfixes

IMPROVEMENTS:

  • Upgraded multiple software components to the latest stable versions to improve security, performance and compatibility.
  • Improved user flow after confirming account
  • Database reliability improvements

BUGFIXES:

  • Issue with user session not being remembered for longer than 1 day
  • Info panels on the dashboard page having different heights
  • Issue with manual uploader when cancelling and re-selecting a file
  • Invalid message displayed when limit reached using the manual uploader
  • Unclear requirements to complete the company information wizard step
  • NUnit link redirecting to the wrong docs page
  • Docs about finding profile ID had old screenshots
  • Deleting profiles with a large amount of reports would sometimes cause a server timeout

2022-02-02: Jira Integration

FEATURES:

  • Jira integration MVP
    • This will allow automatic link generation of jira ticket keys.
    • This is an MVP, meaning we will add more features around this integration, like automatically creating tickets from a report.
  • Profile Owner
    • A profile owner will be information with any unexpected failures in a profile. For example when the Jira integration fails.

IMPROVEMENTS:

  • Calliope JSON improvements:
    • Added support for screenshots through Base64 or attachment.
    • Added support for tags.
  • Report details page:
    • Removed beta badge from Edit Mode.
    • Added a details-button to every container to be able to see the full description and edit it.
    • Redesigned the delete, move up/down buttons.
    • Improved the layout on editing result details.
    • Added inline markdown support for container and result title.
    • Added tooltip when editing a markdown supported field that shows a preview of your text.
    • Added edit field for result duration.
  • Give more details about the send email summary button on the report page,

BUGFIXES:

  • Issue around text not becoming ellipses when it doesn't fit in a report container anymore.
  • NUnit was still using old metadata instead of custom tags.
  • No warning was displayed when refreshing page while having unsaved data.
  • Moderators were able to access the company wizard.
  • Sorting icons were not displayed on some data tables.
  • No view password option on the reset password form.
  • Empty value visible in timezone dropdown.
  • Company tags page not visible for read only members
  • User not automatically joining company after registering through invite.
  • Some old documentation pages still referred to ProjectId instead of GroupId
  • Some dropdown fields would not adjust width when resizing the browser window.
  • In some cases it would not be possible to delete a result.
  • Bootstrap tooltips not showing after something reloaded on the report details page.

2021-12-16: Semantic API import

FEATURES:

  • Semantic imports
    • Automatically create groups and profiles through the import api endpoint.
    • E.G. https://app.calliope.pro/api/v2/company/my-company/group/unit-tests/profile/development/import/junit
  • Support for short test cases in Gherkin using @auto_populate . More info here
  • Added documentation for PyTest.

IMPROVEMENTS:

  • Better support for comments in the Gherkin formatter.
  • Updated email layout generator to latest version improving the quality of emails.
  • Add more information to multiple authorization warnings to give a better understanding of the cause.
  • More readable styling for Copy fields.

BUGFIXES:

  • Groups and profiles without an ID causing errors on some pages.
  • Making a failed report public would cause some loading issues.
  • HTML in company name being rendered in some places.

2021-11-29: Report tags

FEATURES:

  • You can now add report tags to an import.
    • Added a company tags page to see all tags used in a company.
    • Added a tag details page, listing all reports that use the selected tag.
    • Added possibility to add/remove tags from existing reports.

IMPROVEMENTS:

  • Improved the user newsletter page to be able to subscribe/unsubscribe in a single click.
  • Greatly improved the support for Safari browsers.
  • Added documentation for better Robot Framework results.
  • Hide and disable a number of buttons that can't be used by read only users.
  • Moved invite company user form to a separate page.
  • Make <environment> tag optional for NUnit XML reports.

BUGFIXES:

  • Import message not escaping code correctly.
  • Error shows when sorting the reports table by profile.
  • Incorrect email when setting someone else's notification subscription to never.
  • Guest using public report could see the names of other groups and profiles within a company.
  • Multiple errors when a users' session has timed out.
  • Timezone issue on schedules and report date.
  • Better tooltip information on profiles when the name is shortened by ellipses.
  • When filtering informational, the no result-text would show empty.
  • Font style issue on runtime for reports table.
  • Fix in uploader trying to upload a report file to a sub-group.
  • Better handling of multiple edge-cases when a login session has timed-out navigating to a specific page.

2021-10-20: Robot Framework improved

FEATURES:

  • Robot Framework:
    • We now support screenshots.
    • When attaching the report.html and log.html referral links will keep working.
    • Completely zipping and uploading the results folder to Calliope will work.
    • Some fixes around showing invalid failures or passes.

IMPROVEMENTS:

  • Instead of saying "something went wrong" on a failed report, we now directly show the error message.
  • Add a failed-tag to a failed report.
  • Prioritize the passed status over a skipped status (so a container with passed and skipped results, will show as passed).
  • Changed color scheme for secondary buttons.
  • Multiple import messages are improved by adding documentation or clarification.
  • Fink will now show any 100 - 399 http-response as passed.
  • Upgraded Gherkin parser to latest version.
  • Add more details when multiple files fail during importing.
  • When the content of a description becomes too large, we now check if it's text, html or json and store it accordingly.
  • Registration form validation is now instant.

BUGFIXES:

  • Incorrect redirection registering successfully after a failed registration.
  • Javascript crashed when a browser would not support push notifications.
  • Mobile: Dropdown menu in sidebar would overflow screen width.
  • Mobile: Notification dropdown would overflow screen with when containing large content
  • Report filter icons overflow button when using more than 3 filters simultaneous.
  • Fixed some files not being found as attachment due to a front-slash vs back-slash issue.

2021-10-09: Security scans, Upgrades & bugfixes

FEATURES:

  • Added a security scan tile referring the user to our integrated security scanning service.
  • Gherkin formatter now supports comments.

IMPROVEMENTS:

  • Upgraded to the latest Bootstrap 5
  • Show container description as light text next to the container title.
  • Allow Markdown in container titles and result titles.
  • Make the Informational status editable and filterable.
  • Reworked the policy flow checking if someone is allowed visiting a page or doing an action.
  • Updated the flow if a limit is reached, by showing the create (group/profile) page with a diagram of the limits.
  • Cucumber formatter now support cases of using After Steps and multiple before/after elements for a single result.
  • Improved performance checking the validness of a file before trying to process it.
  • Update support for latest lighthouse version.
  • Improved warnings and errors when a file was incompatible for a formatter.
  • Show a specific warning when a Postman Collection is uploaded instead of test result.
  • When clicking the top navigation upload-button, it will now pre-select the current group/profile you're on.

BUGFIXES:

  • Multiple problems filtering and setting report elements to status Informational.
  • Issue profile/group page freezing when a latest report contains over 10000 results.
  • Close all open notification dialogues before opening another one.
  • Prevent Read Only users from seeing GitLab warnings.
  • Fix hover issue in status drop downs in edit mode.
  • Edge case getting a server ResultAsset::ImporterWarning warning instead of a more user friendly message.
  • More details in the warning message when someone uploads a HTML file.
  • Hide errors when a request was aborted.
  • Fix multiple typo's for old API endpoints or still using projects instead of groups.
  • Report page would show with containers and a critical error when there are no results.
  • Issue with hidden files in Mac generated zip files.
  • Issue not being able to delete your account if the email address contains a html-entity like < or &
  • Fixed JUnit to be more accepting of missing name attributes.
  • Long company names not showing inline where it should.
  • Error message not including the correct limit text.
  • Top navigation dropdown breaking when a company has more than 20 groups.
  • Sorting reports list by profile would show an error.
  • On the public sharing page, if a company has no website set, it would open an empty window.
  • Company overview page would show an empty space if a profile was created, but no report uploaded yet.
  • Redirect issue coming back from a create group page.
  • Going to a company without groups as read only user.

2021-09-31: Public reports

FEATURES:

IMPROVEMENTS:

  • Improved tag view on small reports, including latest and public if that's the case.
  • Gracefully catch case if a user session ends while in edit mode.
  • Stop considering all containers new when it's the first upload of a profile.
  • Updated version support for some formatters:
    • Burp: Add support for version 2.2
    • Lighthouse: Add support for version 7
    • Robot Framework: Add support for version 4
  • Inform how many containers were combined together when using the merge_containers option.

BUGFIXES:

  • Report tags not updating as expected when moving from one report to another.
  • Hide existing notification dialogues if a new one appears.
  • Email top navigation was not similar enough to the application.
  • Going from loading state to loaded state in the report view, there was a 1 pixel shove.
  • Fix Fink not being recognised as formatter if there is only 1 result.
  • Issue where Microsoft Office files (like .xls or .docx) are recognised as zip archives.
  • Issue uploading a corrupted empty zipfile.
  • Issue where UTC time was displayed instead of local time.
  • Quick upload icons overlapping form in between large and small screen width.
  • Make the create group button disabled if a user has no permissions to create a group.
  • Fix email notification preference link going to the wrong page.
  • Removed company image from email due to security risk on using external sources in the emails.
  • Breadcrumb icons overlapping dropdown icons instead of becoming ellipses.

2021-08-03 Recursive Grouping and Gherkin feature support

FEATURES:

  • NEW FORMATTER: Gherkin feature files:
    • Import your Gherkin feature files to Calliope to generate a blank report.
    • Supports a wide range of languages.
  • Projects has been replaced by groups and sub-groups:
    • Allows organising your projects in a more dynamic way.
    • Subgroup your profiles up to 6 levels deep.
  • Added documentation for implementing Knapsack Pro.

IMPROVEMENTS:

  • Breadcrumb items:
    • Spread more evenly and shows ellipses more naturally.
    • Better support for tablet and mobile view.
  • Reworked company overview:
    • Now shows all Groups and Profiles in 1 list.
    • Displays the latest report.
  • Improved the feedback while editing a report and your session expired.
  • Improved the feedback message when uploading only HTML reports.
  • Autofocussing input fields on profile and group settings.

BUGFIXES:

  • Fixed issue with report summary filter showing empty report.
  • Fixed issues around date/time not respecting the user's timezone.
  • Fixed an issue where users received a report email while the Slack notifications are set.
  • Fixed text cropping issues on the edit report page.
  • Increased security not allowing the system to redirect to any non-whitelisted addresses.
  • Issue with history not being compared and saved as expected when using multiple files.
  • Fixed login form elements still being clickable when sliding to the sign-up form.

2021-07-07: Asynchronous importing

FEATURES:

  • Asynchronous import processing
    • Faster response times for large imports.
    • Making Calliope prepared for more growth.
    • Shorting loading times due to predictive caching.
    • Updated report details page interface to display the progress of processing the report.
    • Added /report/{reportId}/status API endpoint to keep track of the processing status.
  • Invalidate user sessions on all devices when a user logs out manually.

IMPROVEMENTS:

  • Updated many dependencies to the latest versions.
  • Instead of escaping HTML, we now sanitize it, allowing basic, non-xss html.
  • Show a custom message when an empty zip file is imported.
  • Add an import warning message when a report file is older than 24 hours.
  • Show user icon in the import details dialog.
  • Changed minimum password length from 6 to 8 characters.
  • Allow longer project names.

BUGFIXES:

  • Company invite not being send the first time someone is invited.
  • Email icons not showing on GMail.
  • Long title text overflowing in results container.
  • Import messages sometimes overflowing out of its container.
  • Read only user was able to see the edit mode interface, but not save anything.
  • Deleting a large report could sometimes take a long time.
  • Javascript breaking when a browser does not support push notifications.
  • Notifications not always being send with the correct conditions.
  • Searching company member displays an error.
  • Fixed multiple typo's on the docs pages.
  • Uploading certain file types returned a 500 error instead of showing failing import messages.
  • Error pages were showing the zero in an error code not inline with the rest of the numbers.

2021-06-16: Bugfix release

IMPROVEMENTS:

  • Performance improvement on opening reports with containers that contain a lot of results.
  • Renamed 'Settings' to 'Information' in the company dropdown to make it consistent.
  • Improved readability of the 'members' page of companies on mobile.
  • Showing how many days are left until the next month for subscriptions.
  • Showing a message when there is an empty report uploaded.

BUGS:

  • Fixed a 404 error going to Gitlab integration.
  • Fixed Email layouts in Gmail.
  • Fixed breadcrumb on integration pages.
  • Fixed issues with JUnit report import dates.
  • Fixed issues with container status switching.
  • Fixed resizing issue on the Gitlab integration settings.
  • Fixed some HTML showing in active notifications.
  • Fixed error layout issues on the 'Reset password' page.
  • Fixed an issue with uploading empty JUnit reports.
  • Fixed an issue with the ignore_max_files_limit import option.

2021-06-06: GitHub & Travis CI support

FEATURES:

IMPROVEMENTS:

  • Deleting a company now also has a separate page explaining what is required to be able to delete it.
  • Some tables are now populated a-synchronously, to improve page load time.
  • Use Gravatars Identicon instead of the mystery person icon when not set.
  • Show parent container title in the result-container sidebar when showing the results.
  • Redesigned report result numbers showing in a more efficient manner.
  • Use SVG icons instead of PNG where possible.
  • Updated payment system:
    • We now make use of Stripe Checkout and Stripe Portal, leaving the subscription payment and management to them.
  • Reduced the font size in form elements to the same as all other fonts.
  • Added an extra indicator when a user has the read only role in a company.
  • Set maximum of scheduled profiles to once per 5 minutes.

BUGS:

  • Mobile view:
    • Better visibility of company name in dropdown.
    • Responsiveness of upload form breaks.
    • Text falling out of container.
    • Nothing happening when pressing send email summary.
    • Pressing share link on report page didn't work.
    • Fix breadcrumb menu dropdown tags displaying incorrect.
  • Multiple text-elements not dynamically showing ellipses when text is too long.
  • Import messages missing on report details page.
  • Fix for toggling containers created in edit mode in the same page load.
  • Report results number overflowing when going over 1999 results.
  • Subscription not being cancelled when payment was declined.
  • Robot Framework containers not always showing the correct data.

2021-03-24: Report assets

FEATURES:

  • Added report assets to the report view.
    • Also possible to add and delete them from edit mode.

IMPROVEMENTS:

  • Big rework on the layout of the reports pages:
    • Many of the buttons are now moved to the left-side navigation.
    • Moved os/platform/build to the report name as tags.
  • Better special character support (Upgraded from UTF8 to UTF8MB4)
  • Upgraded from Ruby 2.6 to 2.7
  • Better grouping by classname attribute of JUnit reports.
  • Combine containers and sub-containers if the sub-container only has 1 sub-container.
  • Documentation improvements:

BUGS:

  • Fixed issue with merge_containers that positions were not updated after merging
  • Fixed issue with JUnit and grouping containers by the classname.
  • Fixed not redirecting to the profile overview page after saving changes.
  • Invalid link to the Swagger documentation
  • Fixed full report button wrapping words.

2021-03-03: Lighthouse & Nessus support

FEATURES:

IMPROVEMENTS:

  • Better algorithm to decide if a container should be expanded automatically.
  • Added import option suppress_notifications to prevent a notification to be sent when importing a report.

BUGFIXES:

  • Copy text notification showing chain icon multiple times.
  • Not scrolling back up when going to different results container.
  • Results without a status should not display a history.
  • Some API endpoints returning a wrong url for the logs page.
  • Buttons in alerts having an underlined text.
  • Text color in alerts sometimes not readable due to lack of contrast.
  • File extension sometimes different from Mime Type. (XML Mime Type generated XLS extension)

2021-02-15: Following profiles

FEATURES

  • Created a generic notification method, allowing us to easily send simple messages to a user.
  • Profile followers overview page to see all company members who are following a profile.
    • As a moderator, you can now set another company member to follow a profile.
      • This will inform the user that they're now following a profile using the new generic notification method.

IMPROVEMENTS

  • Dropped support for TLSv1 to improve the security of a connection between browser and server.
    • This means that (very) old browser won't be able to access Calliope Pro: Chrome 21, Firefox 23, IE 10, Safari 6, Opera 12.0, iOS Safari 5.0
  • Dropped last bits of support for a legacy a-sync tasks runner.
  • Slack report status message showing a line on the left side, indicating a good (green), medium (orange) or bad (red) status.

BUGFIXES

  • Width of role dropdown in members page can become too small.
  • Form validation checkmark overlaps dropdown button in select fields.
  • An icon inside an avatar circle is not in the exact vertical center.
  • Scrollbar in notification dropdown showing, even when it's not exceeding the maximum height.
  • Long messages in the notifications drop down could break the maximum width causing a horizontal scrollbar.
  • Edge case where a notification could cause a page not to load anymore.
  • Issue with push notifications not being send.

2021-02-01: Slack integration

FEATURES

  • Completely reworked the notifications system adding many improvements and features:
    • Slack integration for Report notifications. (See docs)
    • Push notifications for Report notifications. (See docs)
    • Improved in-app notifications (Notification bell).
    • Added report notifications to the in-app notifications.
    • Created a dedicated notifications page to manage all your notifications.
  • Delete profile and project page instead of a simple are you sure? warning to prevent accidental deletions.
    • Allowing a quicker way to delete a project full with profiles.
  • Using Gravatar as avatar provider for the user icon.

IMPROVEMENTS

  • Improved the styling of emails.
    • Report notification now shows more and clearer information.
  • When reaching a limit, all moderators and above will receive a notification.
    • Instead of where previously it showed a constant warning under the notification bell.
  • When an import failed, the sender of the API call will always be notified.
    • This is to prevent an import failing for a longer time unknowingly.
  • Removed maximum height on report result fields, to prevent scrolling-in-scrolling windows.
  • Newman documentation
  • Added re-send button to invited user list.
  • Top navigation dropdown now goes over a notification dialogue instead of under it.

BUGFIXES

  • Some links not working when not clicking exactly on the text.
  • Being able to invite new members while the maximum users in a company limit has been reached.
  • Fixed edge case situation where an API call with Content-Type:multipart/form-data is done, but the content is send as a body causing a 500 server error.
  • Fixed some styling issues in the report numbers.
  • Fixed url location not being restored after logging in.
  • Fixed allowing some email addresses when inviting a user to a company that are not allowed when creating a new account.

Release archive

Release notes archive