Announcement Archives - Visokio https://visokio.com/category/announcement/ Developers of Omniscope - Business Intelligence software for data processing, analytics and reporting Tue, 14 Mar 2023 21:48:42 +0000 en-GB hourly 1 https://i0.wp.com/visokio.com/wp-content/uploads/2019/06/favicon-visokio.png?fit=32%2C32&ssl=1 Announcement Archives - Visokio https://visokio.com/category/announcement/ 32 32 157333698 Omniscope Rock Build – 2023.1 https://visokio.com/2023/02/03/omniscope-rock-build-2023-1/ https://visokio.com/2023/02/03/omniscope-rock-build-2023-1/#respond Fri, 03 Feb 2023 17:56:07 +0000 https://visokio.com/?p=18979 After months of anticipation, we are thrilled to unveil our latest treasure trove of features. From enhanced functionality to exciting new tools, there’s something for everyone. Take a moment to explore what’s new and discover the features that will make a difference to your reporting....

The post Omniscope Rock Build – 2023.1 appeared first on Visokio.

]]>
After months of anticipation, we are thrilled to unveil our latest treasure trove of features. From enhanced functionality to exciting new tools, there’s something for everyone.
Take a moment to explore what’s new and discover the features that will make a difference to your reporting.

Watch a brief video showing some of the highlights.
Send us your questions and feedback – let us know what you think!  (here is a Survey link)

Workflow: improved connectivity and data prep

You can now seamlessly integrate data from a wider range of sources into your workflows – our latest update includes support for the following data sources (and outputs):

  • Google Cloud Storage, Amazon S3, Microsoft Azure Data Lake Storage Gen2 in the File Input and File Output blocks.
  • Outlook PST files in the File block – users can now open, load email, messages, calendar events and other items.
  • Google Drive in the File Input, File Output and Batch Append Folder blocks; support for shared drives in Google Drive file input and output.
  • SalesForce connector is updated to the latest API version
  • New experimental Google Sheets output block.
  • New preparation blockFill Down” replaces nulls in a field with the last non-null preceding value in the same field.
  • The new Parse text block will help you parse the contents of a text field, containing JSON or XML, and output one or more records resulting from each cell. (Read more)
  • Community Custom Scripts are folded into the main block picker categories such as Inputs, Connectors, Preparation and Analytics. The Community Blocks (and also the Library Blocks) now keep their category’s colour on the workflow.
    In the Admin section there is also an option to hide the Community blocks, if they are not relevant for the particular use case.
  • For our users in Asia we’ve improved the “Simplified Chinese” translation, so they can interact with the translated menus and application components.
    We also support custom translations – you can find more information below and let us know if you need help to implement.
    (See article)

 


You can now pin the workflow blocks palette as a left collapsible panel, which makes it easier for you to locate and apply the desired blocks. This eliminates the need to repeatedly click on the Add Block menu. Keeping the sidebar menu readily accessible will save you time and effort when building complex workflows.

Managing date patterns has never been easier thanks to our latest update, which introduces new date format dropdowns in both the Field Organiser and Report field settings. With these drop-downs, you can quickly search for a specific pattern or add a new one to the list.

 

Drop files anywhere: you can simply drag a source file from your computer and drop it anywhere in the Omniscope interface, whether it’s on the projects page, within a workflow, or on a File source block. This streamlined process means you can easily upload new data without the need to browse to the file location.

 

Editing data

Table view’s ‘data edit mode’ turns the table into a rich editing experience, similar to a spreadsheet; with multi-cell selection, copy/paste, inserting/deleting records/fields, renaming fields, resizing columns, also cell edits with an undo/redo option.
Note: Requires the Report input to be a Data Table or Text Input block.

  • Refill (only) action in the Data Table block: these blocks can now be “refilled” without refreshing the upstream workflow, by selecting just that block and clicking the Execute button with the Refill icon.
  • Text Input block has a new UI making it easier to input and edit data.
  • Editing dates now shows a date picker, while the Toolbar button is added to clear sorts.
  • There is also a new edit behaviour option to disable/show toggle or always enable editing. Editing can be enabled for some columns and disabled for others (from the Report> Fields settings or the three dot menu on the Report’s Data tab).
  • Read more here

 

 

New data visualisations and Report UI improvements

New charts on the block: Dumbbell and Lollipop are commonly used to represent changes in data over time or between different groups. Dumbbell charts are particularly useful for showing the difference or change between two data points. They consist of a pair of markers or dots connected by a line, with the length of the line representing the difference between the two data points. They are often used to compare before-and-after data, or to show the difference between two groups of data.  Lollipop charts, on the other hand, are useful for displaying individual data points or values within a dataset. They consist of a vertical line or “lollipop stick” with a circular marker at the end representing the data point. They are particularly effective for highlighting outliers or individual data points that are significantly different from the rest of the data.

  • Improvements in Bar, Line and Candlestick charts – addition of technical indicators : Simple Moving Average, Exponential Moving Average and Bollinger Bands. These indicators are dynamic and will instantly be recalculated following filtering and selection.
  • Multi-point tooltip support in Line, Area, Radar and Parallel Coordinate views (e.g. the user can display the state of multiple KPIs on a given day).
  • Added option to reverse the split axis in the Bar, Line and Streamgraph views (e.g. the timeline on the X axis could be showing descending order).
  • Scatter view quadrants: option to move X/Y axis to origin.
  • Added vertical reference lines in the Line view.
  • Pivot view improvements: support for copying cell data; showing gridlines in the corner of the Pivot view; plus an option to show column or row titles /headers.
  • New “Custom HTML” custom view is available now in all app versions. It allows the user to embed either a static HTML snippet or to dynamically display HTML retrieved from the view input data. It can be used to embed HTML widgets (e.g. a Discord channel widget) or to display HTML content based on the filtering / selection happening in other views. You can see a demo on our sandbox.


    We have introduced a new navigation UI for the Explore and Design dashboard editing modes, to provide a clearer distinction between editing and viewing reports in Omniscope. The Explore mode allows you to quickly and easily interact with all views on the page, simultaneously exploring data and adding new charts. The Design mode, on the other hand, provides more advanced editing capabilities, with the data/settings sidebars and a more focused single chart edit mode.

 

 

We have made improvements to our tabs management system with:
– addition of visible vs hidden tabs
– tab layout : drop-down picker Vs visible tabs navigation
– new tab positioning options: on top/ right/ bottom/ left of the report page
– the tabs can be sorted using drag and drop

 

Report templates, automated diagnostics

Report Templates are pre-configured projects available from the Projects page, some of which contain stunning visualisations that can be simply dragged onto the workflow and used immediately. You can simply re-configure the source to connect to your account/credentials, check the block search criteria and reload the data. The template project contains a dashboard, which will be ready to go the moment you load the new data!

Diagnose fields dialog – We have introduced a new dialog that automatically appears when there are issues with the data sources, fields, or formulas in any of the views within the report. In cases where the data flowing into the report has changed, the dialog offers help with remapping fields to ensure that your data is correctly integrated into the report. This makes it easier to bookmark, reuse or share report templates.

 

Although the data is the most important element of your report, appearances can also make a significant impact, so why not take a few moments to polish your presentation? With the Report Styles section, you can transform your report with just two clicks. You now have the option to choose from a selection of pre-configured style Presets, or even create and share your own presets as report styles in XML format. This is a convenient way to preserve combinations of colours, fonts, backgrounds, and borders.

Report layouts: Perfect chart proportions are achieved easily in the Free form report editing mode. The new snap report views feature is a user-friendly way to manipulate the charts using the guidelines and create slick dashboard layouts, including the exposed pixel and % measurements . If you haven’t used the dashboard device optimisation feature – it is worth having a go… Read more

 

Projects page – welcome tour and banners

We wanted to revisit and improve the user experience – whether the user is an experienced analyst or a total novice. The app is more welcoming and offers help to discover the features, while at the same time facilitates a more intuitive interaction with different interfaces.

Our new users will appreciate the Omniscope application tour popup – a dismissible sequence of hints to guide them through the basics on the Welcome screen, in the workflow app and on the report pages. Not a paperclip in sight!

Even the Projects list page got a bit of a makeover, with the ability to add banners with text, images, gifs and links using Markdown syntax.
Simply add a banner.md file to the projects folder. You will be able to add instructions or display a welcome message for the report consumers when they find themselves facing a long report list…
Read more

 

Report publishing and Automation

  •  “Chain repetitions counter” is a new scheduler feature which allows the user to repeat the action(s) a set number of times until finished, or a failure occurs.
  • Dashboards can be saved as .IOR files and publishing can be automated with the new scheduler task “Create IOR file from Report”. Read more
  • New chart options from three dot menu – report editors can choose to expose the chart’s underlying data to the viewer (and the source data) and make it downloadable, or decide to hide it (through the “Hide source data” option in Report sharing settings).
  • Omniscope views can now be saved and downloaded as images from the same chart menu (in PNG format).
  • Convert and publish Omniscope multi-tab report as PowerPoint presentation via the new custom Report to PowerPoint block (available on Business/Enterprise plans).

 

Advanced features

 

Report variable influencing a live SQL query. To use this feature, the database block must be configured for live query and you must tick “Enable live query injection” in the report variable configuration. This will allow you to use the variable name as a parameter in the Database block custom SQL option. See the article 

 

Omniscope File Drop facility: A new Custom view allows the report viewer to upload a data file by uploading it to a Report page and immediately trigger a data Workflow execution of specific blocks in one request (where the uploaded data file will become an input data block), optionally also refreshing the report which contains the ‘upload file’ view. See more

See also – relevant features already available:

Parameter passing – Custom views in the Report section allow the analyst to integrate a parameter-passing mechanism, so that the report viewer is able to make a choice or enter a new value to be passed to the workflow and trigger a re-execution.
See more

Performance improvements

When multiple users are requesting the same query Omniscope has an option to store and retrieve results of the first-executed query. Report queries are cached indefinitely, subject to a configurable cache memory capacity via an option in the Admin section, and do not otherwise expire until the server app is shut down. Manual report “warm-up” (after data refresh) can be useful on servers with complex reports and large numbers of viewers to facilitate dramatically improved load time and interaction time for common initial actions.

Important Note about the Omniscope Classic Mobile mode sunset – for the users who wish to share their reports as web links Evo is a superior web app – it is better positioned to deliver web based reports and share content. As of this Rock build we will remove support for the old Classic ‘mobile mode’. Please get in touch if you wish to discuss the migration options and licensing.

 

Let us know what you think, here is a Survey link

#TeamVisokio

The post Omniscope Rock Build – 2023.1 appeared first on Visokio.

]]>
https://visokio.com/2023/02/03/omniscope-rock-build-2023-1/feed/ 0 18979
Omniscope Rock Build – 2022.1 https://visokio.com/2022/04/22/omniscope-rock-build-2022-1/ https://visokio.com/2022/04/22/omniscope-rock-build-2022-1/#respond Fri, 22 Apr 2022 19:05:59 +0000 https://visokio.com/?p=18492 They say good things come to those who wait… Because our new Omniscope 2022.1 Rock release took slightly longer this time – it is only right that we treat you to more goodies than usual… Whatever it is that you wish to do this spring:...

The post Omniscope Rock Build – 2022.1 appeared first on Visokio.

]]>
They say good things come to those who wait… Because our new Omniscope 2022.1 Rock release took slightly longer this time – it is only right that we treat you to more goodies than usual… Whatever it is that you wish to do this spring: to clean, build, move and improve – you’ll find that Omniscope has just the right tools to do it.

Bring in the Robots!

Save time with the Macro functionality – create reusable workflow logic, then add it as an ETL routine to other projects. 

The new Rock build adds the ability to decompose complex workflows into smaller “macros” and optionally share them with other users/ folders/ projects on the server via the Macros folder.

You can use macros without sharing them, as a way of reducing the complexity of a large workflow, by creating a smaller project alongside the main project, and using the “Macro” block to embed it within the main project.

Alternatively, you can create projects within the dedicated “Macros” folder, and they will become immediately available to all users and projects in other folders on the server, via the Add Block menu.

Read more:

 

Optimised report mobile experience

Design dazzling dashboards for different devices – preview multiple layouts and optimise every user’s experience.

The report creator can share a link to a dashboard, while making sure that the mobile display will be optimised and look great on any device.

The slider preview device is a switch between different screen sizes, e.g. desktop, tablet or phone, allowing the designer to see what the report will look like on someone’s screen. Their report page is shown within bounds of the chosen target preview device.

This design optimisation process will manage device layouts per tab, so that each tab can have different content, i.e. different set of views. Instances of views added in one of those layouts can also be added in another layout for the different screen size from “Add view” dropdown. A report shown on a big screen may have 10 charts, while a small laptop may show 6, and when the same report is opened on a mobile phone – it may display only 4 charts.

See how to build a report for any device with different layouts

Custom Blocks Library

There is now a better way to manage your own custom blocks – preview, update and delete blocks from a central repository called the Blocks Library. The library is maintained from a single folder on disk and every Custom Block (a subfolder comprising Python or R code and JSON metadata) that is added to this folder is available immediately from the block picker. When library blocks are dragged from the block picker to the workflow, they are linked with the Custom Block source file on disk. Any change to the source file is immediately propagated to all linked blocks in all workflows, thus removing the necessity to update them manually.  You can optionally use VCS such as a GitHub working copy for the Blocks Library folder.

Expanding data connectivity and cloud technologies compatibility

If the sky’s the limit and you’re looking to move your reporting to the cloud – you will appreciate the newly-added support for cloud file systems and file types.

We’ve added support for reading and writing to Google Cloud Storage and Amazon S3 buckets, via an option in the ‘File location’ drop-down (in File and File Output blocks), also in the Batch Append and the Append Files blocks.

Another addition is support for reading and writing Apache Avro and Parquet files.

(read here ​​Apache Parquet read/write support)

Added Batch HTTP block: Connect to any data source with the REST API via the Batch HTTP block, added to handle data-driven HTTP requests. Allows you to precisely configure and execute HTTP requests, where everything can be data-driven: custom headers, request/response payload, URL structure, HTTP method.

Bundled Admin dashboards

You will be able to enjoy Omniscope logs data from the comfort of your own admin dashboard – to understand which reports are getting the most hits, pinpoint which scheduled tasks need attention, or monitor the app performance.

Easy data access with instant data visualisation/exploration

Adding ability to drag and drop data files onto the Workflow app and the Projects page. These files are then automatically uploaded, and a file block is created for each uploaded file.

Capture, save and manage fast-flowing data

Help is on the way if you’re dealing with a ‘data firehose’ scenario: the new Data Savepoint block (from the Operations blocks menu) is allowing you to capture and analyse the data whenever you wish. The block enables you to retain execution data indefinitely at any point in your workflow, so you can continue working and building the workflow downstream of a slow and complex upstream workflow.

Savepoint block has Retention option which will set the behaviour to either:

  • “Persistent” – which captures data indefinitely for future executions, or
  • “Temporary” – which captures data temporarily only, within a single workflow execution, to ensure reuse of the same data downstream if there are multiple pathways.

 

Report auto-refresh

New file data refresh option enables you to configure your Report to auto-refresh on open (see Report settings > Global tab). The first person (in a configurable time period) to open this report will trigger the workflow to execute and extract the latest data from the source, and update the visualisation. Useful for infrequently opened projects, or those without a Scheduler-enabled license (a Scheduler is needed if you wish to avoid your users having to wait for the data refresh to complete).

Diagnose query

Report creators will appreciate that in a report with multiple queries they will be able to quickly diagnose which filter combinations are used for each of their queries, and the impact of a complex combination of move/keep actions and filters.

(see Report settings and View data source section).

Dynamic ranking

Calculate your TopN on the fly (based on filtered data): New blocks on the Report data sources menu – Sort and Limit will allow you to display a ready-made queried, calculated, aggregated and ranked dataset in any view. If you wish to dynamically rank top 10 performers, while allowing the report viewer to exclude some data, then you will want to try this mechanism in your reports.

In the screenshot below, our original dataset with ‘all shipment transactions’ has multiple operations applied – the Query block will enable filtering (on the original dataset ‘All shipments’) and control the flow of data into the Aggregation block, where the transactions’ values are summed, then sorted, and a limit is applied to determine the cut-off point for the resulting dataset (to show just Top10 shipments). Every view in this report will have access to this newly-created dynamic dataset.

Chart data download

When making a chart selection, a details button shows in the main toolbar. When clicked – a table showing the selected records is displayed, with options to copy/download the data.

There is also an option to preview the data in each view, showing a table with the displayed and source data and options to copy / export the data.

 

Commercial plan flexibility

  • Adding Team plan licensing support for distinct fixed numbers of Viewers vs Editors concurrent seats.
  • New option to create a limit of one session per user. If ticked, only one browser session at a time is allowed for each authenticated user. If the licence has limited seats, this will ensure one user cannot consume multiple seats using different devices, and it will allow installations to support named seats in addition to the default shared seats setup.

 

General & admin

New ability to restrict what resources projects can access on the file system. Read more.

  • Better disk and memory management, admin UI options, diagnostics and disk cleanup for the data engine
  • Better logging and improved Workflow Jobs Queue admin page, to show the reason jobs were started and cancelled, and when they were created;
  • Added option in the admin interface to specify additional arguments to Pip, the Python Package Installer, so that proxies, features, certificates, etc. can be defined.
  • Updated Log4J version to 2.17.1, for peace of mind. This update addresses various security vulnerability concerns present in older versions (even though in practical terms they were not vulnerabilities in Omniscope due to the restricted manner in which Omniscope uses Log4J)..
  • Omniscope now records resource monitor data every 60 seconds to a new log file “resource_monitor.csv”. Previously available only for the last 7 days via an Admin page, it is now persisted indefinitely as a rolling logfile. Includes information such as system CPU load, memory use, swap, process heap and non-heap, open file handles, and free disk space. Useful when correlating system load with Omniscope activity.
  • More bundled demos – find them on the Welcome page; on upgraded existing installations, install new/updated demos from Admin. Alternatively – visit our refreshed  demo gallery

 

Workflow

  • Showing ‘Last Executed’ time when hovering on blocks and on the Report ‘Refresh data’ button to show when the report data was last updated.
  • Bookmarks: Ability to create private block bookmarks (available from create bookmark dialog). Private bookmarks will only be available to the user who has created them.
  • Added option to download an ioz file without the report data
  • Improving performance of large projects with complex workflows
  • Updated Google Campaign manager to v3.5.
  • Data Table block: option for in-memory (non-persistent) storage
  • Field Filter: A new “Auto-populate” button appears when there are no filter rules configured. It inserts a rule for every existing field in the input, letting you easily customise the rules and protect against future field changes or additions.
  • File block (and other blocks that let you browse for a file in Omniscope): Added additional sortable columns “Modified”, “Size” and “Type” to the File Browser.
  • File and File Output blocks: read/write remote files over SSH (SFTP, SCP) using an optional private key
  • File and Append Files blocks: Added options to retry block execution on I/O error
  • Field Organiser: Improving performance, including optimising date format conversions. Easy date formats, via a drop-down menu of common formats, while allowing you to continue entering custom formats.
  • Promoting workflow execution stats recording to a non-labs feature. A few rock builds ago, we introduced a labs feature that logs workflow-wide and per-block execution time statistics to a CSV logfile, allowing you to analyse bottlenecks in your workflows. It’s now proven for production use with negligible overhead, and has graduated to non-labs.

 

Reports

  • Being able to hide report tabs in the Present mode.
  • Supporting 3rd party IFRAME contexts for SSO and Unlimited Viewers licenses, when accessed via HTTPS. However, note that 3rd party IFRAME contexts with single-sign-on (OpenID Connect) are “on notice”, with modern browsers phasing this out over the next 2 years; you should instead ensure your IFRAME embeds are seen as a “same site” as a long-term architecture.
  • New options for the spacing/ padding/ border options and behaviour related to creating dividers around the charts

 

Visualisations

Adding option to show the colour key at the top or bottom of the view, with configurable number of lines for the colour key text.

Bar view:

  • Improving multi-tier split labels (>1 split)
  • Adding option to set Bar split min/max values if numeric or date continuous axis.
  • Adding option to always show stack labels, even if the stack is very small.
  • Improving performance of Bar queries when stacking and colouring by stack.

 

Scatter view:

  • Added option to create reference lines in both X and Y axes.
  • Added new ‘Jitter’ option – moves markers by a small random amount to provide a better visual sense of the number of observations when either the X or the Y axis are discrete.

 

Table view

  • Added option to limit editing to pre-configured values. A dropdown, rather than a text field, is used to edit the values. Read more here.
  • New option to disable editing of number/date fields
  • New option to style cells and headers differently for each column

 

Map view: Added UK NUTS levels 1-3 GeoJSON base layer maps

Sankey view: new option to show percentages

Timeline and Item views are now non-experimental 

New experimental view: Bubble view

 

💥 and that’s all folks!  Your feedback, as always, is very appreciated, and we are here to support you. 🙏

#TeamVisokio

The post Omniscope Rock Build – 2022.1 appeared first on Visokio.

]]>
https://visokio.com/2022/04/22/omniscope-rock-build-2022-1/feed/ 0 18492
Omniscope Rock build – 2021.2 https://visokio.com/2021/10/06/omniscope-rock-build-2021-2/ https://visokio.com/2021/10/06/omniscope-rock-build-2021-2/#respond Wed, 06 Oct 2021 09:54:06 +0000 https://visokio.com/?p=18187 “Now pay attention, 007…” It’s been a busy summer in Visokio’s development department and we’ve got some interesting new features and gadgets to show you… Multiple Omniscope interfaces received a facelift (better than a Bond villain), and you will notice improvements in the workflow handling...

The post Omniscope Rock build – 2021.2 appeared first on Visokio.

]]>
“Now pay attention, 007…”
It’s been a busy summer in Visokio’s development department and we’ve got some interesting new features and gadgets to show you…
Multiple Omniscope interfaces received a facelift (better than a Bond villain), and you will notice improvements in the workflow handling and execution performance. Under the bonnet an upgraded data engine will speed up your dashboard queries.

New look welcome page and project templates

 

The Omniscope welcome page has changed! As well as finding your projects and data files, you can now create projects for common tasks using templates, such as for importing from databases or entering/editing data. Recent files are shown separately, so you can quickly find the project you were working on yesterday. The interface is now more consistent and familiar across the welcome page, workflow and report experiences.

Grouping blocks

Tired of zooming and scrolling through large, complicated workflows? Lost in a sea of blocks and connections? Now you can organise sections of your workflow into groups, optionally name them, and expand them with a click when you need to look or work inside.

Animated transitions in reports

Your reports will come to life when your users filter and select within them, now that Omniscope animates most transitions.
As well as being more funky and engaging, it helps perceive the impact of actions upon the data.

New views

Need to see the cumulative effect of a bar chart? The new Waterfall chart lets you do this, with an optional total bar, and with negative (down) as well as positive (up) sections. Also known as cascading bars, flying bricks or bridge.

Still experimental in this rock, and due to graduate early in version 2021.3, are the new Timeline and Item views. Use the Timeline view to show a small number of events on a single time axis, coloured and labelled. Use the Item view to represent a small number of “items” (e.g. seats in parliament) as coloured dots in one of 4 common arrangements.

Workflow performance 

Performance interacting with and executing workflows has been greatly improved. Memory use under high load is better managed. Experimental “labs” options have been added to let you try other performance improvements in development (please send feedback). Should things go wrong, improved diagnostics will help us understand and resolve the problem faster.

Upgraded data engine

The bundled data engine, used to execute queries underlying the visualisations in your reports, has been upgraded, bringing performance, reliability and disk management improvements. Existing servers will need to rebuild their queryable data from execution data (automatically on first access).
You can find documentation and instructions here.

Secure, isolated Custom Block execution using Docker

Custom Blocks let you write your own code to transform and process data, in R or Python, and then share them as bookmarks or community blocks on GitHub. However, such scripts have unrestricted access to the server filesystem, previously requiring you to trust your workflow-permissioned users. Omniscope 2021.2 now lets you execute all custom blocks using Docker, via a server-wide policy, where the script code is completely isolated from the server file system other than where configured via options. Requires Docker Desktop (Windows/Mac) or Docker daemon (Linux) to be installed and running. (read more)

Docker Logos | Docker

 

…and more:

Data preparation

  • Templated parameters – new powerful type of param that helps with URL / file path customisation (read more)
  • The Google Sheets connector lets you pull data natively from one of your cloud spreadsheets
  • Native support for more database vendors. Although Omniscope supports any JDBC based connector, there are now additional guided choices for SQLite, MariaDB, Azure SQL Server, Amazon Redshift, Snowflake, Vertica and Actian Avalanche.
  • The Database Output block lets you customise the schema on a per-field basis when creating tables during execution.
  • In Field Organiser, the new NETWORKDAYS formula function lets you easily calculate working days between two dates.
  • If you’re a DoubleClick user, please note, it has been renamed to Campaign Manager.
  • Community blocks:
    • This month’s hot giveaway – new Community block: Field Renamer – just feed it a mapping file containing Old Vs New field names (and your dataset) and it will rename the fields. Faster than typing 100s of new names in the Field Organiser block!
    • Slack API web client: it allows you to call all the public Slack endpoints and methods.
    • Azure Data Lake Storage Gen2 Blob Connector

 

Interface 

  • You can now add notes to every block in the workflow. Useful if you want to explain what you were doing in that 5th Field Organiser block!
  • Report tabs can now actually be shown as … tabs! We’ve kept the default (a drop-down) for space efficiency, but you can now enable actual tabs (as a separate toolbar, or configured to appear on the main toolbar if space permits).
  • In report, the new Styles menu lets you quickly and easily make common style changes to your views, such as setting the font size.
  • Sharing links are now accompanied by QR codes. Useful on a large screen or at a show, and when testing on mobile devices.
  • IE, Legacy Edge and Opera mini are no longer supported.

 

DataViz

  • Filter devices have better defaults. Choice devices will be the default, where the data is categorical.
  • The Map view improvements: you can show arrows on your “Line” layers – useful to show transport flows, for example. A new Layer picker overlay lets your report users choose what layers they see. And you can preview what’s inside GeoJSON files more easily – useful when configuring how the additional data is rendered and merged.
  • Bar, Line and other views now let you make drag-rectangle selections to rapidly and easily select multiple bars or lines.
  • Many views now let you define custom tooltips in a consistent and powerful way, so you can manage what information is displayed on mouse-over in visualisations.
  • Custom Views: “Set parameters and execute” view – it creates an interface where the report viewer can set the new parameter value and trigger a workflow execution

 

Admin, branding, permissions

  • Manual activation in Evo – relevant in cases where ‘online’ activation/deactivation is blocked by the company’s firewall.
  • Improved Admin / Scheduler with multiple working on same tasks/settings.
  • New scheduler actions: Refresh all Report blocks and Publish all output blocks.
  • Fix for Mac activation lost on system OSX software update.
  • Fully brandable welcome/project list.
  • Permission presets: Simplification of applying permissions. Ability to define globally (Admin section) permission presets which you can then choose from in permissions dialog.

 

As always, your feedback is highly appreciated, and we are here for you – if you need help, advice or training to put you in a better shape to deal with data challenges.

Let us be your Q!

Love from #TeamVisokio

The post Omniscope Rock build – 2021.2 appeared first on Visokio.

]]>
https://visokio.com/2021/10/06/omniscope-rock-build-2021-2/feed/ 0 18187
Omniscope ROCK build – 2021.1 https://visokio.com/2021/04/15/omniscope-rock-build-2021-1/ https://visokio.com/2021/04/15/omniscope-rock-build-2021-1/#respond Thu, 15 Apr 2021 22:40:03 +0000 https://visokio.com/?p=17897 Remember those days when you’re packing for a holiday and you keep adding ‘just one more thing’, until you can no longer close the suitcase? That’s exactly what happened with this edition of our Rock build, so we hope you’ll appreciate all the new features...

The post Omniscope ROCK build – 2021.1 appeared first on Visokio.

]]>
Remember those days when you’re packing for a holiday and you keep adding ‘just one more thing’, until you can no longer close the suitcase? That’s exactly what happened with this edition of our Rock build, so we hope you’ll appreciate all the new features arriving in this pack! 

Download the latest rock build here.

Explore mode

Surf your reports in the new Explore mode – interact with data and chart configuration simultaneously and enjoy the immediate effects. Try all four modes on the main toolbar: Explore (for free-form data discovery), Design (for authoring pixel-perfect dashboards), Present (preview the report as your users would see it) and Focus (zoom into a single view, with drag-and-drop fields, measures and dimensions).

We’ve also comprehensively reorganised view options into meaningful sections  such as “Measure axis”, “Lines”, “Bars”, “Markers”, with a cog menu that lets you search everything. 

Improved Authentication – OpenID Connect

Check out the improved authentication methods – support for session-based authentication using OpenID Connect identity providers (Google, Azure, Keycloak, Okta, Auth0) – suite of configurations supporting flexible security models, role-based authentication managed at the provider, identity management and tracking, account switching, single-sign on (SSO), session expiry and refresh, multi-tenant hosting.

The Admin and Scheduler parts of the app are now part of the same authentication scope, with new permissions available at the root level to control access to them.

New “super-groups”, let you define a server-wide or folder-wide configuration of (e.g.) administrator accounts, which cannot be overridden in subfolders. Existing server deployments will find that the admin credentials have automatically been migrated to an equivalent super-group.

Documentation, as usual, available on our Help Center Solutions section.

Publishing on steroids

Publishing 1 report with 100 variants? No worries – we’ve got your back. Report Generator block will automate creation of reports from a template, including the custom tabs/filters driven by a data configuration (different from the multitenant system).

Give your report viewer more than just a variant – add a Refresh Data button, enabling them to retrieve the latest information at any time. 

Integrate email into your reporting process – either for email data harvesting using the new Email block including the ability to download attachments, or to send out data-triggered alerts (from Validation block) and new report links (via Email output).

Filter, drill down and share your data exploration

Share insights by using the new “Sharable link” option, while preserving the exact tab and filter states. Or build links with customised filters yourself, using our scheme to specify filters. Use the new Filters button to hide and show your dashboard’s filters. Show view menus reveals a menu per view, to access data export and maximise controls.

We brought new blocks and the tools to build your own

Meet the new blocks in town: Storage – use it as an input or output, sharing the data by table name across projects. Previously experimental, this has now graduated. It also now lets you write data in “append mode”, such that every time you refresh it, the input data is appended to instead of replacing the existing data. Project Metadata block: extract metadata about blocks, outputs, schema, reports, tabs, data sources from a project, to facilitate “configuration as data” automation workflows.  Spring clean any workflow with new “Clean-up data” action and delete data not used by reports – available as in the workflow app menu, as a scheduler task, and also automatically in the background for older projects. 

Previously experimental, the Custom block lets you create reusable blocks from your own Python or R code, and share them with your team, or publish them on our Github community blocks repository.  Now supporting R 4.x, with an option to select an R version.

Misc

  • The File Output block now has an Append option when writing to IOD files.
  • New formula functions SUBSET_UNIQUECOUNT, TEXTVALUE and INTROUND available in reports.
  • You can add Reference Lines to Bar and Line views, and have better control over multiple axes.
  • The Bar view lets you configure a custom sort measure, supporting formulas.
  • The Workflow API has a new Lambda Workflow Execution endpoint, allowing you to spawn and execute parameterised clones of workflows.
  • The Omniscope Setup Console makes setting up a headless Linux server a breeze, with guided licence activation, configuration of the “external web server”, and setup of an admin account. With a silent mode for fully automated deployments. See the Linux Installation help article.
  • Omniscope now by default runs with restricted filesystem access when running as an external web server (Team license and up). Your workflows and blocks can no longer access files outside the sharing folder by default. You can revert to the old behaviour in environments where this is not a security concern, using “Allow using files outside Sharing Folder” in Admin, web server settings.
  • We’ve renamed the launch scripts on Linux to avoid confusion. The old scripts remain until 2021.2, when they’ll be removed.
  • We’ve updated the version of Java that Omniscope runs on and bundles – now Java 11. This requires some configuration changes to custom deployment scripts and Windows Service configurations; see advisory.
  • After frankly years of suffering as developers, following Microsoft’s lead and schedule, we are finally dropping support for Microsoft Internet Explorer (IE) and Edge Legacy. 2021.1 is the last version to support these browsers, with a warning displayed. 2021.2 will fully drop support. The latest versions of Chrome or new Edge are recommended.
  • Memory: some improvements to efficiency, and new diagnostics for use in production servers.
  • And as always, a huge number of minor enhancements, fixes, stability and diagnostic improvements. See the full changelog for details.

 

WHAT’S NEXT? YOUR FEATURES!

As always, we’d love to hear what you want added to Omniscope. Please contact us to get access and join the discussion at our public Trello board!

The post Omniscope ROCK build – 2021.1 appeared first on Visokio.

]]>
https://visokio.com/2021/04/15/omniscope-rock-build-2021-1/feed/ 0 17897
Omniscope ROCK build – 2020.3 https://visokio.com/2020/10/04/omniscope-rock-build-2020-3/ https://visokio.com/2020/10/04/omniscope-rock-build-2020-3/#respond Sun, 04 Oct 2020 16:30:12 +0000 https://visokio.com/?p=17377 Another quarter, another rock. We’re pleased to announce the latest quarterly Omniscope production-ready “rock” build. The Visokio development cycle marches onwards and upwards, despite these unprecedented times! Download the latest rock build here. NOTABLE NEW FEATURES: Easily break down your data, with Hierarchies Hierarchies let you...

The post Omniscope ROCK build – 2020.3 appeared first on Visokio.

]]>
Another quarter, another rock. We’re pleased to announce the latest quarterly Omniscope production-ready “rock” build. The Visokio development cycle marches onwards and upwards, despite these unprecedented times!

Download the latest rock build here.

NOTABLE NEW FEATURES:

Easily break down your data, with Hierarchies

Hierarchies let you group and collapse/expand your data by successive levels of detail. Date and number fields have implicit hierarchies (year, quarter, month…), and you can define your own custom hierarchies (product category, sub-category…). When you drag on fields which are part of a hierarchy, a +/- button inside the “pill” lets you easily add/remove further levels. And within your dashboard, +/- buttons let users expand and collapse for themselves.

Recycle, Reuse – save time with Bookmarks

With Bookmarks, Omniscope now lets you easily save a block configuration for reuse elsewhere within the same Omniscope installation. Let’s say you’ve configured the perfect Field Organiser block, entered some tricky connection details or SQL query in a Database source block, developed a Custom block using your own handwritten Python or R, or finished a Report block that needs to become a company dashboard template. Bookmark it, and reuse it from the Add Block menu on another project, available to other users (if it’s a shared server).

Data Table block – edit/snapshot the data in the workflow or report

This new block represents an editable and persistent store of data (it’s simply a table of data, hence the name), large or small. You can put data into it (“refreshing” from the input, if connected, as a persistent snapshot of the incoming data), pull data out of it (by connecting blocks downstream), consume directly as live data in the report (no need to execute), and edit it (in the workflow, directly in your reports, and via APIs, if permissioned and enabled, with immediate effect). See introduction and use with workflow execution API.

Salesforce input and output blocks

We’ve added Salesforce source and output blocks, so you can now consume tables from Salesforce in your Omniscope workflows, enrich and correct the data, then publish back.

Categorical axis in Scatter

You can now create scatter views using categorical (text) fields as either axis.

 

And more…

As usual, tons of lesser features and fixes have been added since the previous rock build, including:

  • Workflow APIs now let you execute and set parameter values
  • Much improved performance with large (e.g. 200+ block) workflows
  • Deployment on Windows and Linux VMs from all major clouds (MS Azure, GCE, AWS EC2) fully supported (see advisory)
  • Easily consume JSON data from REST endpoints using the new “JSON HTTP API” block
  • Send emails with data attached using the new Email Output block, and automate sending such emails with batch publishing actions using the Batch Output block.
  • Perform better automatic checks on your data, and consume problem metadata, using the latest enhancements to the Validate Data block.
  • Improved robustness of Storage Block, and workflow execution in general, in high concurrency servers.

 

Community blocks

Over the same time period, a number of notable new community blocks have been shared on our Github repository. These are open-source add-ons which use open APIs within Omniscope to add functionality, and can be found within the Add Block menu:

  • Sharepoint Online Downloader block
  • ForEach block
  • Etherscan block
  • SFTP Downloader block
  • Report to PDF batch output block
  • Web Image PDF output block

 

Advisory notes

Any Omniscope cloud installation (on Microsoft Azure Compute, Google Compute Engine or Amazon EC2) must be deactivated/reactivated before/after upgrading to 2020.3See details.

 

What’s next? Your features!

We’re busy developing OpenID Connect integration for better identity and authentication management, expanded formulas, drill-down, dashboard filters as URL parameters, and smarter defaults for filters.

But we’d love to hear what you want added to Omniscope. Please contact us to get access and join the discussion at our new public Trello board!

The post Omniscope ROCK build – 2020.3 appeared first on Visokio.

]]>
https://visokio.com/2020/10/04/omniscope-rock-build-2020-3/feed/ 0 17377
Rocking after Rock – new Omniscope features https://visokio.com/2020/07/27/rocking-new-omniscope-features/ https://visokio.com/2020/07/27/rocking-new-omniscope-features/#respond Mon, 27 Jul 2020 11:03:38 +0000 https://visokio.com/?p=17287 Difficult times can help spark creativity, so we’ve tried to use this tricky period to inspire some clever solutions. Take a look at these new features – they should bring a smile to your face. Data editing Data Table block in the workflow, linked to the...

The post Rocking after Rock – new Omniscope features appeared first on Visokio.

]]>
Difficult times can help spark creativity, so we’ve tried to use this tricky period to inspire some clever solutions.

Take a look at these new features – they should bring a smile to your face.

Data editing

Data table block

Data Table block in the workflow, linked to the improved Table View in the Report, empowers project editors and report viewers to snapshotquery and edit data, to amend mistakes or add comments and push the edited data ‘upstream’ into the workflow. Read more

Data validation

Validate data block can automate multiple data quality scans, such as data schema and values. Create alerts should something fail the criteria or add an output with diagnostics report, telling you about everything that failed, so you can quickly identify the problems. More..

Screen Shot 2020-07-22 at 17.38.29

Data alerts

Email block makes communication an integral part of the data management process: notify the report viewer that their report is ready, or let the analyst know they need to fix something, by sending them those validation diagnostics.

Before you ask – email output is integrated with the Batch output block, so you can use it in the multi-user publishing scenarios. More…

Block bookmarks
Screen Shot 2020-07-22 at 19-45-05

Bookmark frequently used workflow blocks to avoid having to configure them repeatedly – works for the multi-tab Reports and coding blocks too!
Find more here

Salesforce integration

The Salesforce connector is now added to Evo, making it easy to integrate SF API with data coming from other sources to create a complete overview of your business, edit the CRM data, even publish it back to Salesforce, should you wish to.  Read more

Finally – we’ve added some features to make the report formatting easier.

As usual, make sure to check our changelog to see features making their way daily.

 

Stay tuned, stay safe and let us know if you have any feedback

#TeamVisokio

The post Rocking after Rock – new Omniscope features appeared first on Visokio.

]]>
https://visokio.com/2020/07/27/rocking-new-omniscope-features/feed/ 0 17287
Omniscope ROCK build – 2020.2 https://visokio.com/2020/06/01/omniscope-rock-build-2020-2/ https://visokio.com/2020/06/01/omniscope-rock-build-2020-2/#respond Mon, 01 Jun 2020 17:32:55 +0000 https://visokio.com/?p=17250 We’re pleased to announce the latest quarterly “rock” build of Omniscope, version 2020.2 b20956. A rock build marks the end of a development phase (2020.2) with a build that has passed extended manual and automated testing and is suitable for production deployments. Download the latest...

The post Omniscope ROCK build – 2020.2 appeared first on Visokio.

]]>
We’re pleased to announce the latest quarterly “rock” build of Omniscope, version 2020.2 b20956. A rock build marks the end of a development phase (2020.2) with a build that has passed extended manual and automated testing and is suitable for production deployments.

Download the latest rock build here.

NOTABLE NEW FEATURES:

New Map view in production

This ROCK brings a production-ready version of the new Map view, as introduced experimentally in 2020.1. You can now blend GeoJSON, Shapefiles and KML files with report data, and create multiple layers of points, lines and area fills on top of customisable base maps.

We’ve replaced the previous Map and Choropleth views; existing reports will automatically be migrated to the new Map view with identical appearance. All missing functionality has been added: selection, data export, colour keys, clustering, zoom modes, bundled GeoJSON files.

 

Working Copies of projects

Working Copies let you maintain separate but linked “master” and “development” copies of projects (workflow, reports and local execution data), to easily but safely control updates to your production dashboards with a click. You can keep both files on the same server, or for total isolation, use separate production and development servers or a production server and multiple local desktop installations. More….

 

Formula measures

These let you plot dynamically calculated values in views such as the Bar and Pivot, using simple expressions in Omniscope’s Excel-like formula syntax. In this HR data example, by department, we’re showing the average age of women compared to the average age for all sexes:

 

Copy/paste within Reports

It’s now much easier to reuse parts of your dashboard and save time with repetitive configuration. Report tabs, styles, views and fields can now be copied to the clipboard and pasted into another report – which can be in a different project, or even on a different Omniscope installation. The target will need a compatible data schema and the same installed Omniscope version. More…

 

Publishing

Editing and workflow API in reports

In addition to the query and custom view APIs, Omniscope 2020.2 brings a new Workflow Execution REST API, allowing custom views or 3rd parties to programmatically trigger and monitor execution of part or all of the workflow, typically used to update the data in the report when required.

We’ve shared a community custom view which demonstrates the new API – you can use this in your dashboards using “Workflow Execution” in Add View menu, or view the source on GitHub when developing your own custom view. Documentation.

This is part of an expansion of editing functionality within Omniscope which you’ll see more of in 2020.3. See the blog post.

Enhancements to Multi-tenant reports

Last ROCK saw the introduction of multi-tenant reports, where a single report can become multiple variants for different data subsets based on the visiting user. This ROCK, we’ve added “Scenario” URL fragments, where a portion of the visiting URL can be used to influence the report variant. Documentation.

You might use this if you have your own authentication framework outside of Omniscope, or to automate generation of PDFs for each variant, as seen here using the community custom block “Report to PDF batch output”.

Smoother dashboard data refresh

We’ve improved the experience in reports/dashboards, when a data refresh happens. Omniscope now preserves the existing dashboard and its previous data while a refresh/execution is ongoing, and swap-in the new data only when ready, with a brief and unobtrusive update.

We’re also now preserving the per-session filters of read-only visitors, when a data refresh arrives.

 

Other improvements

Turbo-charged performance

This ROCK includes significant performance improvements to Omniscope Evo. General server-side performance has been improved many times over, and we’ve reduced I/O overhead on production servers.

Better automation with Scheduler

  • A new “retry” task configuration option, letting you retry a specified number of times if a task fails.
  • Importing tasks using drag and drop, making it easier to backup or migrate scheduler task configurations.
  • A new log file “service_scheduler_task_log.csv”, well structured in CSV format, with a row per task execution, with data including start time, end time, outcome etc., making it much easier to monitor and analyse scheduled tasks using Omniscope itself.

 

Report views/visualisations

  • Custom markers in Scatter/Line
  • Improved menus for adding and changing measures and groupings.
  • More responsive filter/variable sliders
  • De/normalise split axis in Bar/Line/Area
  • Cascading option in Line
  • Configurable “Other” in Bar
  • Logarithmic axis in Line/Scatter
  • Connect markers in Scatter
  • Expand/collapse all in Filters
  • Cell alignment in Table

 

Workflow

  • Option to select fields to retrieve in Database Source block, and to limit or disable preview data.
  • Option to specify custom HTTP headers in the File block when accessing a URL, e.g. to specify an auth token.
  • Append block improved performance

 

Advisory notes

Omniscope Classic users

Omniscope Classic’s Map view has been updated to use modern MapBox styles, ensuring maps continue to be displayed correctly after MapBox remove support for their classic styles in future. If you’re using Omniscope Classic, or are running an Omniscope server hosting legacy “Mobile” web versions of Classic IOK reports, you are strongly advised to install this update.

Mac users

From 2020.2 onwards, we’re providing the Mac version as a TGZ file rather than DMG; after installing (downloading and extracting to Applications), you will need to manually trust the application in the OS X system preferences.

 

WHAT’S NEXT?

As usual we’re already busy working on 2020.3. Look forward to richer data editing capabilities within your reports, bookmarks in the workflow, a new Exploring mode, wider cloud deployment options, more intelligent defaults in your reports and views, and much more!

As usual, please let us know your feedback at support@visokio.com. Stay safe!

The post Omniscope ROCK build – 2020.2 appeared first on Visokio.

]]>
https://visokio.com/2020/06/01/omniscope-rock-build-2020-2/feed/ 0 17250
Omniscope ROCK build – 2020.1 https://visokio.com/2020/02/11/omniscope-rock-build-2020-1/ https://visokio.com/2020/02/11/omniscope-rock-build-2020-1/#respond Tue, 11 Feb 2020 21:46:58 +0000 https://visokio.com/?p=17090 The latest quarterly “rock” build of Omniscope, version 2020.1 b20848 is out now! A rock build marks the end of a development phase (2020.1) with a build that has passed extended manual and automated testing and is suitable for production deployments. Download the latest rock build here....

The post Omniscope ROCK build – 2020.1 appeared first on Visokio.

]]>
The latest quarterly “rock” build of Omniscope, version 2020.1 b20848 is out now!
A rock build marks the end of a development phase (2020.1) with a build that has passed extended manual and automated testing and is suitable for production deployments.

Download the latest rock build here.

Notable new features:

New report user experience

The interface for designing reports in Omniscope Evo has been significantly improved. We’ve removed the right sidebar in design mode to give more space to the report itself. In the left sidebar, Views tab, browse Omniscope’s rich array of “views” (charts, tables, visualisations etc.) and add to the current page by dragging or clicking:

The Data tab shows the fields in a selected report data source, and lets you customise their formatting:

And if a view in the report is selected, you can drag and drop these fields into the view to configure the view’s axes and data-driven styling:

The Settings tab, without a view selected, shows page-level settings. Here, Image is expanded, showing how I’ve configured an image to blend over the report, as introduced in 2019.3:

But if you have a view selected, the Settings tab shows view-specific settings. Here, I’m searching for “title” within all the options for the selected Bar view. This also shows how the primary controls for the selected view are now attached directly around the view, which helps understand how they relate to the selected view and its axes:

When focusing/zooming into a single view, a thumbnail appears at the bottom of the sidebar, letting you see where the view sits within the report. You can click on the thumbnail to pick another view. It’s another way to explore your data, with more space given to each view:

And if you have a larger screen and still want the right sidebar, the pin button lets you bring it back:

Undo in reports

We’re a little embarrassed it took us so long, but you can now undo your configuration edits within a report. Delete a view or change a setting by mistake? It’s one click to bring it back:

Drag and drop files

We’ve made it easier to work with files in Omniscope Evo. You can drag and drop files onto the welcome page, and upload them individually or in a group:

When you upload a data file (CSV, XLSX etc.), you’ll be offered to create a project for it…

… immediately showing the data within:

Sort and search files

In the Welcome page file list, you can now sort

… and search (within the subtree of files, providing they have the same security scope):

You can also bookmark the page URL, to be able to revisit the same “query” in future.

Project attachments

Within a report, you can attach files to the project. Attachments are part of the project, and are copied and exported/imported with the project. For example, the new Map view lets you attach GeoJSON files:

The Image and Content views, and report image setting, also let you attach image files this way. See the previous example (further above) of a lighthouse image attachment.

Community blocks, and the new custom block

A while back, we introduced community blocks: a Github repository of blocks developed independently of the Omniscope release cycle. These are a lightweight way for both Visokio and 3rd party developers to provide workflow blocks that provide niche or missing functionality on-the-fly without needing a new Omniscope update, using Python or R code. We use these ourselves as part of our bespoke solutions, and to prototype new functionality; it’s also a way for our partners and clients to share their efforts. As an end user, you can use these blocks just like core blocks (though not to the same high standard), using the Add Block menu:

For example, here I’ve added the Interval join community block (also see demo of this block), which lets you join two datasets by matching each left record by whether its date/number is within an interval defined by two right date/number fields. The block provides some options to the end user:

But if you open the Design tab, you’ll see how it was built (in R), and can customise or adapt if desired:

To code from scratch, find the Custom block in the Add Block menu (currently experimental). We support Python and R coding languages (this may expand in future), and provide automatic package dependency management. Here’s the Design tab of a blank new custom block, which by default passes data through, ready to start coding:

If you have developed a reusable Custom block and want to share with others or keep for future use elsewhere, you can export as a zip file…

… and import into another project using the Add Block menu:

If you want to publish it on our Github repository, submit a pull request there, or instead simply export as a zip and send it to support@visokio.com.

Multi-tenant reports

This ROCK introduces the ability to tailor reports dynamically to the visiting user. We expect this functionality to expand in future, but currently you are able to restrict which rows/records the user sees based upon their authenticated user name or group name.

This allows you to create one report with one master dataset, then let only Client A see Client A’s records, Client B see Client B’s records, and Administrators see all records, for example. Data seen in the report is automatically filtered server-side on the fly, securely.

This simple demo shows it working:

Here, the 2nd input contains a record for each “scenario”. This is used to configure the restrictions when accessing the report externally on its Sharing URL. Note that multi-tenant reports use data-driven configuration, so although the example above uses a Text Input block to provide this configuration, you can scale to much more complex configurations by querying an external database of users and using a chain of blocks as needed. For example:

In report sharing settings, a Multi-tenant configuration section lets you choose this input:

And that’s it. When “sally” logs in, she sees records where the “department” field has value “sales”, an so forth. With one central configuration for the report and data source. For full docs, see here.

Experimental Map 2 (layers) view

We’re in the process of greatly expanding our mapping functionality in Omniscope Evo, with the goal to replace the existing Map and Choropleth views with a single, simple yet powerful, multi-layered new Map view:

This new Map 2 (layers) view is now available in experimental form, meaning you can explore it and use it with the caveats that: we may change it in breaking ways in future versions, it has some missing key functionality, and may have some minor instabilities. Ultimately, likely in the next quarterly ROCK, it will appear as the only “Map” view, replacing existing Map and Choropleth.

The new view lets you add multiple layers in the view configuration. Each layer will be composed on the same map, with data coming from report data or from an attached or externally referenced GeoJSON, ESRI Shapefile (SHP) or Google Earth KML file. You can also add geo-located images and videos, with other map layer types coming soon:

For example here’s a choropleth (region-fill) of part of the UK, provided using an attached GeoJSON file, live-joined to report data using a match between attributes in the GeoJSON and the report data, coloured to show aggregate metrics, with raw points of record data overlaid on top. The default base map (from Mapbox) has been turned off in this case: 

For further reading, see our Knowledge Base article Using the Map view.

Misc

Some other minor changes:

  • We’ve added an administrative section to let you change the server’s language (used by default on clients, unless they’ve configured a different language) and data locale (how numbers and dates are formatted).
  • The Filters view lets you customise the text style of the filter device headers and content.
  • For advanced use, you can now deploy multiple Omniscope server instances on the same host, for workflow execution without reporting. See guide.
  • The ElasticSearch connector now lets you choose which fields to import, which can improve performance.

For a more detailed list, see the changelog.


What’s next?    

Development of the next version (2020.2) is well under way with the first builds available soon. Some features to look forward to, many of which will appear in 2020.2:

“Create working copy + publish” methodology

If, for example, you have a production server, and a dev/test server or local desktop installations, you’ll have an easier way to work safely, by creating “working copies” of a master project, playing to your heart’s content without affecting the master, and publishing back only when ready, with a simple user experience throughout.

Custom block

We will build upon this recently added block to let you work directly within your IDE (e.g. Jupyter, R Studio) to code and debug your scripts, whether building blocks for use in a workflow, or doing ad-hoc data science needing to invoke Omniscope programmatically.

The new Map view

We’ll continue developing the experimental new Map view to wholly replace the existing Map and Choropleth views, including additional new functionality such as point-to-point/spider plots, raster tiles, vector tiles with configurable sub-layers, and micro charts/pie overlays.

Further Report and View configuration UX improvements

We’ll be adding a new Exploring mode, for when you’re exploring new data in Omniscope, looking for insights, rather than fine-tuning a beautiful dashboard. It will allow you to explore and configure in one flat experience, without needing to select views or switch modes.

We’ll also be restructuring and improving the view options, to make them much more logical and easier to navigate, and consistent across different types of view.

We’ll be implementing much more intelligent defaults for reports, views and filters, so there’s less clicking needed to discover your data, visualise with colour, or create reports.

And more:

  • Adding missing options such as field selection to the database source, and pre/post sql to the database output.
  • A series of community Custom blocks which demonstrate how to connect Omniscope to popular data science / analytics libraries to leverage their capabilities and share with your non-data-scientist colleagues.
  • Better UX in the Admin and Scheduler apps, to make it easier to navigate and manage complex configurations.
  • Better collaboration features in projects: in-page chat, and version history.

As usual, please let us know your feedback at support@visokio.com. Have fun!

The post Omniscope ROCK build – 2020.1 appeared first on Visokio.

]]>
https://visokio.com/2020/02/11/omniscope-rock-build-2020-1/feed/ 0 17090
Omniscope ROCK build – 2019.3 https://visokio.com/2019/10/30/omniscope-rock-build-2019-3/ https://visokio.com/2019/10/30/omniscope-rock-build-2019-3/#respond Wed, 30 Oct 2019 16:25:22 +0000 https://visokio.com/?p=16948 We’re pleased to announce the latest quarterly “rock” build of Omniscope, version 2019.3 b20709. A rock build marks the end of a development phase (2019.3) with a build that has passed extended manual and automated testing and is suitable for production deployments. Download the latest rock build...

The post Omniscope ROCK build – 2019.3 appeared first on Visokio.

]]>
We’re pleased to announce the latest quarterly “rock” build of Omniscope, version 2019.3 b20709. A rock build marks the end of a development phase (2019.3) with a build that has passed extended manual and automated testing and is suitable for production deployments.

Download the latest rock build here.

Notable new features:

Summary charts in Tables

The Table view can now show summary charts, “micro views” in the table header which instantly tell you at-a-glance info about the top unique values or number/date distribution of the field:

You can switch between none, header charts, and overlay charts, using the top-left chart icon. In reports, these are hidden by default. In the workflow block dialog’s “Data” tab (shown above), these are shown by default.

Misc. improvements to the Workflow

Key shortcuts Ctrl+Z, Ctrl+Shift+Z have been added for undo/redo, respectively.

The toolbar is much cleaner and simpler; you can now duplicate and delete selected blocks directly from the toolbar:

The “Batch append folder” and “Append files” now support JSON and XML files, and the “File” block now has automatic configuration for importing data from XML files. The “Elasticsearch” block now supports Public Key Authentication (PKI).

Misc. improvements to Reports and views/visualisations

Report tabs now support a Tab background/overlay image, allowing eye-catching dashboards:

You can also use the Image view to place images, optionally linked, easily within your dashboard.

The Bar view now lets you configure a “dual axis” view with 2 parallel/interleaved measures on different left/right scales:

The Bar, Line, Area and related views now let you choose to hide null values, have better automatic histograms for integer fields, and show a “continuous” axis for number/date fields, supporting cleaner split-axis labels:

Stacked bars have much better default/automatic stack labels; you can also use the “Reverse” option in the Bar view to invert Y axis, useful for cases where you want to show an implicitly negative measure:

The Content view lets you insert “micro-charts”, a set of views optimised for a small size, within the text of the Content view. You can, for example, create your own table layouts combining formulas and “sparklines” or mini pie charts:

The Table, Chart and Details views have a much improved field picker, letting you easily select and deselect fields individually or all at once.

The Scatter view has a new “Trend line” option, for unclustered points.

The Sankey view for relational data has been much improved, though remains experimental until we add support for other data formats/models.

The Pivot view lets you select (sub-)total cells, and exports data in the same column/row/cell structure as displayed, in CSV format.

Filters now allow you to show “Choice” filter types as a drop-down, to save space, and to configure “sort by frequency”; you can also configure a “single choice” option which shows a ‘radio’ single-select list of values.


Parameters

Parameters are a hugely powerful and versatile addition to support centralised administration and automated publishing. A parameter is a reusable named value that can be defined in a project, or server-wide in Admin:

(Project parameters in workflow)

(Server-wide parameters in Admin)

(Using a parameter)

Your workflow can refer to these parameters in place of literal values for most block options. For example, you might want to parameterise the Database block’s “host” setting, allowing you to centrally reconfigure all database blocks for a replacement database server.

You can also use the Scheduler tasks “Edit project parameters” and “Edit app-wide parameters” to automate changing of parameter values, e.g. to execute a workflow with a different client’s data:


Language translation

Omniscope Evo now supports translation into arbitrary languages, with near-complete translations bundled with Omniscope for French (thanks to Magali Colin of Avizua) and Italian (shown below), and the ability to add your own custom translations for other languages.

The server default language is configured in Admin; users can override this in their browser using the language ‘flag’ icon in the app. New projects capture the language settings of the user at the time they are created; workflow execution respects the project’s language where blocks produce warnings or errors, for example; reports respect the user’s language if different to the project’s.


Other changes

The welcome page now has a language option (flag icon) and navigation sidebar:

The default app font has changed throughout from Roboto to Lato, a more modern and crisp font with better legibility (of course you can configure a font of your choice in report settings).

The Scheduler “Reconfigure block” task can now automate edits to most kinds of workflow blocks e.g. File, Append, etc.

For a more detailed list, see the changelog.

What’s next?

Development of the next version (2019.4) is well under way with the first builds already available. Download the latest daily build here. Some features to look forward to, many of which will appear in 2019.4:

Custom Script block

This new block, which replaces the existing Python and R blocks, with better performance, and allows you to create reusable blocks with your own set of options, which can be shared with your users via import/export, shared repositories, and Github. It will let you work productively with your own IDE as you develop the block, or use Omniscope as a “slave” for data sources and data visualisation, when doing (e.g.) Python-centric data science. The 2019.3 rock, above, includes an early, experimental and incomplete version of this.

A new Map view

Supporting multiple base maps and data-driven layers from different data sources, including Choropleth, area fills, polygons/polylines, point-to-point/spider plots, markers, raster tiles, images, vector tiles with configurable sub-layers, micro charts/pie overlays, geojson, shapefiles, high-performance / larger data volumes…

Undo/redo in Reports

Common mistakes such as deleting a view will be reversible in a click, tap or keystroke.

Multi-tenant reports

Data-driven configurations to dynamically create user-specific tailored experiences of a report, with different row/column subsets of the data, different tabs, different branding, …

Better Report configuration user experience (UX)

Using the Report to explore your data or build dashboards will become more fluid and intuitive.

View options will be better presented, and easier to navigate and understand.

Better support for creating, administering and understanding your report’s saved/named queries.

More intelligent data-driven defaults for reports, views and filters.

Better automatic data colour palettes.

Device-specific dashboard previews.

Parallel and push-based execution

A more powerful workflow execution engine, making better use of parallelism and allowing editing workflows while they are executing. Push-based execution, and streaming continuous event-based data.

And much more…

Search & sort files on the welcome page.

Formula measures in Bar, Line etc. views.

More ways to copy/paste various settings within and between projects.

Project and Report commenting and history.

Bookmarks, for saving and reusing blocks and groups of blocks in the workflow.

As usual, please let us know your feedback at support@visokio.com. Enjoy!

The post Omniscope ROCK build – 2019.3 appeared first on Visokio.

]]>
https://visokio.com/2019/10/30/omniscope-rock-build-2019-3/feed/ 0 16948