Posts

The Art of Adding Common Sense To Data And knowing When To Dismiss It…

SynerScope

At Synerscope, helping people and notably domain experts, making sense of data is our core business. We bring both structured and unstructured data to use and we focus on combining the most advanced and innovative technologies with the knowledge and brainpower of the people in our customers’ business. Our specially developed visual interface allows domain experts to be directly plugged into the AI analysis process, so they can truly operate side-by-side with data scientists to drive results.

Thinking of the first needs in business continuity following on from the corona outbreak, we recently developed a GDPR compliant Covid-19 radar platform (https://www.synerscope.com/). Our Covid-19 radar supports the tracking and tracing of your personnel and provides HR specialists with ways for rapid and targeted intervention in the event an outbreak should hit your company after having come out of lockdown. Returning to work safely requires your HR departments to be equipped with more information to act upon. We can deliver these insights through our novel ways of handling all the data at hand.

Data, Artificial Intelligence & Common Sense

Due to Covid-19, data and the insights it provides have become an absolute must, as organizations base their decisions on data & analytics strategies in order to survive the outfall of the pandemic.

Making sense of the enormous influx of corona related data that is coming our way, we need Artificial Intelligence and Machine Learning to help master this. However, human common sense & creativity are equally needed in order to teach AI its tricks, as data becomes only meaningful when there is context.

It will be extra impactful as the call to rescue the economy and open up companies sooner rather than later is getting stronger. We have to take into account that we need to track, trace and isolate any cluster of direct contacts around new corona cases as quickly as possible, as not to hinder any progress made while also adhering to the prevalent GDPR rulings in Europe.

 AI Wizardry: it all stems from common sense

For any automated AI to deliver its best value, the models need training and the data input needs to be well selected. Training AI and selecting data are both dependent on human sense making, thus are best applied early on in the process. The quality and speed of human information discovery and knowledge generation depends on both the expertise and the richness of context in the data. Luckily that same AI can help experts to digest a much wider context faster than ever before. When you couple large diversity of expertise with a wider context of data the outcome of the analytical process clearly wins.

When and how do you best involve those people that bring context and common sense to the table? They will add the most value when locating useful data resources and validating the outcomes of algorithmic operations. Leveraging AI should therefore be an ongoing process: with the help of automated unsupervised AI domain experts a data scientist can identify data sources, amass and sort the data, then have data scientists add some more AI and ML wizardry. The outcomes will be presented to the people with the best common sense and with plenty of domain experience. Based on their judgment the algorithms can be optimized and repeated. Following this approach, companies are able to accelerate their progress in AI and learn and improve faster. Equipped with the right tooling and a small helping hand from data scientists, the domain experts will for sure find their way in and around the data themselves: we believe these so called citizen data scientists have a big future role to play in gaining more insight from data!

Reasoning by association

People with business sense help to continuously improve AI by injecting their common sense in the AI system. And what’s more: they add a key substance that typical AI is still missing, which is the capability of causal reasoning and reasoning by association. Enhancing AI with associative and creative thinking is groundbreaking. That’s exactly where our SynerScope technology sets itself apart.

We shouldn’t view AI as a black box, it is too important for that. In our vision, humans and technology are complementary: humans should have the overall lead and control but during the analytics process we should recognize for which steps we give the controls to our computer and let technology guide us through the data. Think of the self-driving car for a minute; while its ABS is fully automatic we still keep a finger at the steering wheel.

Unknown unknowns

As always, there is another side to the value of human contribution in AI. People tend to stick to what they already know, to relate to the context they are familiar with, i.e. to keep a steady course. But we want to ‘think out of the box’ and expect AI to help us with that.
Genuine paradigm shifting AI should help us master the ‘unknown unknowns’. Present us hidden insights and business opportunities that traditional ways of thinking will never unearth, like the cure for a disease that nobody ever thought of, or get the best scenario out of a number of variables too large to be handled by the human brain alone.

To select from the patterns of data that AI helps reveal, again you will need people, but a different kind: people that are fresh in the field, without being primed by too much knowledge, and are not encapsulated in corporate frameworks. And with the right technology solutions to help them find their way in the data, they are able to thrive and your company along with them.

Enabling humans to master all data

Synerscope creates and uses technology to augment intelligence on its way to a data-driven universe. We have developed groundbreaking inventions, some of which are patented. Our products & solutions are in use with some of the world’s Fortune 1000 companies. We are happy to partner with the leading Cloud providers of this world. SynerScope’s solutions provide Intelligence Augmentation (IA) to domain expert users that will make them 20-50x faster at extracting information from raw data. We focus on situations and use cases where insight goals and data inputs are by default not well predefined. And in situations where reaching full-context knowledge requires linking data from text, numbers, maps, networked interactions, transactions, sensors and digital images, in short we combine structured data with unstructured data and everything in between.

If you would like to listen & learn more about our view of the data & analytics market and our solutions, please click here to watch a short video (video SynerScope The Movie: a futuristic vision) or you can contact us by email: info@synerscope.com or call us on +31-88-ALLDATA.

How to manage End User Computing and avoid GDPR or IFRS fines

Author: Jan-Kees Buenen

I’ve long said that End User Computing (EUC) is here to stay, whether we like it or not.

EUC applications such as spreadsheets and database tools can provide a significant benefit to companies by allowing humans to directly manage and manipulate data. Unlike rigid systems like ERP, EUC offers flexibility to businesses and users to quickly deploy initiatives in response to market and economic needs.

However, EUC has become the villain in the big data story. EUC flexibility and speed often lacks lineage, logs and audit capabilities.

The risks of the incomplete governance and compliance mechanisms of EUC are not new. Organizations are pretty aware of the accidents they cause: financial errors, data breaches, audit findings. In the context of increasing data regulation (like GDPR and IFRS) companies struggle to embed EUC in a safe way in their information chains.

GDPR and the impact of EUC

GDPR (General Data Protection Regulation) was enforced on May 25, 2018. It is a legal framework that requires businesses to protect the personal data and privacy of European Union citizens.

Article 32 of the GDPR addresses the security of the processing of personal data. These requirements for data apply to EUC as well.

Article 17 provides the right to be “forgotten” for any individual. Companies have to precisely control data so there is no leftover data lying in unmonitored applications if the user decides to be deleted from all the systems.

The recent financial penalty of 53 Million euro against Google is a concrete example of what may happen to other companies. In accordance with GDPR, Google was fined for lack of transparency, inadequate information and lack of valid consent regarding the ads personalization.

The challenge of EUC applications: they generate data that largely remain in silos, also known as dark data.

IFRS and the impact of EUC

IFRS (International Financial Reporting Standards) aims at bringing transparency, accountability and efficiency to financial markets around the world.

The new compliance requirements, like the new IFRS9 and IFR17, include data at much more defined levels than ever before. Data that currently flows to and from EUC has to be traced, linked and precisely controlled by knowing its content.

Having a higher emphasis on the control environment, workflow and ability to adjust at a very detailed level is key as disclosure and reporting requirements increase.

Using SynerScope to manage the data linked to End User Computing

Organizations have to recognize that EUC falls under the purview of data governance. Any organization that deals with data – basically every organization – has to manage and control such apps so they are able to act immediately to ensure compliance.

SynerScope solutions offer 2 key ways to reclaim management and control over data:

1. Single Pane of Glass

The first solution to reclaim control is to gather the company’s entire data footprint together. Both structured and unstructured data in one unique space: a single pane of glass.

SynerScope offers an advanced analytical approach to include and converge unstructured and semi-structured data sources. All applications from different back-ends are gathered in a unique space. A single, powerful platform for operational analytics that replaces disjointed and disparate data processing silos.

2. Data protection within EUC

The second approach to reclaim control over EUCs is to track and trace all applications, their data and the respective users.

Synerscope combines a top-down overview with all the underlying data records, making it easy to investigate why a certain business metric is off, and where the changes came from. It fluently analyzes textual documents and contracts to help spot the differences between tons of thousands of documents in the blink of an eye.

Furthermore, an extra layer on the top of all data to control outcomes and keep data to check for governance and compliance.

Two powerful tools to get control and insight into End User Computing Data

SynerScope Ixiwa provides a more effective approach to data catalogue and data lake management for business users. Ixiwa is a data lake (Hadoop and Spark-based) management product that ingests data automatically, collects metadata about the ingested data (automatically) and classifies that data for the company. While Ixiwa will often be deployed as a stand-alone solution, it can also be viewed as complementary to third party data cataloguing tools, which tend to focus on structured data only and/or have only limited unstructured capability.

SynerScope Iximeer complements Ixiwa. It is a visual analysis tool that has the ability to apply on-demand analytics against large volumes of data, for real-time decision-making.

Figure 1: SynerScope Ixiwa and Iximeer provide a more efficient and visual approach to data management and analytics

What to do next?

If your organization is concerned about the new IFRS or GDPR regulations and you are searching for solutions to ensure compliance, please contact us to learn more.