We live in a data world, in which 40000 search queries happen every second on average, which works out at over 3,5 billion searches per day and 1,2 trillion searches per year worldwide. Added to this, 3,5 billion smartphone users sending messages, uploading video and photo content and using other apps on their phones which create data according to Statista.
Many industries, including banking, discrete manufacturing, professional services and process manufacturing, as well as federal/central government are investing in big data analytics (BDA) solutions.
There are many benefits, but there are also concerns around the quality and management of data, as well as how it is generated, used, stored and protected.
Getting the framework right
The IEC and ISO joint technical committee which develops international standards for artificial intelligence (ISO/IEC JTC1/SC 42) has published part 3 of a series of standards for big data.
The main aim of ISO/IEC 20547-3:2020, Information technology — Big data reference architecture — Part 3: Reference architecture, is to facilitate a shared understanding across multiple products, organizations, and disciplines about current architectures and future direction.
“In a world of digital transformation fuelled by insights and analytics, the data ecosystem is paramount. Big data revolutionizes IT systems to efficiently address the needs of the application domain by considering the characteristics of the data being processed. The Big Data Reference Architecture (BDRA) international standard and its companion series will accelerate the adoption of this enabling technology by providing an architectural framework and common language for the various stakeholders”, says Wael William Diab, who leads the standardization work.
Speaking a common language
Developers will be able to use the standard which provides an architecture framework for describing the big data components, processes, and systems to establish a common language for the various stakeholders. It’s a tool for describing, discussing, and developing system-specific architectures using an architecture framework of reference, which would cover requirements, structures and operations inherent to big data.
e-tech magazine talked with experts who developed the standard to learn about how it addresses the big data ecosystem (from the user and functional viewpoints), the audiences it covers (data users, providers and consumers) and other aspects, such as data security and privacy and aspects related to the big data analytics lifecycle.
Read the full interview.