{"id":3589,"date":"2021-04-23T07:29:22","date_gmt":"2021-04-23T06:29:22","guid":{"rendered":"https:\/\/bestdatasolutions.es\/business-intelligence-technologies\/big-data\/"},"modified":"2021-07-02T14:17:38","modified_gmt":"2021-07-02T13:17:38","slug":"big-data","status":"publish","type":"page","link":"https:\/\/bestdatasolutions.es\/en\/business-intelligence-technologies\/big-data\/","title":{"rendered":"Big Data"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t
<\/div>
BIG DATA<\/div>

AN ENDLESS WORLD OF POSSIBILITIES<\/p>\n<\/div><\/div><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Big Data<\/h1>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The term “Big Data” was originally associated with three key concepts: large volume of data, variety and complexity of data, and speed of processing. <\/p>\n

Over the last decade, the amount of data available has grown exponentially as different types of data sources and origins have been added such as mobile phones and wearables, social networks, RFID tags, cameras, vehicles, TV’s and IoT devices, among others. There is no doubt that there is now a huge volume of data available and therefore the concept of “Big Data” has evolved, becoming more associated with the strategies, methods and tools used for its processing.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Is Big Data replacing Business Intelligence?<\/h3>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

No, quite the opposite, they complement each other very well. The main difference with traditional BI is a technical issue: how we are going to store the data, what tools and architecture are going to be used and, finally, what strategies to apply.<\/p>\n

Both concepts pursue the purpose of “making relevant and reliable information available, to the right people, at the right time” to support better decision making, as quickly and efficiently as possible.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"Big\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"Big\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

However, processing large (huge) volumes of data of different types and origins, unstructured (or at least a large part of it), in near real time, requires different strategies and tools than BI. <\/p>\n

What is this unstructured data? e-mails or text strings, photographs, videos, audios, geo-references, sensor values and results of applying AI on any of these, among others.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

\"Not everything that counts can be counted and not everything that can be counted counts\".<\/h4>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t
Albert Einstein<\/h5>\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Architecture and Big Data Tools<\/h4>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The information management cycle consists of four main stages: data collection, storage, processing and application. Particularly in Big Data, the architecture will be characterised by:<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Distributed file systems<\/h3>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

To facilitate the storage of large volumes of raw data<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

NoSQL databases<\/h3>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

For the storage of unstructured data<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

In-memory DB<\/h3>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

As a consequence of processing data with these characteristics<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t\t\t\t

This provides a solution to the three concepts that characterise the concept of Big Data mentioned above.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"The\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Various technological ecosystems can be formed in which to develop a Big Data solution. The possibilities are endless, but it is worth highlighting tools such as Apache Hadoop<\/strong>, MongoDB<\/strong>, Jupiter<\/strong>, Apache Spark<\/strong>, Elasticsearch<\/strong>, Apache Storm<\/strong> and Apache Kafka<\/strong>, which are probably the most widely used tools today.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t\t
<\/div>\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

\"I only trust the statistics I have manipulated\".<\/h4>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t
WINSTON CHURCHILL<\/h5>\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Challenges in Big Data<\/h4>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The quality of the data and the fairness of the code, the security and confidentiality of the system, and the ethics with which the information is treated are the most important challenges in Big Data.<\/p>\n

Not all data generates information, but yes, all data has a cost associated with collection, processing, storage and eventual discarding. Currently, less than 2% of data is used by organisations in the decision-making process and it is estimated that of the total volume of data, 25% to 30% will have value to contribute to the decision-making process. <\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t

Do you need our help?<\/h4>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\tCONTACT US<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

BIG DATA AN ENDLESS WORLD OF POSSIBILITIES Big Data The term “Big Data” was originally associated with three key concepts: large volume of data, variety and complexity of data, and speed of processing. Over the last decade, the amount of data available has grown exponentially as different types of data sources and origins have been […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":3567,"menu_order":40,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-3589","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/pages\/3589","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/comments?post=3589"}],"version-history":[{"count":0,"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/pages\/3589\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/pages\/3567"}],"wp:attachment":[{"href":"https:\/\/bestdatasolutions.es\/en\/wp-json\/wp\/v2\/media?parent=3589"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}