Procedimiento para el Análisis de Comportamiento Meteorológico Utilizando el Módulo Big Data de la Herramienta Pentaho.

Abstract

Currently the large amount of data in different areas is growing continuously at a high speed, with great variety in your data and where you have to preserve the integrity of them so that their value is not lost. Here the analysis of Big Data plays a fundamental role by applying modern software tools to store, process and discover valuable information that contributes to the solution of various problems. This work contains a detailed description of all the activities that must be followed to carry out a process of treatment and processing large amounts of information for the analysis of climatic data, following a series of Big Data methods and strategies. The work was mainly developed in the Pentaho tool as a central work environment, in which the modules for data processing and other functions that could be used were investigated. An ETL model (Extract, Transform, Load) was taken as reference for the extraction, transformation and loading of environmental data in data warehouses or NoSQL (Not only relational) in order to automate and improve the process of consultation and analysis. The test data was acquired from the IDEAM (Instituto de Hidrología, Meteorología y Estudios Ambientales) for the development and validation of the procedure for the analysis of climate change behavior.