Snowflake Enriched: Guide for Building a Data Platform

by Raj Rathi, Babu Abraham, Siva Pentela

Snowflake Enriched is written to provide a practical guide to create a data analytics platform, including design, data collection, ingestion, transformation, and visualization. The book provides an insight into the origin of data and how it has been transformed at all the stages of the data lifecycle. Data transformation may occur as new data is being added to existing datasets as well as when data is moved from one stage to another. This book offers detailed steps in building data platform from data acquisition to presentation. It is subdivided into nine topics as • Introducing Snowflake covers the Snowflake architecture and features.• Introducing data platform describes various sources of data files and ingestion methods to the internal staged area.• CSV ingestion covers the various processes involved in loading and processing CSV files.• JSON ingestion deals with ingesting and transforming JSON data.• ORC ingestion provides insights into different aspects of loading and transformation of ORC format files.• Parquet ingestion covers data ingestion and processing using Parquet format files.• Multi-format ingestion describes the methods used to create lookup tables dynamically.• Workflow orchestration covers how to build a custom workflow using Snowflake scripts and stored procedures.• Business insights provides analytical assessment into business use-cases identified by the user community. The overall process of data transformation and managing challenges with disparate data types spread across multiple touchpoints are explained in detail throughout the chapters. The most important aspect of a data platform is insights, which come from data visualizations, and predictive analytics. The art of generating data visualization through dashboards, charts, and other graphical output is critical. Using open-source software, we have created powerful data insights and visualizations for presenting data. This book provides complete coding experience to our readers. It helps them to get 360-degree view for building data platform from extraction to visualization using an emerging technology. The data files and data processing scripts used in this book are available to download from the Git Hub locations provided throughout the chapters.

175 pages, Kindle Edition

Published March 21, 2021