Snowflake - Dhilip Subramanian

Sign in Subscribe

Snowflake

A collection of 5 posts

Building a Fully Snowflake-Native ELT Pipeline with Stripe and Python

Snowflake Featured

Building a Fully Snowflake-Native ELT Pipeline with Stripe and Python

I recently worked on a project to integrate Stripe with Snowflake for downstream reporting. Although our primary tech stack is built on Azure and typically uses Data Factory for data movement, I wanted to explore using Snowflake’s External Access Integration to connect directly to Stripe. Instead of relying on

Automated Schema Drift Management in Snowflake Using Cortex LLM

Automated Schema Drift Management in Snowflake Using Cortex LLM

One of the biggest challenges I face when building data analytics platforms is managing changes in data structures from source systems to destination tables, which affects my ETL/ELT pipeline. While I work with multiple platforms, recently most of my projects have been in Snowflake. In Snowflake, schema drift detection

Snowflake Cortex LLM Functions Explained (with Examples)

Snowflake Cortex LLM Functions Explained (with Examples)

I have been exploring Snowflake Cortex LLM functions, which were recently released. These functions provide us with instant access to leading LLM models from Mistral, Meta, and Google. The best part is that these LLMs are fully hosted and managed by Snowflake, providing performance, scalability, and governance. The data resides

Extract, Transform, and Enhance: Using Snowflake and Azure OpenAI for PDF Data

Extract, Transform, and Enhance: Using Snowflake and Azure OpenAI for PDF Data

I’ve primarily focused on building data pipelines, creating data models, and developing Power BI dashboards. One of my recent projects involved extracting data from PDF files, loading it into Snowflake, and using OpenAI to rewrite specific columns, with the final results saved into new columns. While this approach isn’

Creating DDL and Copying Data: Migrating SQL Server to Snowflake Made Easy

Azure Data Factory

Creating DDL and Copying Data: Migrating SQL Server to Snowflake Made Easy

Recently, I worked on a project to migrate multiple on-premise SQL Server databases to Snowflake using Azure Data Factory. The project involved migrating close to 30 databases, each containing an average of 100 tables. One of the challenges I encountered was creating the Data Definition Language (DDL) scripts in Snowflake