
Chris Hronek
•Jan 9, 2025
Learn how to build an ETL pipeline that extracts AI-generated Slack huddle notes using Airflow, processes them with Snowflake Cortex, and loads them into a data warehouse for future AI agent consumption.
Parakeet Data
Chris Hronek
•Jan 9, 2025
Learn how to build an ETL pipeline that extracts AI-generated Slack huddle notes using Airflow, processes them with Snowflake Cortex, and loads them into a data warehouse for future AI agent consumption.
Chris Hronek
•Dec 23, 2024
Discover how to construct a cost-effective and scalable reverse ETL pipeline using Apache Airflow and Snowflake to seamlessly synchronize data from your Snowflake warehouse to HubSpot. This guide covers essential aspects such as state management, dynamic batching, and API integration to ensure efficient and reliable data synchronization.
Chris Hronek
•May 21, 2024
Explore how Artie helped us streamline our ETL pipelines by replicating our MySQL database into Snowflake. Discover how Artie's real-time database replication tool helped us save time and focus on more important tasks.
Chris Hronek
•Mar 27, 2024
Explore how Semantic Data Fabric (SDF) empowers data professionals to manage data growth effectively. Discover its features—lineage, contracts, and classifiers—and learn how to supercharge your SQL journey.
Chris Hronek
•Nov 19, 2023
Explore the power of Python and GitHub Workflows in enhancing data quality with our comprehensive guide. Learn how to analyze dbt model coverage, ensuring robust documentation and efficient testing in your data engineering projects.
Chris Hronek
•Nov 12, 2023
Explore the seamless integration of secrets management in Apache Airflow, allowing you to customize connections for different development environments. Illustrated through the perspective of our Data Engineer hero, Bob.
Chris Hronek
•Nov 6, 2023
Discover a guide to developing Apache Airflow workloads locally with Docker and a template repository for efficient, consistent development.
Chris Hronek
•Oct 30, 2023
Elevate your data management with DataHub, dbt Core in Apache Airflow, and Astronomer Cosmos. Learn how to automate metadata ingestion and streamline data quality checks for your data model in this comprehensive guide.
Chris Hronek
•Oct 27, 2023
Reduce your AWS Managed Workflow for Apache Airflow (MWAA) costs by 50% with Plural. Explore our journey of transitioning to self-hosted Apache Airflow on AWS Kubernetes (K8s) and gain cost savings and control over data workflows.
Chris Hronek
•Sep 23, 2023
Learn how to set up and run Astronomer Cosmos, an open-source package that allows you to run dbt core projects as Apache Airflow DAGs and Task Groups with ease. This blog post, provides a comprehensive guide to running Cosmos on MWAA (Amazon Managed Workflows for Apache Airflow).
Chris Hronek
•Aug 30, 2023
Explore the art of transforming JSON data in Amazon Redshift databases, mastering elegant techniques to split and extract data from nested structures. Uncover time-saving strategies for managing one-to-many relationships and enhancing data manipulation workflows.
Chris Hronek
•Jul 3, 2023
Discover the distinctions between Data Analyst, Data Engineer, and Data Scientist roles and learn the essential skills required to transition from one to the other.
Chris Hronek
•Jun 10, 2023
The Power of Pre-Commit and SQLFluff - Ensuring Consistent SQL Code Across Your Team's Projects