Charles Woodruff
@chasmannc.bsky.social
Freelance Data Engineer • AWS • ELT • ETL • SQL • Snowflake • dbt • Python • Analytics • Power BI • Tableau
It's Saturday so you know what time it is.
The Home Lab is now open!
My weekend agenda includes:
The Home Lab is now open!
My weekend agenda includes:
May 10, 2025 at 4:09 PM
It's Saturday so you know what time it is.
The Home Lab is now open!
My weekend agenda includes:
The Home Lab is now open!
My weekend agenda includes:
The purpose of this project is to build a Data Engineering/Analytics pipeline designed to ingest, clean, and transform datasets to find key metrics and provide additional business.
End-to-End AWS Healthcare Data Pipeline | Charles Woodruff
This article examines my last end-to-end pipeline project in a more detail.
www.linkedin.com
May 5, 2025 at 5:05 PM
The purpose of this project is to build a Data Engineering/Analytics pipeline designed to ingest, clean, and transform datasets to find key metrics and provide additional business.
View my verified achievement from @awscloud. www.credly.com/badges/dae43... via @credly
Amazon Q Developer Immersion Day was issued by AWS WWCS Solution Architect to Charles Woodruff.
The earner of this badge has participated in an AWS Immersion Day. AWS Immersion Days are specialist workshop content created by AWS Solutions Architects. Hands-on labs simulate real-world scenarios a...
www.credly.com
May 4, 2025 at 7:34 PM
View my verified achievement from @awscloud. www.credly.com/badges/dae43... via @credly
For the past several weeks, I worked on designing and implementing a pipeline to ingest and transform Healthcare related data before making it available for visualization.
Here is my finished design.
Here is my finished design.
For the past several weeks, I worked on designing and implementing a… | Charles Woodruff
For the past several weeks, I worked on designing and implementing a pipeline to ingest and transform Healthcare related data before making it available for visualization.
Here is my finished design...
www.linkedin.com
May 2, 2025 at 3:29 PM
For the past several weeks, I worked on designing and implementing a pipeline to ingest and transform Healthcare related data before making it available for visualization.
Here is my finished design.
Here is my finished design.
I have been using AWS Glue Crawler to ingest data into the Glue data catalog, but yesterday I used AWS Athena's "Create Table" option to populate tables, which led to the question,
"Which should I use and why"?
www.linkedin.com/posts/charle...
"Which should I use and why"?
www.linkedin.com/posts/charle...
I have been using AWS Glue Crawler to ingest data into the Glue data… | Charles Woodruff
I have been using AWS Glue Crawler to ingest data into the Glue data catalog, but yesterday I used AWS Athena's "Create Table" option to populate tables, which led to the question,
&qu...
www.linkedin.com
April 25, 2025 at 8:03 PM
I have been using AWS Glue Crawler to ingest data into the Glue data catalog, but yesterday I used AWS Athena's "Create Table" option to populate tables, which led to the question,
"Which should I use and why"?
www.linkedin.com/posts/charle...
"Which should I use and why"?
www.linkedin.com/posts/charle...
I used dbt and Snowflake on my last project so I opted to use AWS Glue for the latest one.
After finishing the data model, I fired up the AWS management console and went to work. I documented my process and how I plan to automate tasks going forward.
www.linkedin.com/pulse/aws-gl...
After finishing the data model, I fired up the AWS management console and went to work. I documented my process and how I plan to automate tasks going forward.
www.linkedin.com/pulse/aws-gl...
AWS Glue DataBrew - The Hard Way
Over the weekend, I spent many hours with AWS DataBrew, a visual data preparation tool which is quite similar to Tableau Prep, and though it made the preparation process easy it was still a time consu...
www.linkedin.com
April 21, 2025 at 1:13 PM
I used dbt and Snowflake on my last project so I opted to use AWS Glue for the latest one.
After finishing the data model, I fired up the AWS management console and went to work. I documented my process and how I plan to automate tasks going forward.
www.linkedin.com/pulse/aws-gl...
After finishing the data model, I fired up the AWS management console and went to work. I documented my process and how I plan to automate tasks going forward.
www.linkedin.com/pulse/aws-gl...
In preparing for a system design interview later today, I want to review some best practices for building scalable, reliable, and cost-effective platforms.
In preparing for a system design interview later today, I want to review… | Charles Woodruff
In preparing for a system design interview later today, I want to review some best practices for building scalable, reliable, and cost-effective platforms…
www.linkedin.com
March 27, 2025 at 1:40 PM
In preparing for a system design interview later today, I want to review some best practices for building scalable, reliable, and cost-effective platforms.
𝗧𝗵𝗲 𝗔𝗿𝘁 𝗼𝗳 𝗕𝗿𝗲𝗮𝗸𝗶𝗻𝗴 (𝗮𝗻𝗱 𝗙𝗶𝘅𝗶𝗻𝗴) 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻: 𝗔 𝗡𝗼-𝗕𝗹𝗮𝗺𝗲 𝗖𝘂𝗹𝘁𝘂𝗿𝗲
In the fast moving world of Tech, fostering a no-blame culture can transform your team's problem-solving and innovation capabilities.
In the fast moving world of Tech, fostering a no-blame culture can transform your team's problem-solving and innovation capabilities.
#dataengineering #leadership #noblameculture | Charles Woodruff
𝗧𝗵𝗲 𝗔𝗿𝘁 𝗼𝗳 𝗕𝗿𝗲𝗮𝗸𝗶𝗻𝗴 (𝗮𝗻𝗱 𝗙𝗶𝘅𝗶𝗻𝗴) 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻: 𝗔 𝗡𝗼-𝗕𝗹𝗮𝗺𝗲 𝗖𝘂𝗹𝘁𝘂𝗿𝗲
In the fast moving world of Tech, fostering…
www.linkedin.com
March 26, 2025 at 2:29 PM
𝗧𝗵𝗲 𝗔𝗿𝘁 𝗼𝗳 𝗕𝗿𝗲𝗮𝗸𝗶𝗻𝗴 (𝗮𝗻𝗱 𝗙𝗶𝘅𝗶𝗻𝗴) 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻: 𝗔 𝗡𝗼-𝗕𝗹𝗮𝗺𝗲 𝗖𝘂𝗹𝘁𝘂𝗿𝗲
In the fast moving world of Tech, fostering a no-blame culture can transform your team's problem-solving and innovation capabilities.
In the fast moving world of Tech, fostering a no-blame culture can transform your team's problem-solving and innovation capabilities.
𝗘𝘃𝗲𝗿 𝘄𝗼𝗻𝗱𝗲𝗿𝗲𝗱 𝗵𝗼𝘄 𝗦𝗤𝗟 𝘁𝗿𝘂𝗹𝘆 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗲𝘀 𝘆𝗼𝘂𝗿 𝗾𝘂𝗲𝗿𝗶𝗲𝘀? 🤔
tinyurl.com/desystemdesign
tinyurl.com/desystemdesign
#sql #datamanagement #databaseoptimization #techtalk | Charles Woodruff
𝗘𝘃𝗲𝗿 𝘄𝗼𝗻𝗱𝗲𝗿𝗲𝗱 𝗵𝗼𝘄 𝗦𝗤𝗟 𝘁𝗿𝘂𝗹𝘆 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗲𝘀 𝘆𝗼𝘂𝗿 𝗾𝘂𝗲𝗿𝗶𝗲𝘀? 🤔
When writing SQL queries, it's easy to assume that the…
tinyurl.com
March 25, 2025 at 3:12 PM
𝗘𝘃𝗲𝗿 𝘄𝗼𝗻𝗱𝗲𝗿𝗲𝗱 𝗵𝗼𝘄 𝗦𝗤𝗟 𝘁𝗿𝘂𝗹𝘆 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗲𝘀 𝘆𝗼𝘂𝗿 𝗾𝘂𝗲𝗿𝗶𝗲𝘀? 🤔
tinyurl.com/desystemdesign
tinyurl.com/desystemdesign
I was curious about how AI is improving data pipelines so I started researching the subject.
tinyurl.com/AIPipelines
tinyurl.com/AIPipelines
I was curious about how AI is improving data pipelines so I started… | Charles Woodruff
I was curious about how AI is improving data pipelines so I started researching the subject.
𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗲𝗱 𝗔𝗻𝗼𝗺𝗮𝗹𝘆 𝗗𝗲𝘁𝗲𝗰𝘁𝗶𝗼𝗻
🔹AI…
tinyurl.com
March 24, 2025 at 4:48 PM
I was curious about how AI is improving data pipelines so I started researching the subject.
tinyurl.com/AIPipelines
tinyurl.com/AIPipelines
A quick article on how COALESCE works.
Mastering the COALESCE Function in SQL
What is COALESCE?
medium.com
March 23, 2025 at 1:23 AM
A quick article on how COALESCE works.
An overview of today's discussion on processing, storing, and visualizing data for business insight.
As most of you know, if you are in tech, you are automatically a life longer learner.
Find something that interests you, and enjoy the journey.
As most of you know, if you are in tech, you are automatically a life longer learner.
Find something that interests you, and enjoy the journey.
March 19, 2025 at 2:38 PM
An overview of today's discussion on processing, storing, and visualizing data for business insight.
As most of you know, if you are in tech, you are automatically a life longer learner.
Find something that interests you, and enjoy the journey.
As most of you know, if you are in tech, you are automatically a life longer learner.
Find something that interests you, and enjoy the journey.
Why is my data not delivering the insights I expected?
I have asked this many times after transforming data on my current project.
As the saying goes, "Garbage in. Garbage out".
www.linkedin.com/posts/charle...
I have asked this many times after transforming data on my current project.
As the saying goes, "Garbage in. Garbage out".
www.linkedin.com/posts/charle...
March 12, 2025 at 5:32 PM
Why is my data not delivering the insights I expected?
I have asked this many times after transforming data on my current project.
As the saying goes, "Garbage in. Garbage out".
www.linkedin.com/posts/charle...
I have asked this many times after transforming data on my current project.
As the saying goes, "Garbage in. Garbage out".
www.linkedin.com/posts/charle...
This week has been mostly devoted to completing a project involving dbt, Snowflake, and Tableau.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
Charles Woodruff on LinkedIn: #datatransformation #businessintelligence #dataengineering #analytics…
This week has been mostly devoted to completing a project involving dbt, Snowflake, and Tableau.
Project Details:
👉 Configure Snowflake to ingest external…
www.linkedin.com
February 21, 2025 at 3:53 PM
This week has been mostly devoted to completing a project involving dbt, Snowflake, and Tableau.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
Someone in an Apache Spark forum asked if it was better to house 70GB of JSON formatted data in S3 or in HDFS.
The answer is it depends.
www.linkedin.com/posts/charle...
The answer is it depends.
www.linkedin.com/posts/charle...
Charles Woodruff on LinkedIn: Someone in an Apache Spark forum asked if it was better to house 70GB of…
Someone in an Apache Spark forum asked if it was better to house 70GB of JSON formatted data in S3 or in HDFS.
The answer is it depends.
There are other…
www.linkedin.com
February 19, 2025 at 2:33 AM
Someone in an Apache Spark forum asked if it was better to house 70GB of JSON formatted data in S3 or in HDFS.
The answer is it depends.
www.linkedin.com/posts/charle...
The answer is it depends.
www.linkedin.com/posts/charle...
Over the weekend, there was a brief discussion of how to optimize Apache Spark in class. I made a note to research the topic to get a clearer picture of how it should be done.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
Charles Woodruff on LinkedIn: Over the weekend, there was a brief discussion of how to optimize Apache…
Over the weekend, there was a brief discussion of how to optimize Apache Spark in class. I made a note to research the topic to get a clearer picture of how it…
www.linkedin.com
February 17, 2025 at 1:34 PM
Over the weekend, there was a brief discussion of how to optimize Apache Spark in class. I made a note to research the topic to get a clearer picture of how it should be done.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
These are the traits of the best personal growth journeys:
- Courage to step out 🌟
- Patience to endure 🌿
- Resilience to bounce back 💪
- Openness to learn 📚
- Perseverance to keep going 🚀
Look around—you’ll see all the pros have these.
- Courage to step out 🌟
- Patience to endure 🌿
- Resilience to bounce back 💪
- Openness to learn 📚
- Perseverance to keep going 🚀
Look around—you’ll see all the pros have these.
February 14, 2025 at 5:53 PM
These are the traits of the best personal growth journeys:
- Courage to step out 🌟
- Patience to endure 🌿
- Resilience to bounce back 💪
- Openness to learn 📚
- Perseverance to keep going 🚀
Look around—you’ll see all the pros have these.
- Courage to step out 🌟
- Patience to endure 🌿
- Resilience to bounce back 💪
- Openness to learn 📚
- Perseverance to keep going 🚀
Look around—you’ll see all the pros have these.
A quick look at Practical Pyspark.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
February 14, 2025 at 1:10 AM
A quick look at Practical Pyspark.
www.linkedin.com/posts/charle...
www.linkedin.com/posts/charle...
February 12, 2025 at 5:11 PM
ETL jobs can break for any number of reasons.
👉 Data ingestion failures.
👉 Transformation errors.
👉 Slow job performance.
www.linkedin.com/posts/charle...
👉 Data ingestion failures.
👉 Transformation errors.
👉 Slow job performance.
www.linkedin.com/posts/charle...
Charles Woodruff on LinkedIn: #dataengineering #aws #bigdata
ETL jobs can break for any number of reasons.
👉 Data ingestion failures.
👉 Transformation errors.
👉 Slow job performance.
What do you do to troubleshoot…
www.linkedin.com
February 10, 2025 at 3:14 PM
ETL jobs can break for any number of reasons.
👉 Data ingestion failures.
👉 Transformation errors.
👉 Slow job performance.
www.linkedin.com/posts/charle...
👉 Data ingestion failures.
👉 Transformation errors.
👉 Slow job performance.
www.linkedin.com/posts/charle...