Clik here to view.
Load Data from S3 to Snowflake and Use TensorFlow Model
Learn how to load data from S3 to Snowflake and serve a TensorFlow model in StreamSets Data Collector, a fast data ingestion engine, data pipeline for scoring on data flowing from S3 to Snowflake. Data...
View ArticleClik here to view.
How to Become a Data Engineer (and Why You’re Lucky if You Do!)
If you’re interested in how to become a data engineer, you’re in luck. Data engineers are in high demand, and resources for how to become a data engineer abound! Data engineers are technical...
View ArticleClik here to view.
The Sources and Destinations Podcast Episode #3 with Naveen Siddereddy
Who actually owns the schema? I’ve been struggling with that. But I don’t know if it’s weird. Sources and Destinations · Sources And Destinations Episode #3 Naveen Siddareddy Our Guest This Week...
View ArticleClik here to view.
3 Important Trends in Data Integration
If you’d had a crystal ball this time last year, what would you have done differently? In the area of data integration, many of the changes that have taken place are accelerations of trends that were...
View ArticleStreamSets Becomes a Certified HIPAA Business Associate
Data protection is an integral part of working with data today. 2020 saw a huge increase in records exposed in data breaches, and no company wants to leave themselves open to the reputation hit a...
View ArticleClik here to view.
A Very Strange Year in the Data Business
A very, very long year ago, I wrote about three scenarios for adjusting your data practice with respect to the impact of the pandemic on their businesses, and data practices. With 12 months plus now...
View ArticleClik here to view.
Load Change Data Capture data from PostgreSQL to Amazon Redshift using...
Change Data Capture is becoming essential to migrating to the cloud. In this blog, I have outlined detailed explanations and steps to load Change Data Capture (CDC) data from PostgreSQL to Amazon...
View ArticleClik here to view.
Sources And Destinations Podcast Episode #4 Joseph Arriola
Our analogy is, like when you have, one machine learning algorithm, the machine learning algorithm is training, training and training. So in the same way. We think together we are going to learn,...
View ArticleClik here to view.
Data Engineering with a Purpose: Tackling Climate Change
Data has become one of the most powerful tools at humanity’s disposal, and it can be used for a variety of end purposes. As data experts, data engineers can take pride in their mastery of the many...
View ArticleClik here to view.
Alexa, Start My Data Pipeline
Imagine asking Amazon Alexa or Google Home to run your ETL, data processing, and machine learning data pipelines. For example, “Start my data pipeline on Amazon EMR“, “How many active jobs do I have...
View ArticleClik here to view.
3 Sessions to Stream at Gartner Data & Analytics Summit
This year the Gartner Data and Analytics Summit goes virtual with a strong focus on how businesses create agility and value. That means we won’t get to cross paths on the show floor or start up a...
View ArticleClik here to view.
Sources and Destinations Podcast Episode #5 Lorna Mitchell
Sources and Destinations · Sources And Destinations Podcast Episode #5 Lorna Mitchell Putting garbage in gets you garbage out. No one understands this better than developers. No one understands...
View ArticleClik here to view.
You Graduated! What’s Next? Career Advice for Data Engineers
Welcome, new grad, and congratulations – you did it! Getting your degree is the first of many achievements you’re sure to accomplish throughout your professional career. As you contemplate joining “the...
View ArticleClik here to view.
Snowpark + StreamSets = Powerful Data Engineering for Snowflake Data Cloud,...
As a Snowpark Accelerated partner, we’re excited to announce the preview of a new way to work with Snowflake: the StreamSets engine for Snowpark. StreamSets customers that use Snowflake and want to...
View ArticleClik here to view.
What Sets StreamSets Apart as a Great Place to Work
As the pandemic winds down and vaccinations go up, growth is on everyone’s mind. Companies everywhere are hiring. In such a competitive market, competing for top talent with pay and stellar benefits...
View ArticleClik here to view.
Introducing StreamSets Summer ‘21
I would be lying if I said I planned for the introduction of StreamSets Summer ‘21 Beta to unfold exactly this way a year ago. But I won’t. A year ago, on this exact date, I joined the StreamSets...
View ArticleClik here to view.
Announcing StreamSets Transformer Engine 4.0.0
StreamSets is excited to announce the immediate availability of StreamSets Transformer Engine 4.0.0. It is a modern ETL engine that enables developers and data engineers to build data pipelines and...
View ArticleClik here to view.
The Sources And Destinations Podcast Episode #6 with Ahmed Elsamadisi
We know, we know. We went a little long this time, but you are going to love every minute of this week’s guest. This week we are so excited to host Ahmed Elsamadisi from Narrator.ai. Ahmed is the...
View ArticleClik here to view.
StreamSets Engine For Snowpark
StreamSets DataOps platform provides an end-to-end enterprise solution to maximize the value of your Snowflake Data Cloud. The platform can ingest data into Snowflake (using batch, streaming and change...
View ArticleClik here to view.
It’s Summer… And Even Data Engineers Need a Break
When the full lifecycle of data integration matters as much as the initial implementation, and you are the data engineer responsible for end-to-end data delivery…how do you take a vacation? Set...
View Article