StreamSets announced the general availability of the newest engine in the StreamSets DataOps Platform, StreamSets Transformer for Snowflake.
The new engine provides a unique combination of power and ease-of-use for data engineers to build, operate and monitor smart data pipelines for the Snowflake Data Cloud
“The Transformer for Snowflake engine is a prime example of how Snowpark is broadening the depth of use cases on the Data Cloud,” said Tarik Dwiek, Head of Technology Alliances at Snowflake. “By pairing the powerful extensibility of Snowpark with StreamSets’ smart data pipelines, we are extending the Data Cloud to ELT and advanced transformation use cases.”
StreamSets Transformer for Snowflake is the newest engine in the StreamSets DataOps platform delivering advanced data transformation functionality on Snowflake, natively. Transformer for Snowflake an enterprise-grade transformation engine built on Snowpark, combining the power and extensibility of the Snowflake Data Cloud with the data integration capabilities of StreamSets. This new engine combined with StreamSets existing capabilities for batch, streaming, and change data capture (CDC) aims to cover the full lifecycle of modern cloud data engineering use cases.
StreamSets is a Snowflake Premier Technology Partner, Snowpark Accelerated, and Snowflake Ready partner. The company has seen early traction in partnership with the launch of Snowpark. The new engine extends the powerful functionality of the Data Cloud and allows data engineers to go beyond SQL to express powerful data transformation logic with the StreamSets DataOps Platform to conform and cleanse data.
“Data collection and transformation is a critical component of the digital backbone, especially in hybrid and multi-cloud environments” said Girish Pancha, CEO of StreamSets. “Transformer for Snowflake offers a scalable and powerful engine for complex native transformations in the Snowflake Data Cloud removing the technical debt enterprises experience moving data across cloud systems.”
Transformer for Snowflake is available now.
The Latest
As businesses and individuals increasingly seek to leverage artificial intelligence (AI), the cloud has become a critical enabler of AI's transformative power. Cloud platforms allow organizations to seamlessly scale their AI capabilities, hosting complex machine learning (ML) models while providing the flexibility needed to meet evolving business needs ... However, the promise of AI in the cloud brings significant challenges ...
The business case for digital employee experience (DEX) is clear: more than half (55%) of office workers say negative experiences with workplace technology impact their mood/morale and 93% of security professionals say prioritizing DEX has a positive impact on an organization's cybersecurity efforts, according to the 2024 Digital Employee Experience Report: A CIO Call to Action, a new report from Ivanti ...
For IT leaders, a few hurdles stand in the way of AI success. They include concerns over data quality, security and the ability to implement projects. Understanding and addressing these concerns can give organizations a realistic view of where they stand in implementing AI — and balance out a certain level of overconfidence many organizations seem to have — to enable them to make the most of the technology's potential ...
For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems? ...
The OpenTelemetry End-User SIG surveyed more than 100 OpenTelemetry users to learn more about their observability journeys and what resources deliver the most value when establishing an observability practice ... Regardless of experience level, there's a clear need for more support and continued education ...
A silo is, by definition, an isolated component of an organization that doesn't interact with those around it in any meaningful way. This is the antithesis of collaboration, but its effects are even more insidious than the shutting down of effective conversation ...
New Relic's 2024 State of Observability for Industrials, Materials, and Manufacturing report outlines the adoption and business value of observability for the industrials, materials, and manufacturing industries ... Here are 8 key takeaways from the report ...
For mission-critical applications, it's often easy to justify an investment in a solution designed to ensure that the application is available no less than 99.99% of the time — easy because the cost to the organization of that app being offline would quickly surpass the cost of a high availability (HA) solution ... But not every application warrants the investment in an HA solution with redundant infrastructure spanning multiple data centers or cloud availability zones ...
The edge brings computing resources and data storage closer to end users, which explains the rapid boom in edge computing, but it also generates a huge amount of data ... 44% of organizations are investing in edge IT to create new customer experiences and improve engagement. To achieve those goals, edge services observability should be a centerpoint of that investment ...
The growing adoption of efficiency-boosting technologies like artificial intelligence (AI) and machine learning (ML) helps counteract staffing shortages, rising labor costs, and talent gaps, while giving employees more time to focus on strategic projects. This trend is especially evident in the government contracting sector, where, according to Deltek's 2024 Clarity Report, 34% of GovCon leaders rank AI and ML in their top three technology investment priorities for 2024, above perennial focus areas like cybersecurity, data management and integration, business automation and cloud infrastructure ...
