Looking for a solution that helps drive operational data from your SQL Server, Oracle, or DB2 Environment? Need it to be a agentless environment for both source and destination? Read on about Attunity’s new Click-2-Load solution.
Warning: I have not yet used this product so I can’t vouch for it yet. I’m simply relating what I’ve read from their materials. Once I’ve personally tested the product, I will write a review.
Essentially Attunity is providing a product that through a point and click environment you can set Attunity to do one of two things.
1. Bulk Read changes directly out of the source database and bulk load them into PDW.
2. Through the use of Attunity’s CDC product, read the Transaction Log from the source for streaming changes into PDW.
This is all done through SQL Server PDW’s Bulk Loader API which has been published for a while but this is the first vendor product that I’ve seen to take advantage of it. If anyone has used it, please comment on your experiences.
Here is the link:
Barbara Kess and Dan Kogan have written an amazing document on the state of SQL Server 2012 Parallel Data Warehouse. This document steps through PDW’s design and describes why you should expect amazing results for your data warehouse experience. More importantly, what I liked about the document was the many customer references about the what their experience is like with SQL Server PDW. These next few quotes just blew me away:
Our queries are completing 76 times faster on PDW. This was after PDW compressed 1.5 TB to 134 GB.
Our daily load now takes 5.5 minutes on PDW whereas it used to take 2.5 hours without PDW. The load is 27 times faster on PDW.
5.5 TB (uncompressed) compressed to 400 GB (14x compression).
You’ll have to read the document yourself to find out what other customers are saying, including some good links to full reference stories.
Download the whitepaper today
I have a couple sessions in which I’ll be speaking about data warehousing at the PASS Summit in Charlotte, NC. One of them will be a deep dive into SQL Server 2014 Clustered Columnstore Indexes. If you are interested in how clustered columnstore indexes can dramatically improve the performance of your data warehouse on SQL Server 2014, please join us.
SQL Server 2014 Clustered Columnstore Indexes: Friday, Oct. 18th, 2013 1:00 pm Room Ballroom B
Have you experienced the blazingly fast query performance enabled by columnstore indexes and batch mode processing? Are you wondering what’s next for these revolutionary data warehouse features? In this session, we’ll examine new query processing enhancements to extend the benefits of batch mode processing, including updatable clustered columnstore indexes. More query types will benefit from batch mode, and larger proportions of your complex queries will be executed in batch mode. Come learn about these new capabilities for processing data from columnstore indexes and how to take advantage of the benefits.
Here’s a link to the session:
Once again, you may have noticed I’ve been remiss in posting lately. Many things have been going on both professionally and personally….its been a busy time. Hopefully this will be the first of many consistent posts about Big Data and SQL Server PDW.
Next week the PASS Summit is in Charlotte, NC. I will be speaking there on a couple different sessions about data warehousing. One of them will be a deep dive on Polybase within SQL Server 2012 Parallel Data Warehouse. If you are interested in how PDW and Hadoop play well together, please join us.
Polybase Deep Dive: Thursday, Oct. 17th, 2013 5:00 pm Room 217 B-C
With the increasing role of Hadoop in capturing and processing raw, non-relational data, integrating Hadoop into existing SQL Server products is becoming essential as we move toward one comprehensive data platform. Polybase provides a set of features for SQL Server 2012 Parallel Data Warehouse (PDW) that enables you to combine Hadoop and relational data in a seamless and fully parallelized fashion via T-SQL. This session will present a deep dive of the Polybase features shipped in SQL Server 2012 PDW, followed by a comprehensive overview of additional Polybase features planned for the next appliance updates.
Here’s a link to the session:
I have a third session at TechED 2013 North America next week. The session is titled Whats New for Columnstore Indexes and Batch Mode Processing and it occurs on Thursday June 6th at 1:00 PM CDT.
We’ll quickly walk through Columnstore Indexing in general to level set everyone with the technology and how Microsoft implements it in SQL Server. We’ll also speak to batch mode processing and how that helps improve performance significantly. Next we’ll speak to what’s next for SQL Server and Columnstore indexes: Clustered Columnstore indexes. We’ll again speak to improvments in batch mode processing and a new feature for for SQL Server vNext: Archival Compression. Want details? Attend the session!
Did I mention demo’s? Lot’s and Lot’s of demo’s will be included throughout to show the benefits of all of these improvements. Finally, ‘we’ll finish the session with best practices that will help you improve the performance of your queries that are hitting Columnstore Indexes.
If you missed the session, you can catch the recording on Channel 9 here.