Don’t Drive Your DBA Crazy!

“Don’t Drive Your DBA Crazy!” – that was my message today at PASSWIT session hosted by Pragmatic Works. The idea is quite often we concentrate on business requirements (which is superb by the way) and often forget about what is going to happen when we deploy this solution to our Production servers. This session reviews some areas that database developers should be aware of when developing solutions. It also provides common techniques to tackle high volume data processing challenges, that are kind to our production environment (i.e not driving our DBA crazy). Both SQL Server 2008 and SQL Server 2012 features that are useful for high volume data processing are compared and highlighted.

 

Where Do I Go From Here?

Slide deck is available here:

High Volume Data Processing Techniques without Driving Your DBA Crazy

 

In addition to the links that are mentioned in the slide deck, here are some more pointers for your further research.

Batching

Break Large Delete Operations Into Chunks by Aaron Bertrand

ColumnStore

Columnstore Index FAQ

Better Together: Merge, Partitioning, ColumnStore by Greg Low

Inside the ColumnStore Index by Hugo Kornelis

Columnstore Index – Index Statistics by Ted Krueger

Winter 2012 Performance Palooza (special SQLPASS Performance Sessions)

SSIS

SSIS Operational and Tuning Guide

Top 10 SQL Server Integration Services Best Practices by SQL CAT

Balanced Data Distributor For SQL Server 2012

Balanced Data Distributor For SQL Server 2008

Outside the scope

Partitioning is a powerful technique or feature of SQL Server for high volume data processing. It is only available in SQL Server Enterprise edition. Some say it’s tricky, I think it is elegant as a divide and conquer method. Here is a great article by Kendra Little: How To Decide If You Should Use Table Partitioning.

Wrap Up

The recorded session will be made available on Pragmatic Works site by end of the week.

Lastly and most importantly, thank you Pragmatic Works for hosting PASS WIT sessions in March and for having me as a speaker.

Remember: Use the right techniques for the right situations!

 

 

24 Hours of PASS – High Volume Data Processing Techniques Without Driving Your DBA Crazy

I have just delivered my presentation on “High Volume Data Processing Techniques Without Driving Your DBA Crazy!” via webinar at 24 Hours of PASS (24HOP) Spring 2012. Thank you for those who attended the session. Hope it was useful for you. If you have any questions, please don’t hestitate to contact me and I will do my best to answer them.

 

As promised, below is a list of links that I briefly touched on at the presentation.

SQL Server 2012

ORDER BY Clause (OFFSET .. FETCH NEXT …)

http://msdn.microsoft.com/en-us/library/ms188385%28v=SQL.110%29.aspx

 

Paging Function Performance in SQL Server 2012

http://www.mssqlgirl.com/paging-function-performance-in-sql-server-2012.html

 

Columnstore Indexes

http://msdn.microsoft.com/en-us/library/gg492088(v=SQL.110).aspx

 

 

SSIS

The Data Loading Performance Guide

http://msdn.microsoft.com/en-us/library/dd425070(v=sql.100).aspx

 

Minimally Logging Bulk Load Inserts into SQL Server

http://www.mssqltips.com/sqlservertip/1185/minimally-logging-bulk-load-inserts-into-sql-server/

 

BDD

The “Balanced Data Distributor” SSIS

http://blogs.msdn.com/b/sqlperf/archive/2011/05/25/the-balanced-data-distributor-for-ssis.aspx

 

Download Center – BDD

http://www.microsoft.com/download/en/details.aspx?id=4123

 

Special thanks to 24HOP team and IBTalk for everything. I hope to present with 24HOP in the near future. The recording will be available in a few weeks time via the 24HOP website.