“Don’t Drive Your DBA Crazy!” – that was my message today at PASSWIT session hosted by Pragmatic Works. The idea is quite often we concentrate on business requirements (which is superb by the way) and often forget about what is going to happen when we deploy this solution to our Production servers. This session reviews some areas that database developers should be aware of when developing solutions. It also provides common techniques to tackle high volume data processing challenges, that are kind to our production environment (i.e not driving our DBA crazy). Both SQL Server 2008 and SQL Server 2012 features that are useful for high volume data processing are compared and highlighted.
Where Do I Go From Here?
Slide deck is available here:
High Volume Data Processing Techniques without Driving Your DBA Crazy
In addition to the links that are mentioned in the slide deck, here are some more pointers for your further research.
Batching
Break Large Delete Operations Into Chunks by Aaron Bertrand
ColumnStore
Better Together: Merge, Partitioning, ColumnStore by Greg Low
Inside the ColumnStore Index by Hugo Kornelis
Columnstore Index – Index Statistics by Ted Krueger
Winter 2012 Performance Palooza (special SQLPASS Performance Sessions)
SSIS
SSIS Operational and Tuning Guide
Top 10 SQL Server Integration Services Best Practices by SQL CAT
Balanced Data Distributor For SQL Server 2012
Balanced Data Distributor For SQL Server 2008
Outside the scope
Partitioning is a powerful technique or feature of SQL Server for high volume data processing. It is only available in SQL Server Enterprise edition. Some say it’s tricky, I think it is elegant as a divide and conquer method. Here is a great article by Kendra Little: How To Decide If You Should Use Table Partitioning.
Wrap Up
The recorded session will be made available on Pragmatic Works site by end of the week.
Lastly and most importantly, thank you Pragmatic Works for hosting PASS WIT sessions in March and for having me as a speaker.
Remember: Use the right techniques for the right situations!
3 Responses
OMG, a geek who can make a beautiful presentation. For real, probably THE best slide deck I’ve seen on anything technical. Good info too, of course, but kudos on the visual. Just had to opine. 😉
Thanks Matt for the positive feedback! Glad to hear that the content is useful too.
Julie
Good info. Nice hand on presentation.