Monday, October 6

ETL World Record and 150TB fact tables

At the Microsoft BI conference in Seattle today and wanted to give you highlights as I jump from session to session. One point will be about the world record.

MS Message: Think Bigger about BI

MS goal: accelerate decision making using structured and unstructured information.

Trends: Despite BI being on top of CIO spending list, there are less than 20% of people using BI? Why? Still not easy for people to use BI to get their job done.

MS Prediction: BI won't be on top of CIO spending list in the coming 3 years.

Okay about the world record. Microsoft recently set an ETL world record. I didn't even realize there were Olympics for BI but I guess there are. So by using SQL Server, they loaded 1 TB of data within 30 minutes. To put this in context, Oracle's last record was 1 TB within 45 minutes. Of course they are using SQL Server 2008 to accomplish this.

And on that note, Project Madison! If you're interested in large, large volumes of data, this could be the next big leap. An R&D partnership with DATAllegro who produces DW hardware, is building a combination of SQL Server and DATAllegro using massively parallel processing (MPP). They have loaded 150 TB of data with 1 trillion fact table rows using 14 servers. The live demonstration showed response times from Analysis Services reporting within seconds. Impressive.

More as I come across anything that is excellent.

[Other MS BI Conference posts: Ben Stein talks about BI and
BI in the year 2020]

No comments: