10 Questions with Mark Windrim

The "data warehouse for anyone who needs it" has gone open source.  I previously talked with Miriam Tuerk, Infobright’s CEO, when the company launched.  Recently I spoke with Mark Windrim, VP of Community for Infobright, who is at the helm promoting their open source data warehouse, Infobright Community Edition (ICE).  Mark, as I discovered, has a history of spearheading initiatives from their infancy.

In the 90s, Mark started a community called MAGIC while working at Apple Computer. MAGIC grew quickly into one of the largest ISPs serving the Toronto, Canada region. At that time MAGIC was the largest Macintosh user group in the world. He left to join Newstar Technologies in 1996 (where he met Miriam). Newstar evolved and became BCE Emergis.

Now his focus is set squarely on building an open source community for Infobright. It won't be easy. Starting a community in an established company with an existing product - a paid product at that – can be even more challenging.

Question: So Mark, let's get right to it. Why did Infobright decide to go open source?

Answer: As you may know, Infobright built its technology underneath MySQL so we have always had open source roots. Open source has always been part of our plan. In terms of timing, we wanted to prove out our technology with early customers before releasing an open source version. We wanted to make sure it was highly scalable, easy to download and implement, and robust - not an immature project. We see a large untapped opportunity in the market to bring an ultra low-cost, easy-to-use data warehouse to many companies who don’t have the big budgets and resources needed to implement traditional solutions. Open source is the best way to enable them to try it.

Question: What does your community ecosystem look like today?

Answer: We’ve got our main infobright.org site that contains information about ICE. It supports a Wiki and forums where users can mingle and get support directly from Infobright and other community members. We have a great relationship with MySQL/Sun and continue to work closely with them in supporting the open source data warehousing community with ICE. Additionally, we are building partnerships with many organizations. Today, those partners include Pentaho, Jaspersoft and Talend, and we work with their communities in addition to our own.

Infobright also started to build out our integration communities through relationships with OpenBI in Chicago and Lincube in Stockholm, Sweden. Many more are to come. Both OpenBI and Lincube have extensive experience in implementing BI Solutions with open source offerings.

Question: What is the planned direction for your new open source community over the next few years?

Answer: We will be adding a great deal of educational content about data warehousing. The Infobright software itself will be enhanced and updated on a monthly basis. Since the ICE launch, we have already added a 32-bit version of the product and a new release has been posted to the community.

The goal is to create an environment where people can go to be introduced to data warehousing, as well as receive help both from Infobright and the community itself. We’ve begun offering free webinars as an introduction to data warehousing, and the response (and attendance, I might add) has been very good. Many of our community members are turning to us because their current platform is no longer able to meet their requirements, and they’re starting to build data warehouses as a result. Normally that is a very expensive proposition but open source, and ICE, has made it available to the masses. We want to be that go-to location when individuals and businesses need to know how to build these systems.

Infobright will also be adding content about implementing an open source data warehouse through support of our partners. We’re already moving down that path and recently announced an open source bundle with Jaspersoft. Shortly you will see more of this as we try and make the on ramp to open source data warehousing as easy as possible.

Question: What challenges have you encountered starting an open source model within a company selling a paid product?

Answer: We had to engage the entire Infobright team in the vision of a different kind of company. Everyone’s job was going to change in some way and the venture would only be successful with 100 percent employee participation. To be honest, that education process was fairly complex. We implemented a comprehensive plan for the entire company over six months to ensure that everyone was on the same page, and that we had everything absolutely ready. We also researched other open source projects – both successful and unsuccessful ones to understand the best practices of open source. Those learnings have impacted everyone in some manner and through them we have developed guidelines for all to follow.

Question: Infobright's open source database was released in September 2008. So far, what has been the response?

Answer: Response to Infobright’s open source announcement has been incredible! Immediately after launch it became apparent that the community wanted a 32-bit version of ICE, even though we had previously thought that the software needed more memory in the form of a 64-bit version. We responded immediately by offering a 32-bit version, and it quickly became the hottest download on the site. Infobright is also receiving reports from community members that they are using ICE in ways that we never would have thought was a great fit for us, but the sheer volume of people using the platform is giving us some fantastic new insights into where we need to focus our future efforts. I don’t think there is a day that goes by where there isn’t an “oh wow” comment coming from a community member that loves ICE. Now the community is asking us for Windows support, so you’ll be seeing that coming down the pipe shortly.

Question: How has the open source initiative affected Infobright as a company?

Answer: As I mentioned earlier, the way we do virtually everything has changed. Infobright.org community members commenting on code, or recommending new features, has a direct impact on our product roadmap. With many more people using Infobright’s software, we are discovering new ways people can benefit from its use not previously considered. For example, we are now looking into use cases that didn’t make sense to us six months ago - such exploration is a direct result of community members having an impact on the organization. From a business perspective, the last six weeks has been a hockey stick in terms of number of new customers and revenue. By the end of Q1, we expect to have surpassed most, if not all, of our competitors in terms of number of customers using our product. And more users result in a better product – we aspire to deliver the best product in the market!

Question: Has the direction of Infobright changed as a result of being an active part of the open source community?

Answer: Yes, absolutely. The expectations of the open source user are different than that of the commercial one. The open source user demands from a technical perspective are very high – you can’t hide issues and weaknesses; your bug list is entirely public. They’re doing a phenomenal amount of testing and performance stress testing. All these insights benefit every part of Infobright as we add new features to ICE. Such feedback is even changing the types of webinars we present, which user groups on which we focus, and what features we add to the product. We also closely monitor a variety of metrics in order to determine the best ways to support the Infobright.org community.

Question: There is probably the value proposition of lower cost, less implementation time, and less maintenance effort. However, can an organization really run an enterprise-wide data warehouse on open source?

Answer: Every aspect of a data warehouse infrastructure can utilize open source technologies. A company can utilize Linux as the operating system and integrate with open source ETL tools like Talend or Kettle (Pentaho). Many open source platforms will use their own home grown ETL processes built upon Python, Perl, or Ruby (or C/C++, for that matter). The data warehouse can be built upon ICE, and users can use BI tools like Jaspersoft or Pentaho. Support is readily available for purchase or for free through community forums. Every one of these platforms is extremely robust and stable. There is no reason that an organization could not run their data warehouse using open source technologies.

And businesses are recognizing this. Open source BI is a fact of life in enterprises across industry. A recent Gartner survey highlighted that by the end of this year 69 percent of enterprises surveyed either plan to have implemented and be using open source databases. And in the area of BI tools, the number is 34 percent (a 100 percent growth over the previous year). These statistics were gathered before the recent economic downturn. Now, companies are even more pressed to find the fastest and most cost effective way to deliver BI and data warehousing solutiuons to their businesses – and that way is open source.

Question: What is the benefit to your partners and developers of being a part of Infobright's open source community?

Answer: In addition to the obvious and huge benefit to end users, the data warehouse is a key enabler of many enterprise applications. As such, our partners and developers will be able to achieve great benefits to their businesses and products thru integration with Infobright. Now organizations can accelerate their business by reducing the cost and time required for the data warehouse component and focusing their value on the application. Additionally, our partners and developers not only support our community, but they cross pollinate each other’s communities as well. With open source, there is much more willingness among partners to support each other.

Question: It’s been a pleasure talking with you Mark. Do you have any additional links or information about Infobright's open source community you want to share?

Answer: We really encourage people to get involved in our forums (www.infobright.org/Forums). There is a vast amount of information about ICE available there and we really appreciate reports on how people are using ICE. We’d also encourage people to look at Pentaho, Jaspersoft and Talend.

Really Simple Integration

Companies are challenged these days. So are individuals. The vast amount of information available and being created every minute is growing so fast how can one leverage that into something meaningful?

Along comes aggregation. It's seen for blog/news feeds, like AllTop, for the thousands of "top bloggers".

But what about organizations and integrating their information needs? Along comes SnapLogic with an open source RESTful architecture integration app. I spoke with Chris Marino, CEO, and John Bennett, Director of Marketing. They explained how they empower organizations through self-service... to "loosely couple a federation of systems" for enterprise mashups of data.

Here's a partial quote from their press release today:

"Really Simple Integration is a new approach to data integration" that "enables enterprises to quickly and easily make core IT data from data warehouses, Master Data Management data marts, SaaS apps, SOA Web Services and other sources."

Be sure to check them out if you're attending O'Reilly's Web 2.0 Expo in San Francisco this week. In Web 2.0/open source fashion, they have started a publicly available collection of free components, including a screencast showing a mashup of LinkedIn and SalesForce.com.

So where does this put Business Intelligence and more specifically ETL tools and the static nature of data warehouses. I think this is another step towards the end of the ETL era as we know it. Products like SnapLogic provide transformation functionality but have access to more than internal data sources. Ever heard of an ETL tool able to scrap data off a public website to merge with your sales data?

Business Intelligence has been typically limited to using an organization's internal databases, such as finance, CRM, marketing, and sales. But we're in the age of the Internet now (actually we've been here for quite some time) and to be competitive you need access to the vast amounts of information from external sources of information, such as SaaS applications and information websites.

The small to mid-sized market is where SnapLogic is positioned today. Tiny companies can leverage the open source community, while IT staff of mid-sized companies would deploy SnapLogic for efficiencies. So once the data warehouse is built, users/departments will start asking for the data in different ways. (The static issue with a DW). Or merrying DW data with data not in the DW (and they shouldn't wait 18 months for additional DW implementation to address this need). IT departments can shine by having an easy-to-use tool like SnapLogic.

Sometimes there is no time to wait for the perfect enterprise dimensional model to be designed. Organizations are organic and need to stay competitive and ever changing to keep ahead. Access to information is key.

Open source gets VC funding

$12M in a round of Series C funding by Benchmark Capital who has backed other open source companies like Red Hat, Zimbra, and MySQL. This makes a total of $26M of VC funding given to this US-based BI open source company.

Yes, the Pentaho group picks up another round of funding according to this Performance Guys post. The article suggests that open source is one of three disruptive technologies with Software as a Service and pre-loaded appliances being the others.

The question still remains. Can Pentaho, and really open source BI in general, compete with other on-premise vendors, such as Cognos, Business Objects, Microsoft, and Hyperion? According to the article, Pentaho reports "brisk" uptake. My take is they still need to continue converting the 3 million downloads into open source licenses (i.e. sales).

Pentaho has built a location intelligence dashboard mashup with Google Maps. And is working with Greenplum's Bizgres-based data warehousing appliance platform. So they are getting out there and integrating their products for a variety of revenue streams.

But what differentiates them enough from Cognos, BO, Microsoft, and Hyperion?

I guess the licensing costs could be significantly less. The flip side to low upfront costs is the backend support and how that support is perceived. Is there enough of a developer community to support customer implementations? Are there enough help desk and knowledge areas to give IT departments support when questions and issues arise?

Perhaps the open source BI play is in the small to mid-sized company range for now. I'm all for Pentaho and other open source BI companies as they bring competitiveness to the industry. And as they take on more market share, the proprietary vendors will be forced to adjust and improve. And that ultimately provides more choice and flexibility for customers.

First BI mashup with Google Maps

Okay, being the first out of the gate with a new technology doesn't mean you will be the long term winner. But in this case, they could be. A mashup between BI and Google by using the open source, collaborative model gave Pentaho the edge they needed.

That collaborative model may also keep them the front-runners in the future. Instead of using only in-house IT people or consultants to build new products, the Open Source model uses hundreds and thousands of people outside of company walls, many of which are in the new Web 2.0 world, to design and build the next generation of software.

In this case, Pentaho mashed Google Maps with their graphical dashboards to display location-based metrics tied to geographic maps. And Google featured this as an innovative example in Google Code.

Here's an example,
"The combination of Pentaho’s charts and other graphically expressed metrics with visual geographic information can help companies rapidly identify regions associated with certain customer behaviors or spending patterns, (...) zero in on location-based business opportunities, and gain other insights that are difficult to see in a traditional report or spreadsheet."

So chalk this up as a win for the Open Source, collaborative model (and Pentaho, of course).

I'd like to continue with this topic of conversation and ask, "Have you come across other mashups that move BI closer to a Web 2.0 world?" Or know of new innovative features (or would like to suggest ideas for BI) that push the BI envelope to be more mobile, easy-to-use, or ways that would make BI utilized by more people within the organization? Let's hear from you.

0 to 1 Terabyte in 60 seconds

This isn't your grandparents' harvest-gold kitchen appliance. They say it will give you "two orders of magnitude better price-performance" for analyzing large volumes of data. This is hardware with open source software that, when tightly integrated together, improves the performance when querying hundreds of terabytes of data.

Clarise makes the point that enterprises are not investing in new infrastructure and technology. So did Sun and Greenplum waste time & money on a product no one can buy?

Companies have growing volumes of data and the need for timely access to their information. I think we'll see more specialized appliances for the BI industry.

Open source is validated by $8M

It is great to receive validation for what you work hard for. Venture capital funding to the tune of $13M over 8 months says there is a serious new competitor in town. This VC funding validates Pentaho's open source business model and potential to compete.

Interestingly, their product suite sounds similar to the existing BI vendors. "An integrated BI platform with OLAP, reporting, ETL, and data mining."

Coming to a project near you

The open source movement is gaining speed within the BI space. The typical argument of open source vs proprietary talks about ownership costs and savings, operational and strategic alignment and legal violations, to name a few. I wonder if the same analysis is done when organizations are purchasing solely proprietary software?

Many times it comes down to the "trust" a company has. The result of mega cash and time spent on branding, marketing, and advertizing. Cognos. Microsoft. Informatica. Oracle. Well known names that come with a certain amount of trust, even prestige, and even envangelism. Does that "trust" give their products stability and quality?

The marketing babble aside, here is an open source company that is on the right track. Pentaho

And thanks to Joeseph and Clarise for providing these Pentaho podcasts.

And finally, a little news on Pentaho's growth.