header image

Opensource ETL

data_syncronizationIt’s a great and evolving challenge for data integration architects to form an ETL tool that could be capable of integration of the data between a selection of data sources and targets and be moderately priced. If there’s a need for such a resolution, an open source model should be considered.

In one of their press releases, Gartner made some fascinating predictions concerning open source ETL and other kinds of BI tools. Though it’s early to position open source data integration platforms on the same level with advanced proprietary solutions, the deployment of open source tools shows solid growth.
  1. From 2009 through 2014, MDM software markets will grow at a Compound Annual Growth Rate (CAGR) of 18 %, from $1.3 billion to $2.9 billion.

Data integration and MDM is a fast growing software market. The growth provides a serious business opportunity for software vendors focusing in these areas. The rapid growth of the market means that skilled MDM resources are in great demand among software and service providers. As a result, end-user organizations will struggle to adequately resource their MDM programs.

  1. By 2015, 10 % of packaged data management implementations will be delivered as software-as-a-service in the public Cloud.

Data integration software vendors will seek to leverage Cloud computing. Once organizations gain additional experience with the public and private Clouds, the early adopters will seek to achieve the same advantages with a wider range of software, as well as packaged MDM solutions.

  1. Through 2015, 66 percent of organizations that initiate an MDM program will struggle to demonstrate the business value of it.

A range of open source projects are capable of performing more than one ETL function. The technical features of these projects are less different than similar.

Gartner has pointed out the fact that open source ETL and BI tools are more frequently utilized by mid-sized businesses, governmental and public sectors. And several ISVs use open source BI solutions as an extra functionality to their own applications.
What is even more attention-grabbing: massive vendors, proprietary business tools providers seriously care about finding the ways to deal with these challenges from open source data integration and BI offerings, because the latter become their lower-cost competitors.
Assuming this, open source data integration, ETL and other alternatives of business intelligence solutions have earned confidence from the business aspect, and are expected to become even more widely used in the nearest future.
When IT departments initiate data integration projects, they usually struggle to get the business on board and to demonstrate the business value of these projects. MDM needs to be guided by the business strategy, and will require strong involvement of business stakeholders and managers.
Today it is not enough to throw technology at the problem of inconsistent master data. Getting the right governance, establishing the correct data stewardship roles and responsibilities will be vital to the success of data integration initiatives.
In a tough economical competition for every company it is a must to collect and use all possible business data from all over it’s systems – to support the efficient decision making process and so ensure the profitability of business. And this data collection has to be fast, effective and reliable – to make the right decisions on time.

Open source implementations play an important role both in bringing community power into ETL and promotion of development of standards. A massive number of testers is available which makes free ETL tools to be widely spoken of and evolving. But the most significant feature of open source ETL products is that they are more cost-effective expensive than tools of commercial licence.