September | 2015
A recent trend that we see emerging in the data warehousing marketplace is the continued integration of data warehouses into the enterprise IT infrastructure. The need for integrated store of detailed data available - for both tactical and strategic business decision making - is finding wider acceptance across industries today.
A traditional data warehouse is predefined with rigid load cycles and ETL Windows. In a traditional context, source data for making critical decisions might appear at unpredictable times and this results in the need for real time data access. Real Time Integration Architectures like Representational State Transfer (REST) Framework or Simple Object Access Protocol (SOAP) offer an advantage over the traditional set-up because the data can be continuously loaded and accessed, usually with 24x7 availability.
As the data appliance industry continues to grow tremendously with high speed data processing and storage capabilities, a real time access to its data that too with easily deployable API’s, makes REST Framework more popular against other real time services like SOAP etc. in the industry.
Why Real Time Data Access for Data Appliance?
Why REST is best suited in today's context?
Data Appliance Support for REST
Data Appliance market leaders like Teradata has already provided Teradata compatible REST API’s. This helps in providing driverless connectivity from client machines, all that using simple commands like GET and PUT. The Web HDFS Feature which is being offered by Apache or Hortonworks could be used for Real time data ingestion. In addition, the REST API can easily communicate to hadoop clusters. It uses the full bandwidth of the hadoop cluster for streaming data. The ‘file read’ and ‘file write’ calls are redirected to the corresponding data nodes.
With major data appliances rendering support for REST, it has become easier to build services around data appliances on real time. Both applications and machine-data now can be integrated with other available data in the warehouse to build insights immediately.
Pon Prabakaran Shanmugam is a Principal Consultant with Wipro Analytics practice. He possesses exhaustive data architecture experience in the Financial Industry with strong data modeling, integration and analytical skills, and is an enthusiastic agile modeling proponent. He is also a strong believer of embracing open source technologies to make data architecture flexible and evolving.
© 2021 Wipro Limited |
|
© 2021 Wipro Limited |
Pharmaceutical & Life Sciences