DataRoket QlikView Connector

DataRoket Business Objects Data Connector for QlikView

 Many organizations have invested in multiple business intelligence and data storage solutions as part of their overall business intelligence platform. With the QlikView Connector for DataRoket, data residing in these business intelligence platforms can be seamlessly integrated into the QlikView environment, providing Business Discovery capabilities for forging new paths to insight and decision. As a leader in data integration with real-time accelerated data acquisition capabilities, DataRoket provides the ability to leverage existing information assets by integrating data from both structured and unstructured data sources into a single, easy to deploy platform. By combining DataRoket’s data integration capabilities and QlikView’s associative in-memory platform, business users can perform quick, flexible, visual, ad hoc analysis and reporting to enable Business Discovery on both structured and unstructured data sources.

[Watch high level video]

[Download QlikView Fact Sheet]

[Read up on special proposal offer for QlikView Customer]

About QlikTech.

QlikTech (NASDAQ: QLIK) is a leader in Business Discovery-user-driven Business Intelligence (BI).  QlikTech’s powerful, accessible Business Discovery solution bridges the gap between traditional business intelligence solutions and standalone office productivity and applications.  Its QlikView Business Discovery platform enables intuitive user-driven analysis that can be implemented in day or weeks rather months, years or not at all.  The in-memory associative search technology it pioneers allows users to explore information freely rather than being confined to a predefined path of questions.  QlikView Business Discovery works with existing BI applications and ads new capabilities: insight for everyone, zero-wait analysis, mobility, and app-like model, remixablilyt and reassembly, and social collaborative experience.  Head quartered in Radnor, Pennsylvania, QlikTech has offices around the world serving more approximately 22,000 customers in over 100 countries.

Hadoop Connector/Adaptor            

Available as DataRoket Solution or QlikView Connector.    (Download Fact Sheet).

DataRoket’s Hadoop functionality and connector are delivered as two different connectors;

• Hadoop
• ADS File Stores

The Hadoop connector delivers the ability to access distributed Hadoop Files systems by HDFS access.   Both uncompressed and map reduce files can be accessed, queried, and rendered to XML, real time LZO compression (used within Hadoop’s wrapper to the Oburhumer C programming libraries).

-          Extract Hadoop File system or HDFS data files in uncompressed or Map Reduced state.

-          Associate and query Hadoop data directly by DataRoket’s distributed Engines (data byte correlation and in memory real time                compression with cell pointer system.

-          Sort, validate, and partition query data back into Hadoop map reduce, direct LZO compressed XML in block partitions (ie: 2-25            million Record set chunks.)

Persisted or direct in memory resident Data sets.

Ability to correlate/associate Hadoop data with any data source connector DR has available (handled at both string and byte key level)

Custom connectors such as unstructured Data Algorithms have also been developed for past customers using the DataRoket ADS ( Analytical data store) Hadoop approach.

Screensho showing DataRoket feeding Orcale data into Hive.



For example the following are two USE cases we have delivered:

1. Wachovia Mainframe derived records existing in flat file structure. DR developed a connector which looks up Composite key mappings from SQL databases which then are correlated with Wachovia flat file records based on data algorithms against relationship mapping rules.
2. PeopleSoft General Ledgers files, mixed metadata content, variable columns throughout the files.  DataRoket delivered the architecture and data algorithms which were able to read 70+ PeopleSoft general ledgers, totaling in capacity 4.6 GBs, read and sort the data amongst DR distributed engines within 7 minutes, total of 100 million+ records.

DataRoket parallel processed the data files and then based on metadata lookup associated/correlated the datasets in columnar fashion delivering LZO compressed and order datasets through Hadoop JNI wrapper.

Screenshot of Hive as a data source showing table.

Delivered as QlikView Data Pipe for seamless access through QlikView.

Futures:  Pig Tuples Handler.

DataRoket is a completely web based and OS independent application.  We have ensured that the application can be deployed via our SaaS environment or as a simple Virtual Appliance that can operate on VMWare or Xen Server.  Should a customer desire to host the application in their own traditional environment, this can be accommodated since DataRoket is not only OS independent, but is app and web-server independent.

Yes. DataRoket is the intense three year effort of former scientists from Sybase and Business Objects.

How DataRoket™ solves Four of the Core Challenges in Data Today

Instead of shying away from these four core challenges or making it the other tool’s problem, we embraced these challenges and made them the centerpiece of our platform.

DataRoket™ is a new level of combined performance, ease of deployment and usability.  DR’s parallel computing, multi-threaded processing and a patent-pending data model delivers enterprise performance and scalability on standard hardware. Below is a high level diagram of the DR solution.

DataRoket™ addresses all of these challenges, delivering real-time reporting (unparalleled performance) and breaching user limitations (proven scalability).  

DataRoket can connect to a limitless and array of structured and unstructured data.  Every one of the connectors operates in parallel with the other connectors and thus can not only read, but process data at astounding rates. 

More importantly, each connector has an SDK that can be customized to the needs of the client.

There are two key points about our connectors:

The SOA architecture of the DataRoket engine enables us to create new data connectors in a matter of days or weeks.

We build connectors to stay in front of where the database and proprietary application providers are going.  For instance our Oracle connector supports Oracle 11g and our SAP connector supports BAPI and Netweaver.

Lastly, DataRoket does not simply import the information from these data sources, but can and does treat every database, feed or document as data that can be read, associated and queried thus providing a truly global and even real-time view of your data.

Some of the connectors available are:

Business Objects Universe™ Real-time Data Connector

Just as DataRoket has delivered the Business Objects XIR2 SDK connector, the same procedure for connecting to Cognos, SAS, etc. would be followed in that it is a data source (a pipe of information) of which IC acknowledges its hierarchy and integrates it into our business model.

How this is done would vary but in the instance of say Cognos, which offers a rich set of SDK methods, DataRoket™ would utilize its SOA based connector architecture to speak directly to Cognos.

Cognos and Netezza, as well as many DW/BI solutions, have opened connection feasibility through open architecture and SDK delivery.  One of DataRoket™ core design criteria was to utilize an open architecture and leverage SOA through all layers of the application, thus there are several manners in which DataRoket could speak directly to Netezza or even Cognos.

To demonstrate this statement and to reflect the power of DataRoket™’ architecture, we have delivered BI vendor specific connectors to Business Objects XIR2 and SAP NetWeaver 7 in a matter of weeks. Another key point is that we purposefully chose BO’s very complex SDK and SAP’s BAPI programming language as initial data sources outside of the database or warehouse market.

Specific as to integration with a data warehouse appliance such as Netezza, Netezza’s SQL dialect is its proprietary way of building queries. Currently, many connectors are already available that can be used from SQL Server DB, Oracle DB/DW, IWay service bus (which speaks SOA 2.0 or SQL query language), or DataRoket™ can connect to Netezza by way of Netezza’s recognition of SQL and Oracle-based queries.  The core message here is that there is rarely one integration method that is best for all situations.  DataRoket’s architecture provides flexibility and speed of implementation. 

For instance, it is important to note that during implementation, customized connectors can be delivered within a week from any known platforms to be able to speak to DataRoket’s business meta-data model.

Yes we can.  In fact most engagements begin this way and if they do not, we still find ourselves helping our clients solve these issues.

For instance we have a client that asked us to integrate eight data sources, but we were able to remove many operational steps and limit the data sources to only four.

We are recognized experts in business intelligence and management consulting so it is natural to engage DataRoket early in the process to ensure that there is one firm on the hook for your solution.

Yes we do.  In fact some of our best client relationships and product ideas have come from our team solving challenging problems.  We are expert in many areas and many platforms such as Java, J2EE, AJAX, Adobe Flex, data modeling, database performance, database scaling, large scale application development and many specific platforms such as Business Objects and all major databases.

To learn more click here.

Yes we do.  Sometimes this involves leveraging part of the DataRoket solutions and sometimes it does not.  Our area of expertise is about web enabled, data intensive applications.

To learn more about our custom application development services click here.

Yes, DataRoket does custom development and integrating DataRoket' products with a partner's product is a common task.  Due to the service oriented architecture of DataRoket, the integrations are normally very straight forward.

  Technology Partner                  

DataRoket delivers a seamless DataPipe to QlikView allowing users to tap "any" data source, associate it, cleanse it, and present it to QlikView for data visualization and analysis.  Difficult, expensive, messy data sources, like; BO Universe, Teradata, Hadoop, SAP and more (complete with rules,objects, meta data and hierarchies).  JDBC connectors and API's are a "one-off" approach that require individual data source support and maintenance.  What DataRoket delivers is a high volume, high velocity automatic access to any data source.  Handling millions of rows of data, a hundred columns deep in minutes, if not seconds; while cleaning, associating and arranging on "the fly" in real-time.

In fact, DataRoket now allows QlikView to scale on data volume and number of sources to extend it's data delivery to enterprise proportions.  In memory, up to 300 million rows; and beyond 300 million rows using DataRoket ADS technology.

Check out the video on tapping a data source to full QlikView access. (click here)

Download the data sheet on all capabilities (Available shortly)     

About QlikTech.

QlikTech (NASDAQ: QLIK) is a leader in Business Discovery-user-driven Business Intelligence (BI).  QlikTech’s powerful, accessible Business Discovery solution bridges the gap between traditional business intelligence solutions and standalone office productivity and applications.  Its QlikView Business Discovery platform enables intuitive user-driven analysis that can be implemented in day or weeks rather months, years or not at all.  The in-memory associative search technology it pioneers allows users to explore information freely rather than being confined to a predefined path of questions.  QlikView Business Discovery works with existing BI applications and ads new capabilities: insight for everyone, zero-wait analysis, mobility, and app-like model, remixablilyt and reassembly, and social collaborative experience.  Head quartered in Radnor, Pennsylvania, QlikTech has offices around the world serving more approximately 22,000 customers in over 100 countries.

  Technology Partner                  

[Join us for a webinar on using BO Universe data with QlikView on January 3rd, 2010 @ 3:30p ET.]

SERVIAM, LLC is an Elite QlikTech partner for deploying QlikView.

The term Serviam is Latin for "I will serve." Serviam has taken a "we will serve" methodology in how we do business with our clients.  Our approach to always put the client first and always act as their advocate differentiates us from our competitors. With this philosophy, our clients receive the best service in the industry, and they know Serviam will always do the right thing for them.

Serviam is a business intelligence consulting firm specializing in implementing, deploying and developing QlikView solutions for Fortune 500 and 1000 companies. We are QlikTech’s go-to deployment partner because we have the experience, expertise and success in deploying and developing QlikView solutions for our clients. Some of our largest clients include Halliburton, Houston Chronicle and Saks Fifth Avenue.

QlikTech is a software company that has pioneered a powerful, easy-to-use business intelligence solution that enables customers to make better and faster business decisions. QlikTech’s software platform, QlikView, combines enterprise-class analytics and search functionality with the simplicity and ease-of-use found in office productivity software tools for a broad set of business users.

                                                                            

DataRoket is always interested in finding partners who wish to use DataRoket to deploy innovative solutions.  We never compete with our channel partners and leave implementation to our partners and provide assistance where requested.

Simply send an email to sales@DataRoket.com.

DataRoket's Data Binding Methodology High Level Overview

A real-world example of the IntelliCubes core technology – Two data sources (each with one million+ rows) are read in-parallel - real-time ELT. The sources can be databases, XML, Web services, SAP^®, BO Universes^®.

In this example, the  DataRoket connects in parallel to create the million-to-million record multi-dimensional data repository which is compressed in-line, indexed with a single pass histogram and index.  The result is a small footprint, fast and scalable and partitioned data repository with full in-memory analytics while it also incrementally updates the persistent data source with DataRoket's real-time data capability. This is completed  in a memory footprint requiring less than 100MB of total memory during the entire process. The DataRoket Analytical Database is updated via Web services and binds with any real-time data or scheduled source. The resulting query performance is sub-second and the scalability is limitless on standard hardware.

Due to its service-oriented architecture, DataRoket can provide data to any 3rd party application or tool.

From a single application server deployment, DataRoket™ has scaled to 100 users concurrently accessing very granular data.

DataRoket is imminently scalable on standard hardware and support MPP and Clustering.  For instance, from a distributed DataRoket App server build (three DataRoket servers speaking to one shared DataRoketStore) DataRoket™ has been able to provide more than 300 end users concurrently accessing unallocated trades of incrementally updated information at a notable financial institution.

The reality to any concurrent benchmarking is the need to address the size of the dataset returned. For a simple query returning 300 rows (which can be kept resident in-memory), DataRoket, running on any entry level server, can easily provide access to more than 300 concurrent users.

More specifically, we have found that a data set in an uncompressed state of 2 million rows and 20 columns wide can be placed in-memory in under 500 MBs of requirement. In a compressed state the requirement then drops to less than 1/10^th of the original allocated memory space <50 MBs.  This is the real test of concurrent users.  The limitations of an DataRoket environment have yet to be reached on even low end hardware.

DataRoket™ recognizes that delivery of data and user scalability are two different but vital factors. Therefore, DataRoket™ builds its data cubes in very small memory and CPU requirements to address scalability to large numbers of users; however, with regards to concurrency, DataRoket takes full advantage of its memory store, distributed Java memory server.

DataRoket is granular. It persists and partitions data in two manners:

Index and data stored to disk in columnar manner as potential query sources.

Wide row merged or single source data in 10k to 100k data blocks. With compression, files of 30 columns wide have ranged in a size of under 5 MBs, easily accessible via our smart engine’s in-memory pointers.

A user could request data existing in three files; cube41>data>37.XML (or flat file .dat). When that file is requested, it is read into the DataRoket memory store in a compressed state. DataRoket’s real-time compression stream architecture is fundamental in providing scalability of data reads, writes, and even in-memory file presence.

Now 100k rows of information lie resident in 2 MBs of memory, so when the next user requests the data in that file, it is an in-memory read only. This puts the stress of the search onto DataRoket’s in-memory store, allowing very small per user footprint.

Finally, through DataRoket’s in-memory histo file and index pointers, very accurate data location and small file read needs is achieved. This is the heart of DataRoket’s unparalleled scalability.

We have been able to create tremendous dynamic data cells of over 100 million rows very quickly—with results available in mere minutes rather than the accepted performance levels of hours.

However, part of DataRoket’s value is its ability to join two or more different data sources together, based on a primary key correlation—these dimensions can be completely different in terms of accessing Oracle, SQL, or even Business Objects universe and Oracle, and providing near real-time binding of that accessed data in less than 3 minutes. The persisted data source that is then created (referred to as the IC Mart), contains the partitioned data of 30-200 files that can then be queried by multiple users concurrently without additional need for access to the database. The performance improvement is significant.  For instance in In this situation, DataRoket requires 3-5 seconds to aggregate 10 million rows of data ( near real-time) - without any caching, pre-computation or summarization required.

DataRoket connects, integrate, accelerates, scales and streams your data when and where you need it providing you a global view that feeds any downstream database, data warehouse or application.

DataRoket is an web-based, standards-based Data Integration platform the delivers the core aspects of Data Integration, ETL and Data Federation in a single, easy to deploy and use platform that delivers a scalable, dynamic global view of your company's information from any data source or type.  

DataRoket’s unique platform connects, transforms, associates and aggregates multi-domain data into a hybrid in-memory and persistent real-time data repository.

Alternative solutions require costly tools to extract, bind, consolidate, aggregate and distribute the data. DataRoket addresses each of these areas without the endless need for expensive, specialized consultants, reprogramming, new integrations, multiple vendors and blown budgets.

Click here to see our growing list of data connectors

Watch a short video describing how the DataRoket Engine works

{HTML}
<iframe src={quot}http://player.vimeo.com/video/14172096?title=0{amp}amp;byline=0{amp}amp;portrait=0{amp}amp;color=f70248{quot} width={quot}640{quot} height={quot}360{quot} frameborder={quot}0{quot}></iframe>
{/HTML}

Yes. All aspects of DataRoket can be licenced. For instance if your application needs to connect to SAP or Business Objects or if you have massive amounts of data that must be processed and made available to your application (even in real-time), DataRoket can fill the bill. DataRoket can act as your data aggregation and and data visualization engine. Your data and your customers but leveraging our platform so you can focus on other areas.

We offer attractive licencing terms and can support integration and customization into your applications. Simply contact us at sales@dataroket.com.

QlikView Connector Proposal        

The DataRoket QlikView Connector now allows "any" user to tap any number of data sources, associated them, and feed all that data to QlikView for data visualization and analytics.

In order to introduce this technology to the market, DataRoket would like to make a special proposal to qualified companies. In order to qualify, you must have received an invite with the promotion code.  See Terms and details.

  If you did not receive an invite, you will need to request a demo and assessment conversation of your project to still qualify.   

Terms and Details.

- Complete the proposal acceptance form (enter the promo code in comments field).  You will receive, via email, your proposal for signatures. 

- First 5 companies to accept will receive the offer.

- A $60,000 value. For $5,000, DataRoket will install DataRoket, and three (3) connectors of choice from list.  Includes one day of training and standard annual support.

- QlikView licenses and installation in addition to DataRoket.  See participating QlikView partner for details.

- Subscription will be for life, renewing at $5,000 annually, as long as the account is current and within these guidelines. 

* DataRoket warranties every project for the first 12 months, and then follows the guidelines in the software agreement.

DataRoket Proposal        

[Looking for more information on BO and SAP connectors. Click here.]

The DataRoket DataPipe now allows "any" user to tap any number of data sources, associated them, and feed that data to any choice of applications, data visualization or analytics solutions.

In order to introduce this technology to the market outside of existing partnerships, DataRoket would like to make a special proposal to qualified companies. In order to qualify, you must have received an invite with the promotion code.  See Terms and details.

In the enterprise version, you receive the fully featured core DataRoket engine and the powerful DataRoket Big Data Delta Engine and Analytical DataStore (for more than 20M rows) . The packages has no limitations on the number of users or data sources.  The package also includes our full connector suite which has connectors for platforms such as Business Objects, People Soft, Microsoft dynamics, Teradata and many more.

This also includes our full data visualization suite and our drag and drop GUI.

To learn more about our connectors click here.

To learn more about Big Data Delta Roket and Analytical Data Store click here.

Price: Inquire (you can purchase DataRoket as an annual subscription or as our SaaS offering DataRoket on Demand)

DataRoket in the Cloud - Yes it's that easy

DataRoket as a Service (DaaS) is the industry's first enterprise class data integration, data management, data repository and data visualization platform

DataRoket On Demand enables a FULL web enabled expereince from the development and design to the delivery.  There is no need to download anything.  In one online platform you will be able to connect, design, integrate, associate, serve and visualize all of your data no matter how many sources or where they are located

Teamwork enabled by DataRoket as a Service enhances the flexibility of the development process and adds value to the overall organization. The Software as a Service model provides the same level of flexibility to both local and distributed project teams, while enforcing strict security for the project metadata.

The following capabilities are avialable in DataRoket as a Service (DaaS):

• Connection information and data structures for source and target systems
• Integration Jobs, including all properties of components and connectors, data transformations, mappings, etc.
• Administrative information (projects hierarchy, user permissions, etc.)
• DataRoket Scheduler
• DataRoket data repository (single global view of the data)
• Data visulaization package (not required but no extra charge)
• It is important to note that the actual enterprise data can be stored inside or outside your organization's firewall.  You can also deploy DoD inside your own Virtual Private Cloud or limit access to your own VPN.  DataRoket On Demand keeps the actual data safe!

Because it relies on the SaaS model, DataRoket as a Service does not require any configuration or administration.

Price: Per user or per size of infrastructure per year

To learn more about our DaaS click here.

DataRoket Project Consulting and Implementation: 

When you require specific needs or want a turn-key solution.

When to use it:

• You need to solve a specific data integration need and you are looking for a technical solution combined with expertise to deploy quickly a working solution.
• Implement the Free DataRoket Version Successfully.
  

Package contents:
DataRoket's experts help you deploy the DataRoket Product Suite so that you are able to address the specific need under the shortest timeframe possible.  During an initial Assessment of Business Need (ABN), our consultant will work with your team to detail the functional and technical specifications. After an onsite user training, our consultant supports your team throughout the development of the solution.  If desired you can also engage DataRoket's consultants to assist in hands on implementation.
Benefits

• Leverage of best technical expertise to exploit DataRoket Product Suite most efficiently
• DataRoket Product Suite is up and running in production
• Your users are trained

Price: Based on proposal

To learn more about our consulting services click here.

DataRoket is prides itself on besing powerful as any enterprise application, but also very easy to use. 

Still, it you need support, we have provides some easily affordable and flexible support options for you.  We are here to help and will ensure that any of your questions are answered and we will not hesitate to have our engineers dig into your questions.

Below is a summary of our support levels. 

Phone and 24 hour Support options are a percentage of subscription or license. 

Contact Us to schedule all levels of support.