Loading Qonnections 2015 Instagram Posts Into Qlik Sense (Or QlikView)

In this post we will demonstrate using the new Web Edition of QVSource to load data from Instagram into Qlik Sense Desktop.

The QVSource Web Edition is currently in private beta but should be available for general (beta) download in June 2015. We are also currently hosting an invite only cloud hosted instance of QVSource Web Edition which a number of users are already testing out the new version with. If you would like to be considered for access to this please fill out this form.

NOTE: You can also try this out using the current QVSource Desktop Edition. Whichever version of QVSource you are using, when using Qlik Sense just remember that at present you will first need to make this minor config change in order to allow load requests from arbitrary URLs.

First of all we fire up QVSource and open the Instagram connector. We ensure we are authenticated with Instagram and then select the SearchForTags table and enter ‘qonnections’ in the Tag field. There are (at time of writing) 303 results for ‘qonnections’:

We can see that there are a few Instagram tags being used in relation to Qonnections, the most popular one being simply 'qonnections'. We can now go to the MediaByTag table and make sure that this tag name is entered as the tag to find Instagrams for and then run the table.

We then select the Qlik Sense tab and copy the script to the clipboard:

Now we fire up Qlik Sense Desktop, create a new app and open the data load editor:

We paste in the script, and click load data:

And run the reload:

Note that we do not necessarily get back as many results as suggested in the earlier table as the SearchForTags table above shows counts including images which are private or might have subsequently been deleted.

We then return to the app overview and create a new sheet:

We edit the sheet and drag a bar chart in:

Then add the dimension username:

...and a measure of count(id):

We then limit to the top 10:

...and complete the edit, giving us the top 10 posters:

We now create a new sheet and add a table with dimensions for user name and link; and a measure for sum(likes count):

We can then sort by likes (descending) to see the most liked posts and poster:

We click ‘done’ to view the results:

Now we create a new sheet and add a bar chart with create time (utc qlik date) as dimension and count(id) as measure. This can be sorted by the dimension (date) first and saved, showing the peaks in posting media around the annual Qonnections conference:

This demonstrates just how easy it is to pull data from instagram and quickly extract meaningful patterns and trends. This is just a simple example, in a real world example we might want to write QlikView/Qlik Sense load script to loop through a number of different tags which were used during the event. We could also extract a great deal more data such as comments and likes using the many other tables which the connector supports.

You will find a more complete example for QlikView over on our GitHub Page - note that although this is for QlikView the load script should also work fine in Qlik Sense giving you the same data model to build your user interface on top of.

You can request a fully functional free trial of QVSource from our and try out the 35+ Connectors it supports with QlikView or Qlik Sense.

Will Big Data Analytics Change The Competitive Landscape In The Next Year?

An interesting tweet caught my eye recently, but it’s taken me a little while to finally put pen to paper

It was a Qlik tweet that read “84% Of Enterprises See #BigData #Analytics Changing Their Competitive Landscapes In The Next Year: http://onforb.es/1FSCcDe via @forbes”.

The reason that this was of particular interest to me, is that this tweet hit on two things that are very dear to us: 1) data and 2) analytics. 

It’s very simple. There’s a HUGE amount of data out there that holds really important information on your business, and your company’s performance would benefit from accessing and understanding it.

The QVSource team believes that the more data we can help our customers gain access to, the more comprehensive their analytics will be, and the better their decision making will be, and the more successful they will become.

And it’s reassuring to read that 84% of enterprises agree with us. It’s certainly substantiated in the speed at which new customers and partners are buying into the concept of the QVSource data connectors. We are seeing an unprecedented number of organisations, from all industries and all corners of the globe, seeking access to new data sources via the QVSource connectors. QVSource helps companies mine data from a growing number (30+) of online data sources, and pumps vast amounts of new data into Qlik's Business Discovery solutions, in near real-time, ready for analysis. Our technology is changing the speed at which companies are able to react to data analysis, making decisions based on a larger and more comprehensive set of data more quickly than ever before.

Another statistic that was cited in the study was that “89% believe that companies that do not adopt a Big Data analytics strategy in the next year risk losing market share and momentum.” We agree! Data analysis gives companies an understanding of their business performance that leads to intelligent decisions being made, based on factual evidence. This is their competitive edge. Companies that don’t have that strategic insight, comprehensive understanding, and 360 degree view of their business, will have no chance of succeeding in an increasingly ruthless marketplace.

Finally, at the end of the report is an interesting chart asking companies to rank the challenges to implement Big Data. In our opinion these challenges are the same if you’re looking at any kind of new data to include in your analytics, whether it’s defined as Big Data or not. 29% of respondents rated as one of their top 3 challenges, (13% said it was their main challenge) the “consolidation of disparate data and being able to use the resulting data store are difficult”. QVSource is ideally suited to reduce this risk as it reaches out to various platforms and presents it as a single point of call to QlikView or Qlik Sense in a consistent, timely manner. Similarly, QVSource can help reduce the pain point for the 20% who rated as one of their top 3 challenges, “Reliance on multiple vendors-no integrated solutions”, as it integrates nicely into QlikView and Qlik Sense.

We're proud that QVSource is one of the technology companies that are fuelling this revolution. So if you want to get a more complete view of your business in Qlik, by drawing new data sets in from online sources, to make strategic business decisions in real-time based on fact, then come and talk to us. 

Qlik Sense Launched

It’s been a busy time for Qlik! Here at QVSource, we were delighted to see the announcement that Qlik Sense had been launched to market, and we have been following the positive coverage with interest. Qlik was hosting an analyst “unsummit” in New York at the time of launch, and on the whole, the analyst community has been very positive about Qlik’s new data visualisation platform.

And we’re very excited about Qlik Sense too – this is the first “device-independent, self-service visualisation and discovery” product available on the market. Essentially, Qlik Sense is the first offering to deliver self-service BI based on a server-side development and distribution model, empowering every user with the full capability to create, customize, or extend visualisations from any device, at any point in time. We also believe it's the first product written from the very start with mobile devices as first class clients.

As I mentioned in our blog post last month, we have been working hard on QVSource V2; a browser-based version of QVSource that will interconnect with the new Qlik Sense in an even more seamless way (note that the current version of QVSource does work with Qlik Sense already anyway). I’m pleased to say that development is going well, and we should have a demo version ready to share soon.

For many years, we have been working alongside Qlik to help make its BI platform the best connected on the market. QVSource allows businesses to analyse the impact, not only of social media, but also many other channels, on revenue stream performance, and feed that business critical data into both QlikView and Qlik Sense.

Below, I’ve highlighted just a few of the problems that we help our customers to solve, but with over 30 connectors available, the possibilities for QVSource getting web-based data into QlikView or Qlik Sense are almost endless:

Facebook: Are my Facebook pages experiencing trends around user growth or demographics? How and where is content consumed? Can I compare brand to brand? Which are my successful pages and posts?

Twitter: How do I measure the value of Twitter for each of my brands? Who are the most active users and how does the sentiment change over time?

Google: How can I compare my company’s web traffic analysis with other business data, such as revenue performance? How can I see Google’s rich web analysis in a Qlik platform in real-time?

YouTube: How can I analyse the strengths and weaknesses of my company's video strategy? How can I review the financial performance of our YouTube channel?

Please contact us if you would like to know more, or check out the many customer success stories on our website. You can also try QVSource for yourself using our fully functional free trial.

QVSource 1.5.4 Now Available

We have just released version 1.5.4 of QVSource - The QlikView and Qlik Sense API Connector. This blog posts outlines the main changes.

As always, we would also recommend you read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

Qlik Sense

Firstly, we'd like to make another quick mention of Qlik Sense, Qlik's exciting next generation in self-service visualisation and analytics, which became available for download this week. You'll be pleased to know that QVSource will work with Qlik Sense - you can read our blog post about it here.

New Connectors

Google DoubleClick for Advertisers (DFA) - We have developed this connector to compliment our Google DoubleClick for Publishers (DFP). This is an early build, so we'd welcome any comments on it.

Breaking Changes Or Possible Breaking Changes

  • Sentiment Analysis & Text Analytics Connector V2 - Unfortunately we have had to remove Sentimental (formerly Chatterbox) connectivity from our Sentiment and Text Analytics Connector. This is because Sentimental have now removed their API from Mashape and as such we are no longer able to offer it either. If you were using this API from your applications via QVSource it will unfortunately no longer work.
  • Google DFP Connector (POSSIBLE BREAKING CHANGES) We have upgraded to v201405 of API (see release notes here for items which may affect you).
  • MailChimp V2 Connector - This connector has been updated both to the new QVSource layout style but also to use the latest V2 of the MailChimp API. Unfortunately this means that it is not backwards compatible with the previous version and you will need to regenerate your load script. The new version also includes a number of new tables, for example you can now see who's unsubscribed from a list. V1 of this Connector is now deprecated and will be removed in a future version.
  • Removed Connectors
    • V1 of the Facebook Insights Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.
    • V1 of the MongoDB Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.
    • V1 of the Google AdSense Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.

Updated Connectors

We've made a number of changes to some of our connectors, including:

  • Facebook Fan Pages V2 Connector - This now reflects our new connector layout making it much easier to know what parameters each table needs in order to get the data. This connector will replace the existing Facebook Fan Pages Connector, so you should upgrade as soon as possible using the instructions here. V1 of this Connector is now deprecated and will be removed in a future version.
  • General XML/JSON/SOAP Web Connector - S/FTPListFilesAndFolders has been added to the connector, making it easier to work with those locations. Quick Intelligence, one of our partners, recently blogged about using the General Web Connector to pull data from a secure web portal, where this feature was used.
  • File Transfer (FTP/SFTP) Connector - We have updated a key component of this connector and it also now supports specifying port numbers. It also has new tables to list files and folders within a specified directory.
  • Google AdWords Connector - This has been upgraded to use the latest v201406 version of the AdWords API - you can see the API change log here for any updates which may impact or be of use to you.
  • Google BigQuery Connector - the timeout has been increased to 10 mins.
  • MongoDB Connector - This has been upgraded to use the very latest MongoDB driver. 

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release in the personalised download link we should have sent you via email.

If you are new to QVSource you can download a fully functional free trial from our website.

QVSource Works With Qlik Sense

[EDIT: 8th October 2014 - It appears that in a recent Qlik Sense release, by default all reloads have to be done to a [lib:// .....] which does not support building URLs on the fly (e.g. with load script variables) - something which in our experience QlikView users do often with web based reloads (not just via QVSource). You can still enable the previous behaviour as explained here and here. We are also trying to input into this decision which we currently believe will impact a large number of Qlik users negatively.]

We are pleased to see that Qlik have just launched Qlik Sense Desktop. From their press release Qlik Sense Desktop is:

"a free version of its next-generation data visualization application that delivers a simple drag-and-drop interface for business users to rapidly create interactive visualizations, reports, and dashboards. Qlik Sense Desktop is the first commercially available release from the QlikView.Next project. It includes the Qlik patented data indexing engine to give users the unrestricted ability to explore their intuition and the relationships that exist in the data, uncovering the hidden associations and insights that may otherwise be overlooked."

For existing or prospective commercial customers of QlikView and QVSource (we do not have a version of QVSource for free or personal editions of QlikView or Qlik Sense at this point in time) we just wanted to re-iterate that QVSource is fully compatible with the new Qlik Sense platform and we have just put a step-by-step tutorial on our wiki which shows how you can load data from one of the many connectors into your Qlik Sense applications.

We are also prototyping a new version of QVSource which will look and feel more aligned with the new Qlik Sense product and hope to post more details on this in the future.

QVSource - The QlikView API Connector - has over 30 connectors to various online social media and business APIs, is the highest rated product on Qlik Market and built by the winners of Qlik's Technology Partner Of The Year Award 2014. You can grab a fully functional free trial here.

Page List