QVSource 1.6.0 Now Available

We have just released version 1.6.0 of QVSource - The QlikView & Qlik Sense API Connector.

This blog posts outlines the main changes. As always, we would also recommend you read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

New Connectors

  • We have a new connector to JIRA (hosted or locally run). Currently there are only a couple of tables, one to retrieve all issues and another to make and custom REST API request but we will add to this in the next release - please let us know what features/data you need so we can make sure you are covered.

Updated Connectors

  • IMPORTANT/BREAKING CHANGE: We have removed the MyAccounts and Messages tables (as we do not believe they are being used and would now require us getting approval from Facebook to continue using) as well as the FriendsWhoUseThisApp table which we also believe is not useful from the Facebook Fan Pages Connector.
  • V3 of the Facebook Insights Connector has been added (and V2 removed). All requests to FacebookInsightsConnectorV2 will now be automatically routed to FacebookInsightsConnectorV3 (although we would still recommend making the same change in all your load scripts to avoid confusion). BREAKING CHANGE: Unfortunately, Facebook have now changed their Insights API and application insights are no longer available in this version of the connector although we hope to resolve this soon.
  • We have a new V2 of the Salesforce Connector. This replicates the functionality of the previous version and also has additional Insert and Update tables which allow you to write data back to Salesforce from your QlikView or Qlik Sense load scripts.
  • The MongoDB Connector now scans all items in the MongoDB Collection in order to establish all possible columns before generating the table for QlikView/Qlik Sense.
  • A new TableSchema table has been added to the Google BigQuery Connector.
  • The SugarCRM Connector has new max results and order by inputs which makes it much easier to get just the data you need. We hope to add a filter input to this connector also soon.
  • The Klout Connector now makes all API calls over HTTPS instead of HTTP.
  • The Adobe Analytics (Omniture) Connector has a fix in to avoid having duplicate column names in the result tables.

Deprecated Connectors

The following connectors have been deprecated and will likely be removed from the product in a future version.

  • The DFA Connector (which was still in beta) has been deprecated as it uses an API which Google are now removing later in the year. Please contact us if you would like us to consider redeveloping this connector to use the latest DFA API.

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release in the personalised download link we should have sent you via email.

If you are new to QVSource you can download a fully functional free trial from our website.

Urgent Fix for Twitter and Facebook Plus v1.5.6 is Now Available

We've just released v1.5.6.1 of QVSource - the QlikView and Qlik Sense API connector, which is possibly one of our most important releases as it contains a critical fix for the SSL3 issue that arose yesterday and affects all our Twitter and Facebook users. As always we strive to give the best support we can and within a few hours of the issue being identified we had a fix available. You can read more about the issue in the post that we made this morning.

Due to the nature of the issue, this may also affect other connectors, so we recommend that everyone update to the new version as soon as possible.

In addition to this fix, we also have a number of general improvements, some of the notable ones being...

Twitter Connector

  • Twitter have dropped support for SSL3 connections, which QVSource now reflects (see above).
  • The Followers and Following tables now return up to 3,000 results.
  • A max_id parameter has been added to Mentions, UserTimeline HomeTimeline, DirectMessagesReceived and DirectMessagesSent tables. The Favorite table also has this as well as a since_id parameter added

General Web Connector

  • Many tables now have a checkbox to remove invalid characters.
  • Any @ symbol occurrences in JSON key names are now handled better when converting to XML where it is normally invalid.

MongoDB Connector

  • If server value begins with mongodb:// it will now be used as a standard connection string (i.e. port, username/password and database inputs will be ignored). This allows more flexibility in connection options.
  • We have fixed bug where document fields seen in a given batch of documents are not properly remembered on subsequent batches which can break QlikView load.

Sentiment & Text Analytics Connector

  • The Repustate engine now supports Russian.
  • Breaking Change - with Repustate you must now register for your own API key and use this instead of the built-in one, which is no longer available.

New Helper Connector

This is a new connector in development, which currently has a single Encrypt table. This can be used for encrypting a password before sending to, for example, the General Web Connector.

As always, we would also recommend you read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release in the personalised download link we should have sent you via email. If you can't find this, please get in touch.

If you are new to QVSource you can download a fully functional free trial from our website.

QVSource 1.5.4 Now Available

We have just released version 1.5.4 of QVSource - The QlikView and Qlik Sense API Connector. This blog posts outlines the main changes.

As always, we would also recommend you read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

Qlik Sense

Firstly, we'd like to make another quick mention of Qlik Sense, Qlik's exciting next generation in self-service visualisation and analytics, which became available for download this week. You'll be pleased to know that QVSource will work with Qlik Sense - you can read our blog post about it here.

New Connectors

Google DoubleClick for Advertisers (DFA) - We have developed this connector to compliment our Google DoubleClick for Publishers (DFP). This is an early build, so we'd welcome any comments on it.

Breaking Changes Or Possible Breaking Changes

  • Sentiment Analysis & Text Analytics Connector V2 - Unfortunately we have had to remove Sentimental (formerly Chatterbox) connectivity from our Sentiment and Text Analytics Connector. This is because Sentimental have now removed their API from Mashape and as such we are no longer able to offer it either. If you were using this API from your applications via QVSource it will unfortunately no longer work.
  • Google DFP Connector (POSSIBLE BREAKING CHANGES) We have upgraded to v201405 of API (see release notes here for items which may affect you).
  • MailChimp V2 Connector - This connector has been updated both to the new QVSource layout style but also to use the latest V2 of the MailChimp API. Unfortunately this means that it is not backwards compatible with the previous version and you will need to regenerate your load script. The new version also includes a number of new tables, for example you can now see who's unsubscribed from a list. V1 of this Connector is now deprecated and will be removed in a future version.
  • Removed Connectors
    • V1 of the Facebook Insights Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.
    • V1 of the MongoDB Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.
    • V1 of the Google AdSense Connector has now been removed after a long deprecation period - please upgrade to the much improved V2 of this Connector.

Updated Connectors

We've made a number of changes to some of our connectors, including:

  • Facebook Fan Pages V2 Connector - This now reflects our new connector layout making it much easier to know what parameters each table needs in order to get the data. This connector will replace the existing Facebook Fan Pages Connector, so you should upgrade as soon as possible using the instructions here. V1 of this Connector is now deprecated and will be removed in a future version.
  • General XML/JSON/SOAP Web Connector - S/FTPListFilesAndFolders has been added to the connector, making it easier to work with those locations. Quick Intelligence, one of our partners, recently blogged about using the General Web Connector to pull data from a secure web portal, where this feature was used.
  • File Transfer (FTP/SFTP) Connector - We have updated a key component of this connector and it also now supports specifying port numbers. It also has new tables to list files and folders within a specified directory.
  • Google AdWords Connector - This has been upgraded to use the latest v201406 version of the AdWords API - you can see the API change log here for any updates which may impact or be of use to you.
  • Google BigQuery Connector - the timeout has been increased to 10 mins.
  • MongoDB Connector - This has been upgraded to use the very latest MongoDB driver. 

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release in the personalised download link we should have sent you via email.

If you are new to QVSource you can download a fully functional free trial from our website.

QVSource 1.5.3 Now Available

We have just released version 1.5.3 of QVSource - The QlikView API Connector. This blog posts outlines the main changes

As always, we would also recommend you read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

New Connectors

  • Dropbox Connector: We have a brand new connector (beta) for Dropbox which allows you to list your files and folders, download file contents directly to QlikView as well as upload files to Dropbox via your QlikView load script.
  • Google BigQuery Connector: We have a brand new (beta) connector for Google BigQuery.
  • Sentiment Analysis & Text Analytics Connector:  We have added a new Regular Expression option to this Connector which allows you to perform RegEx analysis on any textual data in your QlikView application - you can see some examples here. Note that this is implemented locally in QVSource (it doesn't go via a Web API) so is very fast.

Updated Connectors

  • Twingly (Blog Search) Connector: We have an updated version of our Twingly Connector which allows searching for results from millions of blogs from around the world. With the new version you now get a small number of free API calls whilst trialling the connector and a larger number as a commercial user and there is no longer any need to contact Twingly separately for an API key.
  • Google Drive Connector: This now has a new table to return the contents of a file as XML (useful for example if you are hosting a QVD file on Google Drive).
  • Twitter Connector:  The Tweet Lookup table uses a new feature of the Twitter REST API which means it can now lookup up the data for up to 100 comma separated Tweet IDs per request (and 60 of these requests can be made per 15 minutes meaning ). We have also added the following trend related tables: TrendingLocations, TrendsForPlace, LocationsWithTrends. Finally, we have fixed a bug in the UserSearch table which was returning duplicated rows in some instances.
  • File Transfer (FTP/SFTP) Connector: FTPDownloadAndList and SFTPDownloadAndList tables have been added which list which files were downloaded and a FileCount column has been added to the simpler FTPDownloadFile/SFTPDownloadFile tables.
  • Sentiment Analysis & Text Analytics Connector:  We have added tables to support the new semantic API features from Repustate (Themes, Entities and Expansions). Please note also the old V1 of this connector is now deprecated and all users should move to the new version.
  • POP3/IMAP Mailbox Connector: We have added a new ImapMessageHeaders to allow you to access the emails headers.

Connector Fixes

Connectors Out Of Beta 

We've a few connectors that are moving out of beta, as such, if you're a customer and using these, please get in touch as they are now on our price list. 

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release at the personalised download link we should have sent you via email.

If you are new to QVSource you can download a fully functional free trial from our website.

QVSource 1.5.2 Now Available

We have just released a new version of QVSource - The QlikView API Connector. This blog posts outlines the main changes

As always, we would also recommend you also read the notes on the "Change Log" tab of any connectors you are using for a comprehensive overview of changes.

New Connectors

  • SugarCRM: We have a brand new connector for SugarCRM, one of the most widely used CRM systems on the market. This connector allows QlikView users to load Accounts, Contacts, Leads, Opportunities, Forecasts, Meetings and Calls.

Updated Connectors

  • Facebook Insights V2: We have a completely revised V2 of our Facebook Insights Connector which uses the new UI style. This offers huge performance and usability improvements over the previous version (which is now deprecated and marked for removal) and we would recommend all users to upgrade. We have instructions here on upgrading from the previous version. Please note that the previous V1 of this Connector will be removed from QVSource in June 2014 so all users should upgrade no later than this.
  • MongoDB: We have a new version of our MongoDB Connector which uses the new UI style and the latest MongoDB Driver. The previous version of this Connector is now deprecated and although this Connector is still in beta would encourage all users to start using this new version and providing feedback or comments.
  • Google Calendars: We have a new version of our Google Calendar which uses the new UI style. This has a small but breaking change which is that the default data format is now QVX - we would recommend you regenerate your load scripts.
  • Google AdSense: We have a new version of our Google AdSense Connector which uses the new UI style and the latest API (v1.4) version. Please note that the previous V1 of this Connector will be removed from QVSource in June 2014 so all users should upgrade no later than this.

Removed/Deprecated Connectors

Of particular importance are the four removed Connectors listed below. If you are using these you must upgrade to start using the new versions.

  • The following Connectors have been removed as they have been replace/superseded with new improved versions:
  • Salesforce Connector: We have also deprecated our Salesforce Connector for QlikView. This is because Qlik have their own Connector to this already. We are not currently planning to remove the QVSource version from the product but are no longer actively maintaining or developing it. If you find the Qlik Salesforce Connector does not meet your requirements please get in touch.

Connector Updates

  • Google AdWords Connector: We have upgraded this by two AdWords API versions to the latest v201403. Please check the Report related updates here and here for changes and new features which you may be able to use in your reports.
  • Google Analytics Connector: We have fixed a minor bug where the WebProfiles table did not page correctly. This would only have affected users who had more than 1000 Web Profiles.
  • Google DFP Connector:
    • We have upgraded to the latest DFP API version v201403.
    • We have reduced memory utilisation and improved performance.
    • The Connector now makes more intelligent usage of the API quota limits.
    • The parameter input area should now scroll vertically.
  • Google Drive & Spreadsheets Connector: We have added the ability to specify a folder ID to move a newly created spreadsheet to.
  • Google Plus Connector:
    • The Person table has been renamed ObjectDetails (as it can return data for a Person or Page). For script generated using previous versions, the table People should be automatically mapped to this name. This table also has the following new fields: occupation, plusOneCount, circledByCount and primary_placesLived.
    • We have added a new ObjectDetailsAsXML table which returns all the details returned by the API as XML (ObjectDetails selects a subset of these to a structured table). This can then be natively parsed/loaded in QlikView.
  • Twitter Connector: We have added Post_UserLookup_Info and Post_UserLookupById_Info tables and an associated example application on GitHub here illustrating how they can be used. The purpose of these tables is to support the use case of loading information on a large number of followers or friends. Because the API only allows a limited number of calls per 15 minutes, if the account you are interested in has above a certain number of followers/friends then you need to accumulate this data over a number of reloads over a number of 15 minute windows.
  • Sentiment Analysis & Text Analytics Connector:  The ChatterBox option has been renamed to Sentimental. The Excitement table has been removed and an Anger table has been added for Chinese. These are changes based on the underlying API and not due to QVSource.
  • Facebook Fan Pages & Groups Connector:
    • The User and Person tables now always return a row, a new status column indicates any errors returned if there was an issue retrieving the data.
    • We have fixed a bug in the 'Don't return items before' feature which was sometimes not going back as far as it should.
    • We have fixed bug where the has_at_least_this_many_likes and has_at_least_this_many_comments fields always had a value one larger than the actual.
    • We have added comment_link and like_link columns to FeedItems and Posts tables. This contains a link which allows you to open the post in a browser from your QlikView application.
  • Blue Yonder Connector: We have upgraded this in line with the latest v1.14.0 and also changed the parameter input for the API version so the user can enter their own version number (rather than picking from a drop down).
  • General XML/JSON/SOAP Web Connector: We have added a new User Agent input field to allow this to be overridden.
  • You Tube Analytics Connector: This Connector has now been taken out of beta.
  • HEIDI Connector: The parameter input area should now scroll vertically.

QVSource On GitHub

You will now find most of our example and 'starter' applications over on our GitHub page here.

You don't need to know anything about GitHub to use them (just look for the 'Download ZIP' button for any applications you are interested in). However if you do have a free GitHub account you can use it to receive alerts for changes to the applications and also as a way of exploring the load scripts and their changes on the GitHub site itself (look for the LoadScript.txt file in the sub folder of the application you are interested in).

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release at the personalised download link we should have sent you via email.

Before that - If you like what we are doing with QVSource and haven't already, please take a minute to rate us on QlikMarket or leave a recommendation on our LinkedIn product page.

New QVSource Release (1.4.4) Available

It's been six weeks since we released 1.4.3.0 and as usual we've been working hard to make QVSource even better to give QlikView users even more power and flexibility in connecting to Web APIs and other data sources.

We are pleased to announce that a new version is now available with quite a few interesting enhancements and also a couple of fixes which may have affected some users:

  • We have fixed a couple of important stability issues:
    • Some users were finding that the connectors were not loaded/showing until the 'Include Beta' checkbox had been toggled at least once.
    • The main settings file was occasionally getting reset and losing, for example, the fact that the EULA had been accepted. This was causing issues especially for server based deployments.
  • We have added a new ListFileRevisions table to the Google Drive Connector.
  • The MongoDB Connector has had some massive performance boosts and can now be queried using JSON.
  • The Twitter Connector Search is no longer limited to a maximum of 15 pages of result (i.e. 15 x 100 = 1500 Tweets).
  • Three new tables (GroupMembers, Files and Events) have been added to the Facebook Pages & Groups Connector. We will be working on support for the new comment replies soon.
  • We have updated the DoubleClick for Publishers (DFP) Connector to use the new API (v201302).
  • BREAKING CHANGE: The Accounts table has been removed from the Facebook Insights connector (this is dues to removal of this feature from the API itself).
  • A new 'Include Depreciated Connectors' checkbox has been added and deprecated connectors are no longer shown by default.

If you are a customer or trialling QVSource and would like to get these enhancements as well as some other general bug fixes and performance improvements, simply go to the download link that you would have received in your QVSource download email.

Or, if you've never tried QVSource and would like to, then you can get a free trial by completing this form.

If you like what we do with QVSource then we'd really appreciate it if you could take a few moments to either rate us on QlikMarket or recommend us on our LinkedIn page. If you've already done this, then thank you!

Don't forget you can always keep up to date with what we're doing by following us on Twitter, Facebook and Google+.

Major New QVSource Nightly Build (1.4.0.4)

Good news - We have just made a major new QVSource release available.

As there have been many significant changes and improvements this is currently only available as a 'nightly build' - this means it's not yet recommended (or supported) for critical production environments but we would recommend all QVSource users to try out this new release on their QVSource powered QlikView applications and report back any feedback or issues you are experiencing.

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release at the personalised download link we should have sent you via email.

Note that it's possible that in the week(s) after this blog post and release is published, we will upload new nightly builds with incremental changes and fixes based on the feedback so please check the download page regularly for further updates.

Once this new release has been out for a few days to a week we will probably push out a dedicated email newsletter so that users who might not necessarily follow this blog or our Twitter, Facebook or other social media accounts, are aware of the new release.

We would then expect this to be released as the new official release some time in February.

The rest of this blog posts outlines the main changes in this latest version.

Before that - If you like what we are doing with QVSource and haven't already, please take a minute to rate us on QlikMarket or leave a recommendation on our LinkedIn product page.

Synchronous, Asynchronous and Batch Request Modes Added

This was explained in detail in the previous blog post and so will not be covered here. However this update has the potential to give major performance improvements and also change and improve the way QVSource related QlikView script is constructed. One thing to note is that we have now removed the previous mechanism for running asynchronous requests as the new functionality improves and supercedes this.

(Note: Version 1.4.0.7 released as a nightly build 26/01/13 fixes an issue in the Async feature of this).

QVSource Windows Service

QVSource now has a dedicated Windows Service available and documented here. We have always had a well documented and stable way of configuring QVSource to run on a server environment however the new Windows Service represents an improvement over this technique and in time will likely become the recommended and only supported method.

Related to this, we have also now made it so if QVSource is running in server mode you can run QVSource desktop in order to manage connector and other settings without having to then restart the QVSource server instance for changes to be picked up.

Checking the Status of QVSource

It has always been possible to browse to http://localhost:5555/QVSource to get a html page with various pieces of information about QVSource (e.g. the licence state, version, which Connectors were running). We have now tidied this up and added additional information. More importantly, we have added a new XML option at http://localhost:5555/QVSource?format=xml which allows you to check the exact QVSource status from your QlikView load script as explained here.

Log File & Error Page Updates

QVSource now has a much more structured XML file format with additional information added. As before, logging needs to be enabled for these to be generated as explained here. It should now be possible to load these files into QlikView directly for structured reporting.

Related to this, the HTML error page which QVSource sends back has also been enhanced and tidied.

appID Load Script Parameter

QVSource now adds an appID=$(vQVSourceAppId) parameter to the generated QlikView load script. We recommend setting this variable at the start of your load script (although it is not mandatory) to help provide an identifier to QVSource to be used in error logging and tracing. This is explained in more detail here.

Note that it was pointed out that appID=$(vQVSourceAppId) actually breaks the QlikView 'Web File' Wizard (used for example in the General XML/JSON Connector) - so in 1.4.0.8 and later we actually just include appID= in the URL leaving it to the user to insert a value or variable in the final QlikView script).

Connector Changes & Updates

  • The Klout V1 Connector for QlikView has been removed from QVSource, please upgrade to the new version. We have also made a couple of fixes and improvements to this new Klout Connector.
  • We have upgraded the MongoDB Connector for QlikView to use the latest c# driver and also fixed a couple of minor issues.
  • The Google AdSense Connector for QlikView has been upgraded to use the latest API (version 1.2).
  • The Semiocast Connector for QlikView now supports new languages and has some performance improvements.
  • We have removed V1 of the FreeAgent Connector for QlikView, please upgrade to the latest V2 version.
  • Added option to encrypt the request url in the General JSON/XML Web API Connector (version 1.4.0.7 released as a nightly build 26/01/13).
  • Deauthorise buttons have been added to the Facebook Fan Pages and Insights Connectors to remove the app from your Facebook profile (version 1.4.0.8 and later).
  • Empty \Temp folder has been added to the distribution - this is currently the recommended location to store the parameters CSV files used by the new processParams[Sync|Async|Batch] feature(version 1.4.0.8 and later).
  • The Web Preview window in the General JSON/XML Web API Connector should now format XML and HTML properly (version 1.4.0.8 and later).

Page List