QVSource Web Edition 1.0.1 Now Available

(This blog post originally appeared on the QVSource blog here.)

We are delighted to announce the availability of a new version of QVSource - The QlikView and Qlik Sense API Connector!

We have released an update of both the WinForms Edition (version 1.6.9) and the new Web Edition (version 1.0.1). However, as noted in an earlier post, the WinForms edition is now officially deprecated and will no longer be supported after the 22nd May 2016. Therefore we would strongly recommend you now start working with the Web Edition if you are not already.

IMPORTANT - Upgrade to .NET 4.5.2

There has been a key update to these latest releases - you will now need to ensure you have the .NET Framework 4.5.2 installed on your machine (rather than .NET 4.0 which was required previously). If you do not already have it you can access it here.

New Connectors

Note that we have the first version of a brand new connector to Office 365 Sharepoint.

We also have a new V3 version of the Facebook Fan Pages & Groups Connector, V2 is now deprecated and we would advise all users to start working with the new V3 which works with the latest version of the Facebook Graph API.

Finally, we have a new V2 of the DropBox Connector which replaces V1 (although it is essentially the same, it simply uses their latest API).

All Updates (Since 24th Nov 2015)

The following updates have been made to the QVSource Core and Web UI as well as the connectors listed.

Please pay particular attention to any connectors which may have breaking changes highlighted below.

Adobe Analytics (Omniture) Connector
Amazon S3 Connector
Blue Yonder Connector
Box Connector
Dropbox Connector (v2)
Facebook Fan Pages & Groups Connector (v2)
Facebook Fan Pages & Groups Connector (v3)
Facebook Insights Connector (v3)
File Transfer Connector (FTP/SFTP)
FreeAgent Connector (v2)
Google AdWords Connector (v2)
Google BigQuery Connector
Google DoubleClick For Advertisers (DFA) Connector
Google DoubleClick for Publishers (DFP) Connector (Includes Breaking Changes)
Google Prediction Connector
Google Webmaster Tools Connector
Helper Connector
Instagram Connector
Klout Connector (v2)
MailBox Connector (IMAP/POP3)
MailChimp Connector (v2) (Includes Breaking Changes)
MongoDB Connector (v2)
MS CRM Connector (Includes Breaking Changes)
Notification Connector
OData Connector (V2)
Office 365 Sharepoint Connector
OneDrive Connector
SugarCRM Connector
SurveyMonkey Connector
Sentiment Analysis & Text Analytics Connector (v2) (Includes Breaking Changes)
Twitter Connector (v2)
Web Connector for General JSON/XML/SOAP APIs (v2) (Includes Breaking Changes)
Yahoo! Placemaker Connector
YouTube Analytics Connector
YouTube Connector (v3)

Core Engine

  • application/xml rather than text/xml now used throughout for tables which write a raw XML response. (26 Feb 2016)
  • Updated WinForms version of Web Server so that the connector ID can now be passed in as a query parameter instead of part of the path. So for example http://localhost:5555/QVSource/Connect/?connectorID=TwitterConnectorV2&table=Search&... can be used in place of http://localhost:5555/QVSource/TwitterConnectorV2/?table=Search&... This has been done so that we can explore working via the new Qlik REST Connector. (23 Feb 2016)
  • Added new format=json option. (23 Feb 2016)
  • Fixed bug in processParamsSync feature (See http://wiki.qvsource.com/Synchronous-Asynchronous-And-Batch-Requests-Explained.ashx). (16 Feb 2016)
  • RC3 for new public release. (11 Feb 2016)
  • Short URL Expander Removed. (11 Feb 2016)
  • Added first version of Office 365 Sharepoint Connector. (08 Feb 2016)
  • Added DropBox V2 Connector. (08 Feb 2016)
  • IMPORTANT: Upgraded to .NET version 4.5.2 (previously 4.0 was used). (07 Feb 2016)
  • Connectors which use one or more SOAP requests should now correctly pick up configured Proxy (e.g. RPS Connector, DFP Connector and AdWords Connector). (07 Feb 2016)
  • POTENTIALLY BREAKING CHANGE: We had some custom code to replace certain special characters which are valid JSON but invalid XML with safe values for XML. We have now removed this code and internally use some system level .NET code which should account for all potential invalid values but now uses different replacements. These replaced values might ultimately end up being table column names depending on whether you are using a connector table which provides raw XML or a structured table and you may need to adjust your scripts accordingly according to the following. This is actually a QVSource wide change but the most likely place it will impact is in certain specialist uses of the General Web Connector. (22 Dec 2015)
  • Fixed threading issue which may cause QVSource to crash if status page (e.g. at http://localhost:5555/qvsource) was requested while application was still starting up and registering connectors. (22 Dec 2015)
  • All multi line inputs now (e.g. JSON and XML inputs and some string inputs, e.g. the POST parameter on the Web Connector) can now accept an @file=c:\path\to\file.txt input so that the contents can be more easily managed in an external file. This can be used in conjunction with the ReplaceTokensInFile table of the Helper Connector (http://wiki.qvsource.com/Helper-Connector.ashx#ReplaceTokensInFile_Table_0) which can be used to modify this file before it is read. (11 Dec 2015)
  • RC for new release. (11 Dec 2015)
  • Updated to reference Newtonsoft v7 externally. (05 Dec 2015)
  • Added deprecated message to WinForm title text and also about and licence text areas. (02 Dec 2015)

Web User Interface

  • If there is an error response from the API in XML or JSON format when running a table in the UI, this should now be shown to the user. (25 Feb 2016)
  • RC4 for new public release. (14 Feb 2016)
  • Column aliases in generated load script should now have _ after table name. (13 Feb 2016)
  • RC3 for new public release. (11 Feb 2016)
  • Short URL Expander Removed. (11 Feb 2016)
  • IMPORTANT: Upgraded to .NET version 4.5.2 (previously 4.0 was used). (08 Feb 2016)
  • Added first version of Office 365 Sharepoint Connector. (08 Feb 2016)
  • Added DropBox V2 Connector. (08 Feb 2016)
  • RC2 for new public release. (08 Feb 2016)
  • RC for new public release. (03 Feb 2016)
  • : characters in table column names and generated script (which break QlikView/Qlik Sense load script) should now be replaced with underscores _. (14 Jan 2016)
  • @file=c:\path\to\file.txt style inputs can now be used on multi line inputs to have their values populated from file. See http://wiki.qvsource.com/Multi-Line-Input-Parameters.ashx for more information. (17 Dec 2015)
  • Removed (beta) text from footer. (26 Nov 2015)
  • Fixed check for updates feature on about tab. (26 Nov 2015)
  • Changed MIME type for QVX response which means it should now be rendered in browser again (as in earlier beta versions) rather than being downloaded as a file. (26 Nov 2015)
  • Added warning for IE9 or earlier. (26 Nov 2015)
  • Fixed bug with boolean input parameters not saving correctly on tables. (26 Nov 2015)
  • Fixed issue with CSV file download not always correctly escaping commas and quotes. (26 Nov 2015)
  • The 'Show All' connector settings (on the My Settings tab) should no longer show empty values. (26 Nov 2015)
  • Minor fix to startup code which logs errors instantiating connectors. (24 Nov 2015)

Adobe Analytics (Omniture) Connector

  • Minor refactoring of web exception handling. (07 Dec 2015)

Amazon S3 Connector

  • Added paging to ListObjects table. (25 Nov 2015)

Blue Yonder Connector

  • Minor internal note renaming. (13 Feb 2016)
  • Minor update so that there is now a maximum of 3 concurrent requests across all instances of the connector. (01 Dec 2015)

Box Connector

  • Updated EnterpriseEvents table in line with Box API updates. (17 Feb 2016)

Dropbox Connector (v2)

  • Updated to use V2 Dropbox API for all tables. (10 Feb 2016)

Facebook Fan Pages & Groups Connector (v2)

  • This has now been tagged as deprecated as we have started work on a new V3 of this Connector. There is no intention to remove this connector in the next 6 months, tagging as deprecated at this stage is primarily intended to encourage any new users of the product to start with the new V3 of the Connector. (04 Feb 2016)
  • Added more helpful error message when connector not authenticated. (07 Jan 2016)
  • Minor refactoring of web exception handling. (07 Dec 2015)

Facebook Fan Pages & Groups Connector (v3)

  • Added 'status' column to User, Page and UserOrPage tables. If the table runs successfully this column will contain the string 'OK', otherwise it will contain the error message. (13 Feb 2016)
  • Removed maxPerRequest param. (09 Feb 2016)
  • Added first version of UserOrPage table. (09 Feb 2016)
  • Internal refactoring and caching enhancemenents. (09 Feb 2016)
  • Added caching for Type table. (09 Feb 2016)
  • Pictures should now be rendered in table in Web Edition (if enabled in settings). (08 Feb 2016)
  • Added Type table. (31 Jan 2016)
  • Added more helpful error message when connector not authenticated. (07 Jan 2016)
  • Initial release of V3. (18 Dec 2015)

Facebook Insights Connector (v3)

  • Minor internal refactoring/performance improvements (for Web Edition). (20 Feb 2016)
  • Removed dependency on Microsoft.VisualBasic assembly on startup. (02 Feb 2016)
  • Added more helpful error message when connector not authenticated. (07 Jan 2016)
  • Upgraded to version 2.5 of the Facebook Graph API. (17 Dec 2015)
  • Minor refactoring of web exception handling. (07 Dec 2015)
  • Updated Page ID drop down to show "global_brand_page_name (id)" in dropdown rather than just "name" (which is not always unique). (03 Dec 2015)
  • Web Edition now shows page picker dropdown. (03 Dec 2015)

File Transfer Connector (FTP/SFTP)

FreeAgent Connector (v2)

  • Minor refactoring of web exception handling. (07 Dec 2015)

Google AdWords Connector (v2)

  • Minor internal refactoring. (07 Feb 2016)
  • Upgraded to v201601 of the API. See https://developers.google.com/adwords/api/docs/reference/#v201601 for notes on relevant updates to reporting. (03 Feb 2016)
  • Added extra note to Report tables about looking up territory names from numerical IDs. (16 Dec 2015)
  • Minor refactoring of web exception handling. (07 Dec 2015)

Google BigQuery Connector

  • Default timeout increased to 30 minutes. (22 Feb 2016)
  • Added TableSchemaAsXml table. (22 Feb 2016)

Google DoubleClick For Advertisers (DFA) Connector

Google DoubleClick for Publishers (DFP) Connector

Google Prediction Connector

  • Minor internal refactoring. (15 Feb 2016)
  • Removed dependency on Microsoft.VisualBasic assembly. (02 Feb 2016)

Google Webmaster Tools Connector

  • Fixed encoding of siteUrl by targeting .NET4.5 and removing previous workaround that did not work for https sites. (12 Feb 2016)

Helper Connector

  • Added a Tokens File input parameter to the ReplaceTokensInFile table which allows you to also specify a list of tokens and replacement values in a separate file (which could, for example, be created using the Qlik store (txt) command). (22 Dec 2015)
  • Added ReplaceTokensInFile table. (15 Dec 2015)

Instagram Connector

  • User Name is now required for UserSearch table. (11 Feb 2016)

Klout Connector (v2)

  • Internal refactoring and performance improvements (minor). (01 Dec 2015)
  • Table names are now case sensitive (as with most connectors). (01 Dec 2015)
  • Minor refactoring of web exception handling. (01 Dec 2015)
  • Removed old table name mappings (from 2012 version of Connector). (01 Dec 2015)

MailBox Connector (IMAP/POP3)

  • Mail IDs used in cache keys are now hashed. (16 Feb 2016)
  • html columns are now rendered as encoded html when running in Web Edition UI (previously the html was rendered inside the data table preview). (29 Jan 2016)
  • Added additional notes to the Username and Password parameters to explain that these can be deleted from the generated URL to have the values stored in settings to be picked up by default instead. (29 Jan 2016)
  • Added seen and flags columns to the ImapMessagesInFolder table. (04 Jan 2016)
  • Added a new checkbox input parameter 'Allow Self Signed Client Certificate'. You might wish to check this if you are receiving an 'The remote certificate is invalid according to the validation procedure' error or other certificate related error as long as you are sure you are connecting with the correct server. (08 Dec 2015)

MailChimp Connector (v2)

  • BREAKING CHANGE: The API Key input parameter is now set to be encrypted. If you are using this connector you should regenerate a load request and copy the value of the newly updated/encrypted APIKey= parameter to your load URLs. Alternatively, if you simply remove this parameter from your load URLs the value stored in settings will be used. Note that you can also use the Encrypt table in the Hepler Connector to create the encrypted value on the fly. (13 Feb 2016)

MongoDB Connector (v2)

  • Please note that as a new official BI Connector (https://docs.mongodb.org/manual/products/bi-connector/) is now available for MongoDB 3.2 and later you may wish to first consider this. Because of this we are also now considering retiring this connector if it does not offer any advantages over this. (10 Dec 2015)
  • Upgraded to MongoDB Driver 1.11.0. This should now support version 3.0 of MongoDB. (10 Dec 2015)
  • Fixed bug where if 'Max Number Of Rows' input parameter was set, the connector would still first inspect all documents in collection to establish column structure for table, now it will only inspect the first 'Max Number Of Rows' documents. (10 Dec 2015)

MS CRM Connector

  • Added API call logging. (26 Feb 2016)
  • Improved progress feedback (including total count) and cancellability of running table. (26 Feb 2016)
  • BREAKING CHANGE: The connection string input parameter is now set to be encrypted. If you are using this connector you should regenerate a load request and copy the value of the newly updated/encrypted connectionString= parameter to your load URLs. Alternatively, if you simply remove this parameter from your load URLs the value stored in settings will be used. Note that you can also use the Encrypt table in the Hepler Connector to create the encrypted value on the fly. (12 Feb 2016)
  • Input parameter "Check All Data For Columns" set as optional now. (02 Feb 2016)
  • Minor refactoring. (27 Jan 2016)
  • Added new input parameter "Check All Data For Columns". Previously, if certain columns did not appear in the first 5000 rows of data they would not be included in the results at all. Checking this new option causes the connector to analyse all pages of results before building the columns which fixes this issue. However, it does mean that all of the data has to be loaded into memory in one go rather than streaming the data in oages of up to 5000 results at a time (which is the behaviour if this new option is not checked). (27 Jan 2016)
  • Minor refactoring. (09 Dec 2015)
  • CanAuthenticate table now gives hint to try https instead of http if the connection throws a null reference exception and URL=http://... is being used rather than URL=https://.... (09 Dec 2015)

Notification Connector

  • Minor internal code refactoring. (17 Dec 2015)

OData Connector (V2)

  • Added optional auth header. (23 Feb 2016)
  • Updated auth parameters to be included in the generated load URL by default. If you delete the parameter values from the generated load URL it will fall back to the value stored in settings. (23 Feb 2016)
  • Added additional info about request URL to warn log entry in the case of XML needing to be sanitised before loading. (23 Feb 2016)
  • Connector now attempts to sanitise XML before loading following a bug report where one OData source included invalid content in XML. (05 Feb 2016)
  • Fix CleanupUrl bug when using file paths. (29 Jan 2016)
  • Removed optional paging type parameter as it is not being used. (30 Nov 2015)

Office 365 Sharepoint Connector

  • Added SubSites table. (25 Feb 2016)
  • Added Sub Site Path parameter to ListResources table. (25 Feb 2016)
  • Added GetData table. (25 Feb 2016)
  • Initial release. (08 Feb 2016)

OneDrive Connector

  • Minor update to improve efficiency for Drives and Items tables. (08 Feb 2016)

SugarCRM Connector

  • Minor refactoring of web exception handling. (08 Dec 2015)
  • Fixed bug where request would hang in certain circumstances for CustomRequest table. (08 Dec 2015)

SurveyMonkey Connector

  • Added other available columns to GetRespondentList table. (22 Feb 2016)
  • Added custom_id column to GetRespondentList table. (12 Jan 2016)
  • Added date_start and date_modified columns to GetRespondentList table. (07 Jan 2016)
  • Connector should now use app wide proxy settings. (16 Dec 2015)

Sentiment Analysis & Text Analytics Connector (v2)

  • Fix to Repustate SentimentChunked table. (13 Feb 2016)
  • BREAKING CHANGES: The embedded API key for AlchemyAPI which was included in previous versions has now been removed. (26 Nov 2015)
  • Minor refactoring of web exception handling. (26 Nov 2015)

Twitter Connector (v2)

  • Fixed bug in Followers table where it made unnecessary API requests and used up all of current quota unnecessarily. (15 Feb 2016)
  • Fixed issue in RateLimit table where _x002F_ was shown in data instead of / character. (08 Feb 2016)
  • Minor internal refactoring. (01 Dec 2015)
  • Fixed issue where Post_XXXX tables would error in web edition. (01 Dec 2015)

Web Connector for General JSON/XML/SOAP APIs (v2)

  • Some parameters no longer unnecessarily appear in the generated URL if they have their default values. (14 Feb 2016)
  • Fixed bug with Encrypt URL input parameter not working in Web Edition. (14 Feb 2016)
  • POSSIBLE BREAKING CHANGE: Removed support for using cleanXML parameter in request URL (see earlier in change log) as this has now been superceded by removeInvalidChars parameter which should be used instead. (04 Feb 2016)
  • Removed 'Remove Invalid Characters' input parameter from JsonToTable and RawXmlToTable tables. (04 Feb 2016)
  • Added code to sanitise XML before processing in the case it might contain invalid characters. (04 Feb 2016)
  • POTENTIALLY BREAKING CHANGE: We had some custom code to replace certain special characters which are valid JSON but invalid XML with safe values for XML. We have now removed this code and internally use some system level .NET code which should account for all potential invalid values but now uses different replacements. These replaced values might ultimately end up being table column names depending on whether you are using a connector table which provides raw XML or a structured table and you may need to adjust your scripts accordingly according to the following. This is actually a QVSource wide change but the most likely place it will impact is in certain specialist uses of the General Web Connector. (22 Jan 2016)
  • Added feature allowing @file=drive:\path\to\file.txt for the POST parameter value so that the connector will pick up the text from here instead of the parameter value itself. This is because occasionally (particularly for SOAP requests) the URL generated to QVSource can be very long and exceed the length supported by QlikView or Qlik Sense. (14 Dec 2015)
  • Last request time (for the minimum time between requests feature) is now stored in settings rather than in memory against connector instance (which fixes compatibility for new web edition). (30 Nov 2015)

Yahoo! Placemaker Connector

  • Minor refactoring of web exception handling. (07 Dec 2015)

YouTube Analytics Connector

  • Added quotaUser parameter to Report and MyChannels tables which helps enforce per user quota limits. (16 Dec 2015)

YouTube Connector (v3)

  • Fixed empty table bug when there are 0 results. (15 Dec 2015)
  • Fixed VideoStatistics API error when using more than 50 video ids. (07 Dec 2015)
  • Fixed ChannelStatistics API error when using more than 50 channel ids. (07 Dec 2015)
  • Return early if no nodes found or all nodes found (in a single API request) are duplicates. (07 Dec 2015)
  • Added optional status info to VideoStatistics table. (02 Dec 2015)
  • Update quota info for VideoStatistics table. (02 Dec 2015)

Download Latest

Where do I find this new release? If you are a QVSource customer or have requested a trial in the past you should see this new release in the personalised download link we should have sent you via email.

If you are new to QVSource you can download a fully functional free trial from our website. As noted above though, we would strongly recommend you use the new Web Edition download (which contains the above updates also).

Page List