In keeping the theme with my previous blog I thought I would put together a quick blog detailing some of the more useful features of the Attunity connectors.
1. Support For expressions. Initially, when using the components I thought that the Attunity connectors did not support Expressions, however I was mistaken. The components do support expressions, but you set these on the dataflow properties rather than against the component. To do this, you need to right-click on the empty black background of the data flow and edit the properties. You will see that there are a set of properties which can be set using expressions.
2. If the component is running slowly you should make sure you are running the drivers in 64-bit mode (when running from VS it will always be 32-bit). To do this you need to make sure that you have installed the 64-bit version of the connector (this installs the 32-bit version automatically). If you find that when you deploy packages to the SSIS catalog and run them they fail, however they work when running from Visual Studio this may point to an issue with the installation of the connectors.
3. If you are running in 64-bit mode and you need to further increase the speed of the your ETL it is well worth checking the Batch Size option. Whilst the optimum setting for this depends upon our environment, I generally find that the default setting of 100 very low. I normally start by increasing this to 1000 and then working from there, in some cases I have seen the optimum value for this setting to be greater than 10,000 so results vary, however if loading speed is becoming an issue and this is set to the default value of 100 it is certainly worth investigation.
AI Assistance in Microsoft Fabric
The exponential growth of Large Language Models (LLMs) couples with Microsoft’s close partnership with OpenAI
Apr
10 reasons why it’s worth the effort to understand the value of your data
“If leaders really want to create a data driven culture, the journey starts with them!
Apr
Content Safety in Azure AI Studio
Azure AI Content Safety is a solution designed to identify harmful content, whether generated by
Apr
Model Benchmarks in Azure AI Studio
In the constantly changing field of artificial intelligence (AI) and machine learning (ML), choosing the
Apr
Celebrating International Women’s Day: from Classroom to Code
As we celebrate International Women’s Day, I want to share my journey of breaking stereotypes
Mar
Pretty Power BI – Adding Pagination to Bar Charts
Good User Experience (UX) design is crucial in enabling stakeholders to maximise the insights that
Feb
Pretty Power BI – Creating Dynamic Histograms
Good User Experience (UX) design is crucial in enabling stakeholders to maximise the insights that
Feb
Top Tips to Pass the Databricks Certified Data Engineer Professional Exam
Having recently passed the Databricks Certified Data Engineer Professional exam, this blog post covers some
Jan