The Varigence Blog
Are You Building an Asset or Renting a Liability?
BimlFlex enables a hybrid of OpEx and CapEx models that enables the best of both
Implementing Row Condensing in BimlFlex
Implementing row condensing to only capture actual data changes during Persistent Staging and Data Vault loads.
How to Perform an Unattended Install of BimlFlex
How to perform a silent, unattended BimlFlex installation using a batch file for consistent and efficient deployment across multiple machines.
Introduction to Databricks Solutions with BimlFlex Data Automation
In the "Introduction to Databricks and BimlFlex Integration" session, attendees learn how to integrate Databricks with BimlFlex using a practical example. The presentation covers establishing connections to diverse data sources, efficient data storage using landing and persistent connections, and delves into advanced configurations within Databricks. The session also emphasizes building Databricks notebooks, optimizing Azure Data Factory pipelines, and managing data storage, staging, and archiving. Moreover, a detailed look into the Azure Data Factory instance highlights the significance of storing artifacts and scripts in GitHub for streamlined deployment.
BimlFlex: The Power of Modular Data Integration and Automation
BimlFlex ensures that businesses can tailor their data solutions precisely to their needs, ensuring efficiency and adaptability in an ever-evolving digital landscape
The Top Five Challenges of Data Lakes and how to overcome them with a Data Lakehouse
BimlFlex's next version will include Databricks automation support, extending to all data pipeline layers, and has received positive feedback from customers. This development can save time and costs, improve data quality, and provide robust data insights for businesses. An upcoming blog post will provide instructions on configuring and implementing a fully automated Databricks solution.