I have written a few times in recent months about vendors offering functionality that addresses data orchestration. This is a concept that has been growing in popularity in the past five years amid the rise of Data Operations (DataOps), which describes more agile approaches to data integration and data management. In a nutshell, data orchestration is the process of combining data from multiple operational data sources and preparing and transforming it for analysis. To those unfamiliar with the...
Read More
Topics:
Data Management,
Data,
data operations,
Analytics & Data,
AI and Machine Learning
Ventana Research’s Data Lakes Dynamics Insights research illustrates that while data lakes are fulfilling their promise of enabling organizations to economically store and process large volumes of raw data, data lake environments continue to evolve. Data lakes were initially based primarily on Apache Hadoop deployed on-premises but are now increasingly based on cloud object storage. Adopters are also shifting from data lakes based on homegrown scripts and code to open standards and open...
Read More
Topics:
Business Intelligence,
Data Governance,
Data Management,
Data,
data operations,
Analytics & Data,
Streaming Data & Events,
operational data platforms,
Analytic Data Platforms,
AI and Machine Learning
I have recently written about the organizational and cultural aspects of being data-driven, and the potential advantages data-driven organizations stand to gain by responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. I have also explained that data-driven processes require more agile, continuous data processing, with an increased focus on extract, load and transform processes — as well as change data capture and automation...
Read More
Topics:
Cloud Computing,
Data Management,
Data,
data operations,
Analytics & Data
Organizations are collecting data from multiple data sources and a variety of systems to enrich their analytics and business intelligence (BI). But collecting data is only half of the equation. As the data grows, it becomes challenging to find the right data at the right time. Many organizations can’t take full advantage of their data lakes because they don’t know what data actually exists. Also, there are more regulations and compliance requirements than ever before. It is critical for...
Read More
Topics:
Business Intelligence,
Data Governance,
Data Management,
data operations,
AI and Machine Learning
The data catalog has become an integral component of organizational data strategies over the past decade, serving as a conduit for good data governance and facilitating self-service analytics initiatives. The data catalog has become so important, in fact, that it is easy to forget that just 10 years ago it did not exist in terms of a standalone product category. Metadata-based data management functionality has had a role to play within products for data governance and business intelligence for...
Read More
Topics:
business intelligence,
Data Governance,
Data Management,
Data,
data operations,
Analytics & Data
I have recently written about the importance of healthy data pipelines to ensure data is integrated and processed in the sequence required to generate business intelligence, and the need for data pipelines to be agile in the context of real-time data processing requirements. Data engineers, who are responsible for monitoring, managing and maintaining data pipelines, are under increasing pressure to deliver high-performance and flexible data integration and processing pipelines that are capable...
Read More
Topics:
Big Data,
Cloud Computing,
Data Management,
Data,
data operations
When joining Ventana Research, I noted that the need to be more data-driven has become a mantra among large and small organizations alike. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. Being data-driven is clearly something to aspire to. However, it is also a somewhat vague concept without clear definition. We know data-driven organizations when we see them...
Read More
Topics:
embedded analytics,
Analytics,
Business Intelligence,
Data Governance,
Data Integration,
Data,
Digital Technology,
natural language processing,
data lakes,
data operations,
Digital Business,
Streaming Analytics,
data platforms,
Analytics & Data,
Streaming Data & Events,
AI and Machine Learning
Organizations are continuously increasing the use of analytics and business intelligence to turn data into meaningful and actionable insights. Our Analytics and Data Benchmark Research shows some of the benefits of using analytics: Improved efficiency in business processes, improved communication and gaining a competitive edge in the market top the list. With a unified BI system, organizations can have a comprehensive view of all organizational data to better manage processes and identify...
Read More
Topics:
business intelligence,
embedded analytics,
Data Governance,
Data Management,
natural language processing,
data operations,
Streaming Analytics,
operational data platforms,
AI and Machine Learning
I previously described the concept of hydroanalytic data platforms, which combine the structured data processing and analytics acceleration capabilities associated with data warehousing with the low-cost and multi-structured data storage advantages of the data lake. One of the key enablers of this approach is interactive SQL query engine functionality, which facilitates the use of existing business intelligence (BI) and data science tools to analyze data in data lakes. Interactive SQL query...
Read More
Topics:
Analytics,
Business Intelligence,
Cloud Computing,
Data,
Digital Technology,
data lakes,
data operations,
data platforms,
Analytics & Data,
AI and Machine Learning
I’ve never been a fan of talking about semantic models because most of the workforce probably doesn’t understand what they are, or doesn’t recognize them by name. But the findings in our recent Analytics and Data Benchmark Research have changed my mind. The research shows how important a semantic model can be to the success of data and analytics processes. Organizations that have successfully implemented a semantic model are more than twice as likely to report satisfaction with analytics (77%)...
Read More
Topics:
Business Intelligence,
Data Management,
data operations,
Analytics & Data,
semantic model,
AI and Machine Learning