Data Integration

Data Integration: The Connective Tissue of Business

Actian Corporation

December 7, 2018

data integration with Actian

People, products, processes and systems may come and go, but, regardless, of the structural components of your business, data is the one thing that brings all the pieces together, so you can perform as a cohesive unit.

There is no question modern businesses are evolving quickly. Market opportunities are short-lived, technology advancements are happening at a startling pace and customer preferences are constantly shifting –requiring companies to become more agile in how they identify and respond to both opportunities and threats.

Business strategies, supply-chain relationships, organizational structures and business processes must all be nimble to adapt to whatever changes the company encounters.

Modern Businesses Need Agility to Survive

With all this change occurring, it isn’t surprising most companies and employees experience what seems like endless churn. People and processes that were critical yesterday are not needed tomorrow. IT systems enter and exit the company’s technology environment like a revolving door. Supplier and partner relationships continuously change, with new players appearing and others disappearing almost daily.

With all this churn, it raises the question: “How can I match the pace of change?” Companies must constantly change and adapt to survive in the age of digital disruption. They must integrate diverse sources of data, ever-growing volume, and velocity and veracity of data types. New data sources are emerging from on-premises applications, cloud and IoT, and companies need to access this data.

Agility in connecting to diverse data sources and integrating them so you can transform, manage and syndicate data to everyone who needs it is essential.

If Data is the New Oil, Then Integration is the Pipeline That Will Deliver it

It was once thought data existed to support people and processes and as an artifact of IT systems. This understanding was backward – data is the “thing” that makes companies run. People, processes and systems play the supporting role –creating, changing, merging, analyzing, moving and transforming data.

Data is the object or asset, the rest are the tools to help data flow throughout the company, so decisions can be made, products can be produced and company goals can be achieved. Think of it like cars on a highway supporting the goal of helping people travel from their various starting points to their desired destinations. The starting and ending points may change, a bridge or a stoplight may be replaced with something else, but what doesn’t change is a bunch of people on the move.

Data is what fuels your company growth and integration is what connects all the parts of your company.

How Data Can Help You Manage Change

The operational data your company produces (every second of every day) contains a wealth of information about what changes are occurring both within your business and in the environment where you operate. This information can give you insights into how you may need to adapt to take advantage of opportunities and protect your company from threats.

People, process and systems are constantly changing anyway (or so it seems) – data can help you direct this change in structured and impactful ways. Some of this data is sourced from inside your company through your day-to-day operations while other data is gathered from your environment.

The Need for a “Universal Connectivity Platform” to Connect Anything, Anywhere and Anytime

With the great diversity of IT systems your company operates directly, accesses through cloud providers, or connect to as part of the broader business ecosystem (partners, suppliers, customers, governments, banks, etc.), it can be difficult to manage all of the pieces that are coming and going to ensure your employees and leaders have access to all the data they need to do their jobs. That’s why Actian developed the DataConnect integration solution.

DataConnect is that Universal Connect™ platform that empowers anyone to integrate anything, anywhere and anytime. On-premise software, cloud services, partner systems, IoT devices and other data sources can be connected to reporting, analytics and decision-support systems, enabling seamless sharing of data across your company.

As your business evolves to match the dynamic needs of the marketplace, old systems can be removed, new systems can be added and business processes and supplier relationships can change, but your data will remain, to help you understand where you’ve been, where you are now and where you must move during the future.

Actian is the industry leader in hybrid data management, integration and analytics.

These solutions enable you to manage seamlessly and connect your operational and analytics data for superior performance, insights and business outcomes. Actian DataConnect is the universal connection platform that can help you manage your data – the connective tissue of your business, so you are better prepared to respond to the changes ahead. To learn more, visit www.actian.com.

 

actian avatar logo

About Actian Corporation

Actian empowers enterprises to confidently manage and govern data at scale, streamlining complex data environments and accelerating the delivery of AI-ready data. The Actian data intelligence approach combines data discovery, metadata management, and federated governance to enable smarter data usage and enhance compliance. With intuitive self-service capabilities, business and technical users can find, understand, and trust data assets across cloud, hybrid, and on-premises environments. Actian delivers flexible data management solutions to 42 million users at Fortune 100 companies and other enterprises worldwide, while maintaining a 95% customer satisfaction score.
Data Integration

What’s New in Actian DataFlow Version 6.6.1?

Actian Corporation

November 26, 2018

Actian logo

Actian DataFlow is a parallel workflow platform for end-to-end data access, transformation, preparation, and predictive analysis that eliminates performance bottlenecks in your data-intensive applications. Complimentary to the Actian Vector analytic database, DataFlow leverages concurrency, parallelism, and pipelining to accelerate data movement between locations in your data architecture, creating faster results. DataFlow eliminates memory constraints, as well as the need for data movement into specific data stores before analytics are run. DataFlow understands the available resources before breaking up the execution into smaller chunks that can be run in parallel to take maximum advantage of horizontal and vertical scaling.

DataFlow combines the KNIME (open source data mining platform) drag-and-drop visual workflow environment with the underlying Actian DataFlow platform to provide greater control over the entire process of reading the data, performing the transformation and analytic functions, and writing the results.

What’s new in version 6.6.1?

This update to DataFlow certifies new releases of the most popular Hadoop distributions from Apache, Cloudera, Hortonworks, and MapR, as well as improves parallel load features with the most recent releases of Vector for Linux, Windows, and Hadoop. There is also support for five new data types with DataFlow to handle a larger variety of data formats.  Here is the specific list:

  • Added support for Apache Hadoop 3.0.1+.
  • Added support for MapR 6.0.1.
  • Verified Support for MapR 5.2.2.
  • Updated support for Hortonworks HDP 2.6.
  • Updated support for Cloudera CDH 5.15.
  • Updated direct vector loader to work with latest Vector & VectorH (5.0 & 5.1).
  • Added support for 5 new base types: Money, ip4, ip6, uuid, and Intervals (Periods and Durations).
  • Added support for latest AWS authentication library (1.11 previously 1.3).
  • Added support for logical paths in Hadoop.

DataFlow Results:

For data preparation, data onboarding, and ETL use cases, DataFlow can accelerate the process by factors of 20X or more. For one customer who previously required 17 hours to prepare and cleanse data to onboard new customers, DataFlow reduced the time to 43 minutes, almost 24 times faster. Another customer used DataFlow to parallelize and pipeline their data transfer process to reduce their claims processing times from more than 30 hours to just 20 minutes, which is 90 times faster. In a third example DataFlow demonstrated that it could load 500,000 records into an Oracle database in seven seconds, versus a previous runtime of more than 3 minutes. Contact results@actian.com if you are interested in seeing a demonstration.

actian avatar logo

About Actian Corporation

Actian empowers enterprises to confidently manage and govern data at scale, streamlining complex data environments and accelerating the delivery of AI-ready data. The Actian data intelligence approach combines data discovery, metadata management, and federated governance to enable smarter data usage and enhance compliance. With intuitive self-service capabilities, business and technical users can find, understand, and trust data assets across cloud, hybrid, and on-premises environments. Actian delivers flexible data management solutions to 42 million users at Fortune 100 companies and other enterprises worldwide, while maintaining a 95% customer satisfaction score.
Data Architecture

What is an Operational Data Warehouse? Why Does it Matter?

Actian Corporation

October 23, 2018

the next big thing

Data warehouses have been around for decades, and have established themselves as reliable reporting systems with consistent value. They have also evolved into data marts, specialized appliances, and EDW variants to meet emerging needs, but all of these solutions have their drawbacks when it comes to meeting today’s business demands. Some of the common pitfalls to avoid include stale data, slow query performance, long development cycles, and high costs associated with these variants. There is a better approach. An operational data warehouse (ODW) addresses the need for operational data analytics with the characteristics listed below, without any of the pitfalls:

1. Current:
As the demands for organizations to operate in real-time or in the moment increase, data warehouses need to deliver ever more current data. SQL Hadoop databases commonly fail to handle continuous streams of updates as the file system is optimized for infrequent batch updates, with a moving window of historical data. Lack of current data can mean businesses fail to respond to threats and opportunities fast enough to stay competitive.

2. Fast:
Built on an underlying architecture optimized for analytic query performance, requiring little or no tuning in anticipation of certain workloads (like indexing or aggregations), maximizing the variety of workloads it can support.

3. Scalable:
Scales to large data capacities with an economical and flexible storage layer, connecting to a variety of existing legacy and new sources of data.

4. Secure:
Offers multiple data protection mechanisms to meet enterprise security requirements and comply with tough regulatory environments.

5. Flexible:
Offers flexible deployment options, on-premises and multi-cloud options.

6. Robust:
Delivers enterprise-level resiliency and manageability.

Such an ODW solution provides a database system that can deliver near-real-time insights for ad hoc self-service data discovery and analytics using the most current operational data storage.

actian avatar logo

About Actian Corporation

Actian empowers enterprises to confidently manage and govern data at scale, streamlining complex data environments and accelerating the delivery of AI-ready data. The Actian data intelligence approach combines data discovery, metadata management, and federated governance to enable smarter data usage and enhance compliance. With intuitive self-service capabilities, business and technical users can find, understand, and trust data assets across cloud, hybrid, and on-premises environments. Actian delivers flexible data management solutions to 42 million users at Fortune 100 companies and other enterprises worldwide, while maintaining a 95% customer satisfaction score.