Teradata announced a uniquely open and connected approach to supporting open table formats (OTFs) Apache Iceberg and Linux Foundation Delta Lake, embracing the industry pivot toward open-source technologies and offering unparalleled customer choice in data management. This move adds a forward-looking dimension to Teradata VantageCloud Lake, Teradata's next-generation, cloud-native analytics and data platform for AI, as well as Teradata AI Unlimited, an on-demand and cloud-native AI/ML engine - which will move to public preview on both AWS and Azure Marketplaces beginning in second quarter 2024. Teradata?s fully open and connected approach is designed to be future-ready and allow enterprises to employ a modern data strategy with unmatched agility and flexibility for executing Trusted AI at scale.

Teradata's platform, the industry's most open, offers first-party services for Apache Iceberg and Linux Foundation DeltaLake OTFs with full support for cross-read and cross-write data stored in multiple OTFs. This interoperability extends to AWS Glue, Unity, and Apache Hive catalogs and works in multi-cloud and multi-data lake environments, which is designed to deliver a connected, harmonized data experience to Teradata customers without the need to move or transform data. AI adoption has driven a rapid consolidation of data warehouses, analytics, and data science workloads into unified lakehouses.

OTF support further enhances Teradata?s lakehouse capabilities, providing a storage abstraction layer that?s designed to be flexible, cost-efficient, and easy-to-use. Users can leverage AI Unlimited and other analytical engines against their own datasets, in their own cloud object stores ? enabling them to take an agile, best-of-breed approach without the challenge and expense of moving data.

Secure, shared access to large datasets enables Teradata customers to build data pipelines, score and train models, improve analytics and decision-making, and much more. AI datasets are one of the most common ways organizations are using OTFs now, so it?s critical that platforms meant to accelerate AI use cases, like Teradata AI Unlimited, support this data format. Teradata AI Unlimited is an on-demand and cloud-native AI/ML engine that?s fully open and connected ?

now with support for OTFs ? which is intended to make AI innovation faster, easier, and more cost-effective. Soon-to-be-available in public preview on AWS and Azure Marketplaces, AI Unlimited allows data scientists, data engineers, and developers to explore, experiment, and operationalize AI projects at scale.

Teradata AI Unlimited is designed to provide high-performance compute, massive parallel processing, and the advanced in-engine analytics required to execute and operationalize AI workloads. AWS SageMaker and Azure Machine Learning can be integrated into AI Unlimited workloads, and Azure OpenAI Services provide large language models (LLMs) that can be used to develop generative AI applications. Best of all, work prototyped in AI Unlimited can be smoothly promoted to production in VantageCloud, which Teradata believes will provide quick and substantial value to enterprises.

AI Unlimited also includes the robust capabilities of Teradata?s ClearScape Analytics, which is designed to provide organizations the transparency, explainability, and repeatability needed for Trusted AI. OTFs and AI Unlimited can reduce the cost and complexity of AI workloads by minimizing data storage costs, as well as the need for data movement or replication. Teradata has also added new integrations with third-party tools ?

Airbyte Cloud, Apache Airflow, and dbt (data build tool) ? a part of the modern data stack. These integrations are intended to accelerate the building of data pipelines, increase productivity by freeing data engineers from repetitive work, and drive profitable growth.

Airbyte Cloud: Streamline data ingestion into VantageCloud with a fully managed and hosted service that eliminates the need for time consuming infrastructure setup and management. Apache Airflow: Programmatically author, schedule, and monitor workflows. dbt (data build tool): Manages the T in ELT (Extract Load Transform) and is a commonly used tool for data transformation in databases, data lakes, and data warehouses.

OTF support will be available for VantageCloud Lake and AI Unlimited on AWS and Azure in June 2024. AI Unlimited is available for purchase in second quarter, as a public preview, on the AWS and Azure Marketplaces. Integrations with Airbyte Cloud, Apache Airflow, and dbt are available now.