edgepedia

Artificial intelligence and data

3,135 articles

General

Database design

Database design is the process of organizing data into tables, keys, constraints, and relationships, split into logical design, independent of software, and physical design, which decides storage on hardware.

General

Database Directive

The Database Directive (Directive 96/9/EC) is 1996 European Union legislation protecting databases on two layers: copyright for original selection or arrangement, and a sui generis right for substantial investment.

General

Database index

A database index is a data structure that lets a database find specific rows much faster than scanning the table, at the cost of extra storage and slower writes.

General

Database Internals

Database Internals (A Deep-Dive into How Distributed Data Systems Work) is Alex Petrov's 2019 O'Reilly book, 370 pages in two parts on storage engines and distributed systems, covering B-Trees, LSM-Trees, the RUM Conjecture, and consensus.

General

Database Management Systems

A database management system (DBMS) is software that stores, retrieves, and manages data in databases. Relational systems, based on Edgar F. Codd's 1970 model, hold data in tables.

General

Database model

A database model is a formal way of specifying how data is structured, related, and constrained in a database; widely used models include relational, hierarchical, and graph models.

General

Database normalization

Database normalization, introduced by Edgar F. Codd in 1970, structures relational databases into tables by normal forms such as 1NF, 2NF, and 3NF to reduce redundancy and update anomalies.

General

Database right

The database right is a European property right protecting the contents of databases made with substantial investment, created by Directive 96/9/EC in 1996 and lasting 15 years.

General

Database schema

A database schema is the overall design of a database, declaring its tables, columns, types, keys, and constraints; the schema changes rarely, while the data it holds changes continuously.

General

Database security

Database security is the set of tools and controls that preserve the confidentiality, integrity, and availability of data in a database, its DBMS, and related applications and infrastructure.

General

Database transaction

A database transaction is a logical unit of work against a database that either commits entirely or is fully rolled back, so it never leaves the database half-applied.

General

Database trigger

A database trigger, or SQL trigger, is a stored program a database executes automatically when an event such as an INSERT, UPDATE, or DELETE occurs on a table.

General

Databend

Databend (formerly FuseQuery/Datafuse) is an open-source cloud-native data warehouse written in Rust, fully based on object storage, with Snowflake-compatible SQL, vector and full-text search, time travel, and an Apache 2.0 core with Elastic License 2.0 enterprise features.

General

Databricks Agent Bricks

Databricks Agent Bricks is Databricks' agent developer platform, launched in beta June 11, 2025, that builds auto-optimized enterprise AI agents from task descriptions, with Unity Catalog governance, Lakebase-backed memory, MLflow tracing, and CLI deployment.

General

Databricks Lakeflow

Databricks Lakeflow is Databricks' unified data engineering solution for ingestion, transformation, and orchestration, comprising Lakeflow Connect, Lakeflow pipelines (built on Spark Declarative Pipelines, formerly DLT), Lakeflow Designer, and Lakeflow Jobs, governed by Unity Catalog and generally available since June 2025.

General

Dataflow model

The Dataflow model (Beam model) is Google's unified batch and streaming data processing model from the 2015 VLDB paper by Akidau et al., using windowing, watermarks, and triggers to trade off correctness, latency, and cost; open-sourced as Apache Beam in 2016.

General

Datafold

Datafold is a US data engineering automation company founded in 2020 by Gleb Mezhanskiy (YC S20), known for Data Diff value-level diffing, CI/CD data testing, and AI data migration tooling.

General

Dataform (software)

Dataform is a Google Cloud managed service for developing, testing, version controlling, and scheduling SQLX data transformation workflows in BigQuery. Founded in London in 2017, YC Winter 2018, acquired by Google in December 2020; GA June 2023. Open-source core plus CLI; BigQuery-only managed service.

General

DataHub

DataHub (datahub-project) is an open-source metadata platform and data catalog for discovery, governance, and lineage, created at LinkedIn as WhereHows' successor, open-sourced in 2020, and commercialized by Acryl Data's DataHub Cloud.

General

Dataiku

Dataiku is a software company founded in 2013 and headquartered in New York, whose Dataiku DSS platform provides data preparation, machine learning, MLOps, and AI governance for enterprises.

General

DataOps

DataOps (data operations) is a collaborative data management practice applying DevOps, Agile, and statistical process control to data pipelines; distinguished from MLOps (model lifecycle) and DevOps (software) by its focus on data delivery, testing, and orchestration.

General

Dataset distillation

Dataset distillation is a machine learning technique that synthesizes a small synthetic dataset from a larger one, so models trained on it approximate full-data performance. Introduced in 2018.

General

Datasheets for Datasets

Datasheets for Datasets: Gebru et al.'s 2018 framework (CACM 2021) giving every ML dataset a structured 57-question document covering motivation, composition, collection, uses, and maintenance; complements model cards.

General

DataStax

DataStax is an American data platform company, founded in 2010 in Santa Clara, California, known for commercial products built on Apache Cassandra, including Astra DB and Langflow.

General

David 8

David 8 is a fictional android portrayed by Michael Fassbender in Ridley Scott's Alien prequel films Prometheus (2012) and Alien: Covenant (2017), created by Peter Weyland.

General

DBeaver

DBeaver is a free, Java-based database tool and SQL client for developers, administrators, and analysts, supporting any database with a JDBC or ODBC driver; a free Community edition and paid PRO editions are available.

General

DBSCAN

DBSCAN (Density-Based Spatial Clustering of Applications with Noise) is a density-based clustering algorithm that finds clusters of arbitrary shape and labels points in low-density regions as noise.

General

DbSNP

DbSNP, the Database of Single Nucleotide Polymorphisms, is a public archive maintained by NCBI since 1999 that catalogs SNPs and other short genetic variations, each with a stable rs identifier.

General

dbt (software)

dbt, originally the data build tool, is a SQL transformation framework with an Apache 2.0 open-source core (dbt OSS, formerly dbt Core), launched in 2016 by Fishtown Analytics (now dbt Labs, merged with Fivetran in 2026) that builds DAGs of warehouse models, tests, and docs; its Rust-based v2 ships as dbt and the Apache 2.0 dbt OSS.

General

dbt Labs

dbt Labs, a Philadelphia company founded in 2016 as Fishtown Analytics, develops dbt, a SQL transformation framework with an Apache 2.0 open-source core (dbt OSS, formerly dbt Core), and the dbt platform (formerly dbt Cloud); valued at $4.2B in 2022 with $100M ARR, it merged with Fivetran in June 2026.