edgepedia

All articles starting with D

24,034 articles

Data wrangling

Data wrangling, also known as data munging, is the process of cleaning, structuring, and integrating raw data into a form suitable for analysis before it can support machine learning.

Data-centric AI

Data-centric AI (DCAI) is an AI paradigm, promoted by Andrew Ng from 2021, that improves AI systems by systematically engineering data, holding the model fixed. Key practices include label cleaning, deduplication, and augmentation; studies show gains rivaling model work, especially in healthcare and low-data settings.

Data-constrained scaling laws

Data-constrained scaling laws extend neural language-model scaling laws to treat unique training data as a binding constraint, quantifying how often tokens can be repeated before loss stops improving.

Data-dependent acquisition

Data-dependent acquisition (DDA) is a mass spectrometry acquisition mode that automatically selects and fragments the most abundant ions from each survey scan, the most common mode in shotgun proteomics.

data-diff

data-diff: Datafold's open-source CLI and Python library for value-level row diffing within and across SQL databases (joindiff and hashdiff modes); launched 2022, archived May 2024, continued as Reladiff.

Data-driven reduced-order modeling

Data-driven reduced-order modeling builds low-dimensional computational models of complex systems by learning from simulation or measurement data, treating the full solver as a black box.

Data-flow analysis

Data-flow analysis, also known as global data-flow analysis, is a static analysis technique that propagates facts through a control flow graph to a fixpoint and underlies many compiler optimizations.

Data-flow diagram

A data-flow diagram (DFD), also called a data flow model, is a graphical model showing how data moves through a system, without showing control, sequence, or timing.

Data-independent acquisition

Data-independent acquisition (DIA) is a mass spectrometry method for quantitative proteomics in which the instrument fragments all peptide ions in predefined isolation windows, without selecting precursors in real time.

Data-rate units

Data-rate units quantify how fast digital information moves, defined in IEC 80000-13 as data elements transferred divided by the time interval, with telecommunications using kbit/s, Mbit/s, and Gbit/s.

data.world

data.world: Austin-founded cloud data catalog and governance platform built on a knowledge graph with SPARQL-queryable metadata, Eureka lineage, Archie AI assistant, and the retired Open Data Community; acquired by ServiceNow, closed July 2025.

Database

A database is an organized collection of data managed by software called a database management system (DBMS), underpinning everything from banking records to AI applications.

Database administrator

Database administrator (DBA): IT professional maintaining, securing, and tuning database systems; also called database coordinator or database engineer. Duties include backups, security, performance tuning; US median pay $104,620 (2024).

Database design

Database design is the process of organizing data into tables, keys, constraints, and relationships, split into logical design, independent of software, and physical design, which decides storage on hardware.

Database Directive

The Database Directive (Directive 96/9/EC) is 1996 European Union legislation protecting databases on two layers: copyright for original selection or arrangement, and a sui generis right for substantial investment.

Database index

A database index is a data structure that lets a database find specific rows much faster than scanning the table, at the cost of extra storage and slower writes.

Database Internals

Database Internals (A Deep-Dive into How Distributed Data Systems Work) is Alex Petrov's 2019 O'Reilly book, 370 pages in two parts on storage engines and distributed systems, covering B-Trees, LSM-Trees, the RUM Conjecture, and consensus.

Database Management Systems

A database management system (DBMS) is software that stores, retrieves, and manages data in databases. Relational systems, based on Edgar F. Codd's 1970 model, hold data in tables.

Database model

A database model is a formal way of specifying how data is structured, related, and constrained in a database; widely used models include relational, hierarchical, and graph models.

Database normalization

Database normalization, introduced by Edgar F. Codd in 1970, structures relational databases into tables by normal forms such as 1NF, 2NF, and 3NF to reduce redundancy and update anomalies.

Database right

The database right is a European property right protecting the contents of databases made with substantial investment, created by Directive 96/9/EC in 1996 and lasting 15 years.

Database schema

A database schema is the overall design of a database, declaring its tables, columns, types, keys, and constraints; the schema changes rarely, while the data it holds changes continuously.

Database security

Database security is the set of tools and controls that preserve the confidentiality, integrity, and availability of data in a database, its DBMS, and related applications and infrastructure.

Database transaction

A database transaction is a logical unit of work against a database that either commits entirely or is fully rolled back, so it never leaves the database half-applied.

Database trigger

A database trigger, or SQL trigger, is a stored program a database executes automatically when an event such as an INSERT, UPDATE, or DELETE occurs on a table.

Databend

Databend (formerly FuseQuery/Datafuse) is an open-source cloud-native data warehouse written in Rust, fully based on object storage, with Snowflake-compatible SQL, vector and full-text search, time travel, and an Apache 2.0 core with Elastic License 2.0 enterprise features.

Databricks

Databricks is an American data and AI company founded in 2013 by the creators of Apache Spark, selling a unified cloud platform for data analytics and AI applications.

Databricks Agent Bricks

Databricks Agent Bricks is Databricks' agent developer platform, launched in beta June 11, 2025, that builds auto-optimized enterprise AI agents from task descriptions, with Unity Catalog governance, Lakebase-backed memory, MLflow tracing, and CLI deployment.

Databricks funding rounds

Databricks' funding rounds are the private financings of the data-and-AI company Databricks, culminating in a $10 billion Series J in December 2024 at a $62 billion valuation.

Databricks Genie

Databricks Genie is Databricks' family of AI products (Genie One, Genie Agents, Genie Code) for natural-language data questions converted to SQL, governed by Unity Catalog; preview June 2024, GA June 2025, agentic coworker June 2026.