3,135 articles
Anomaly detection
Anomaly detection, also called outlier detection, is the machine learning task of identifying patterns in data that do not conform to expected behavior, such as fraudulent transactions.
Answer set programming
Answer set programming (ASP) is a declarative logic programming paradigm for combinatorial search and knowledge representation, in which a solver computes a program's stable models, called answer sets.
Ant colony optimization algorithms
Ant colony optimization (ACO) algorithms solve hard combinatorial optimization problems with artificial ants whose pheromone-based choices improve over iterations, introduced by Marco Dorigo in 1991.
Anti-aliasing filter
An anti-aliasing filter is a lowpass filter placed ahead of a sampler, such as an ADC, that attenuates frequencies above the Nyquist rate so they cannot alias into the band of interest.
Antlion optimization algorithm
The antlion optimization algorithm (ALO) is a population-based metaheuristic for numerical optimization, introduced by Seyedali Mirjalili in 2015, which mimics how antlion larvae trap and consume ants to guide candidate solutions toward an optimum.
Anytime A*
Anytime A is a heuristic search scheme that turns A into an anytime algorithm, quickly returning a bounded-suboptimal solution and improving it toward optimal, useful in planning.
Apache Atlas
Apache Atlas is an Apache Software Foundation open-source metadata and data governance framework for Hadoop, offering a type system, JanusGraph graph store, Kafka integration, lineage, classification, and Ranger-driven access policies; originated in Hortonworks' 2014-2015 Data Governance Initiative.
Apache Beam
Apache Beam is an open source unified programming model for batch and streaming data pipelines, originating from Google's Dataflow SDKs donated in 2016, with SDKs in Java, Python, Go, and others and runners including Flink, Spark, and Google Cloud Dataflow.
Apache Calcite
Apache Calcite (formerly Optiq) is a dynamic data management framework: an SQL parser, validator, cost-based query optimizer, and adapter framework that powers Hive, Flink, Drill, Phoenix, Kylin, and others, without storing data itself.
Apache Camel
Apache Camel is an Apache Software Foundation open-source integration framework based on Enterprise Integration Patterns, first committed March 19, 2007 by James Strachan; routes use from().to() DSLs in Java, XML, or YAML with 300+ components.
Apache Cassandra
Apache Cassandra is an open-source, distributed NoSQL wide-column database designed at Facebook around 2008 to power Inbox Search, providing high availability, low-latency reads and writes, and scalability across commodity servers.
Apache DataFusion
Apache DataFusion is an extensible Rust query engine built on the Apache Arrow in-memory format. Donated to Arrow in 2019 and an ASF top-level project since 2024, it offers SQL and DataFrame APIs plus the Ballista, Comet, Python, and Java subprojects.
Apache DataFusion Comet
Apache DataFusion Comet (DataFusion Comet) is an open-source Apache Spark plugin, originally from Apple, that runs Spark SQL queries on the Rust-based DataFusion engine on CPUs, with fallback to Spark; benchmarked 1.57–1.75× on TPC-DS 3TB.
Apache DolphinScheduler
Apache DolphinScheduler (formerly EasyScheduler) is an Apache top-level, open-source distributed visual DAG workflow orchestration platform for data pipelines, with master/worker/api/alert services, 30+ task types, and Zookeeper-based high availability.
Apache Doris
Apache Doris (formerly Baidu Palo) is an Apache top-level MPP real-time analytical database with sub-second queries, MySQL protocol compatibility, FE/BE architecture, and 4.0/4.1 AI, vector, and lakehouse features.
Apache Drill
Apache Drill is an open-source, schema-free distributed SQL query engine for Hadoop, NoSQL, and cloud storage, inspired by Google Dremel. Entered the Apache Incubator in 2012, became a top-level project in 2014, latest release 1.22.0 (2025) supporting Java 11/17/21.
Apache Druid
Apache Druid is an open-source distributed real-time analytics (OLAP) database begun at Metamarkets in 2011, using time-partitioned columnar segments, Kafka/Kinesis streaming ingestion, and Druid SQL; latest release 38.0.0, October 2026.
Apache Flume
Apache Flume is a distributed, reliable Apache service (also Flume NG) for collecting, aggregating, and moving large volumes of log/event data via source-channel-sink agents into stores like HDFS; incubated 2011, graduated 2012, merged into Logging Services 2023.
Apache Fluss
Apache Fluss (German for river) is a lakehouse-native streaming storage system for real-time analytics and AI, started at Alibaba Cloud in 2023, incubated 2025, an Apache TLP since July 2026, with Fluss 1.0 as its first TLP release.
Apache Gluten
Apache Gluten is an open-source Spark plugin, started by Intel and Kyligence in 2022, that offloads Spark SQL execution to native Velox or ClickHouse engines via Substrait and JNI, reporting about 3x TPC-H/TPC-DS speedups; it became an Apache Top-Level Project in 2026.
Apache Gobblin
Apache Gobblin: open-source distributed data integration framework for streaming and batch ingestion, replication, organization, and lifecycle management. Built at LinkedIn (2014), Apache Incubator 2017, Top-Level Project 2021.
Apache Gravitino
Apache Gravitino is an Apache Software Foundation top-level project, a high-performance, geo-distributed, federated metadata lake (catalog of catalogs) for data and AI assets, incubating from June 2024 and graduating June 3, 2025.
Apache Griffin
Apache Griffin was an Apache Software Foundation open-source data quality platform for big data, batch and streaming, built on Hadoop and Spark. Entered incubation 2016, graduated November 2018, retired to the Apache Attic in 2025 (ATTIC-246); final release 0.6.0.
Apache Hadoop
Apache Hadoop is an open-source framework for storing and processing large data sets across clusters of commodity computers, combining HDFS storage with MapReduce processing and YARN resource management.
Apache HBase
Apache HBase is an open-source distributed NoSQL data store modeled after Google Bigtable, running on HDFS. Started in 2006 at Powerset, it powers high-throughput uses like Facebook Messages.
Apache Hive
Apache Hive is an open-source data warehouse system built on Apache Hadoop that queries very large datasets using SQL; developed at Facebook from 2007 and open sourced in 2008.
Apache Hop
Apache Hop (Hop Orchestration Platform) is an open source, metadata-driven data integration and orchestration platform forked from Pentaho Kettle in 2019, an ASF Top-Level Project since January 2022, with 250+ pipeline transforms and Beam/Spark runtimes.
Apache Hudi
Apache Hudi is an open-source data lakehouse table format providing atomic upserts, deletes, and incremental change streams over Hadoop-compatible and cloud object storage, developed at Uber in 2016.
Apache Impala
Apache Impala is an open-source MPP SQL query engine in C++ and Java for Hadoop, Iceberg, Kudu, and cloud storage, developed at Cloudera, an Apache top-level project since 2017, latest release 4.5.3.
Apache InLong
Apache InLong (应龙), formerly TubeMQ, is an Apache top-level data integration framework from Tencent supporting ingestion, synchronization, and subscription; incubated 2019, renamed 2021, graduated 2022-06-15.