Skip to main content
Version: latest

整体架构

ArchitectureThe CnosDB architecture mainly includes two types of processes: CnosDB and CnosDB meta, named cnosdb and cnosdb-meta respectively. CnosDB supports online horizontal expansion of nodes. Supports metadata and data backup to ensure cluster stability. Support for most SQL syntax, using the built-in cnosdb-cli client can quickly and easily connect to CnosDB for query and import.

整体架构图​

Arch

CnosDB meta​

CnosDB meta ,the corresponding program named cnosdb-meta, the role is to maintain the consistency of the cluster. It stores metadata in the cluster, including information about the topology of the cluster, the distribution of replicas, and the distribution of data.它存储了集群中的元数据，其中包括集群的拓扑结构、副本的分布以及数据的分布等信息。

cnosdb-meta ,there are two roles: the cnosdb-meta leader and the cnosdb-meta follower, in which one cnosdb-meta is elected to be the leader through raft consistency protocol. The leader election requires more than half of the follower nodes to survive. Therefore, in a distributed cluster service, it is recommended to deploy 2n+1 cnosdb-meta services to ensure the high availability of the cluster.leader 的选举需要半数以上的 follower 节点存活，所以通常在一个分布式集群服务中，建议部署 2n+1 个 cnosdb-meta 服务，这样可以保证集群的高可用性。

CnosDB makes the following optimizations in the meta cluster:

  1. Cache and localize frequently accessed data.
  2. After the schema information is stored locally, subscribe to the schema version changes from the meta cluster to relieve the read pressure on the meta cluster.
  3. The meta cluster shares the leader pressure and provides a Follower/Read solution to optimize the read performance.

CnosDB​

The following figure shows the architecture of CnosDB.CnosDB, the corresponding program named cnosdb, is used to query and store data. cnosdb is internally divided into two services: query service and tskv storage service, which are the core of cnosdb.

Architecture

Query : Query service, mainly responsible for client connection, query planning, sql analysis and other work. Tskv : Storage service, mainly responsible for the storage of data and the execution of sql physical plans.

Data management​

In Cnosdb, the data management adopts the DB+Time_range shard rule. The number of shards is set by specifying the number of buckets when creating the database, and the time data is cut into Vnodes according to the set interval using the timeline property. Finally, each Vnode is dropped into a bucket for storage, as shown below.

Bucket

Bucket : A bucket is a logical unit, specified when the library is created. Each bucket contains the following main properties: < db, shardid, time_range, create_time, end_time, List< Vnode > >.

Vnode : A Vnode is a logical computing unit distributed to a specific Node, and it is also the smallest unit for data replication.

Replicaset : The high availability of data is maintained by the Data replicaset. Each db has multiple replication groups, which represent the number of replicas of data. A group of Vnodes in a bucket form a replicaset. All Vnodes in a replicaset have the same data and inverted index information. 同一个 bucket 内的一组 Vnode 组成一个 replicaset， 一个 replicaset 内的 Vnode 具有相同的数据和倒排索引信息。