一种数据统计方法及系统

Data statistic method and system

Abstract

The invention provides a data statistic method and system. The method comprises the following steps: pre-creating a data extraction record chart, presetting a target condition and monitoring at least one relational database connected with a big data platform; when the target condition is satisfied, extracting incremental data in the relational database with the incremental data into the big data platform; updating the data extraction record chart; and when a statistic instruction is obtained, responding the statistic instruction according to the data extraction record chart. According to the scheme, the data extraction record chart is updated after the data in the relational database is extracted into the big data platform; and when statistic is carried out on the data in the big data platform, response can be carried out by utilizing the data extraction record chart without traversing all the data in the big data platform, so that the statistic efficiency can be improved and a mass of computation and network resources are saved.
本发明提供一种数据统计方法及系统,方法包括:预先创建数据抽取记录表,以及预先设置目标条件,监测与大数据平台相连接的至少一个关系型数据库;在满足所述目标条件时,将具有增量数据的关系型数据库中的增量数据抽取到大数据平台中;更新所述数据抽取记录表;在获取到统计指令时,根据所述数据抽取记录表响应所述统计指令。根据本方案,在将关系型数据库中的数据抽取到大数据平台之后,对数据抽取记录表进行更新,在对大数据平台中的数据进行统计时,可以利用该数据抽取记录表进行响应,无需对大数据平台中所有数据进行遍历,从而可以提高统计效率,节省了大量的计算、网络资源。

Claims

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (0)

    Publication numberPublication dateAssigneeTitle

NO-Patent Citations (0)

    Title

Cited By (0)

    Publication numberPublication dateAssigneeTitle