Dashboards play a crucial role in the CHT, and we’re excited to share that CHT Sync is now production-ready!
What is CHT Sync?
CHT Sync is an integrated solution designed to enable data synchronization between CouchDB and PostgreSQL for the purpose of analytics in near real-time. It combines several technologies to achieve this synchronization and provides an efficient workflow for data processing and visualization. The synchronization occurs in near real-time, ensuring that the data displayed on dashboards is up-to-date. See architecture below;
What is the advantage of CHT Sync over couch2pg?
CHT Sync will serve as a direct substitute of couch2pg for the dashboards. CHT Sync and couch2pg differ in implementation, while couch2pg is implemented to sync couchDB and Postgres at defined time intervals in batches, CHT Sync constantly updates Postgres based on changes on couchDB hence the dashboards are reliable and are near realtime. We have included an enhanced couch2pg in CHT Sync that now streams changes to PostgreSQL which is an enhancement compared to the standalone couch2pg.
The data syncing process and data transformation are separate on CHT Sync, we introduced DBT to handle data transformation in cht-pipeline.
Documentation
Here are some data synchronization resources on our doc site.