# Benchmark 4.6 vs 4.5

**URL:** <https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418>\
**Category:** Documentation\
**Created:** [March 28, 2024, 7:22am UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418 "2024-03-28T07:22:16Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![magp18](https://communityhealthtoolkit.b-cdn.net/user_avatar/forum.communityhealthtoolkit.org/magp18/32/1319_2.png) [@magp18](https://forum.communityhealthtoolkit.org/u/magp18)\
**Post date:** [March 28, 2024, 7:22am UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418/1 "2024-03-28T07:22:17Z")

</div>

Hi Everyone!

I am not sure where to share this but wanted to make a post on the impact of the recently released 4.6 on two of our CHT running algorithms!

The categories we benchmarked are :

- Loading screen : How long does it take to open the form
- Next page: How long does it take to go to the next page of the questionnaire
- Submit: How long does it take to submit the form
- Tasks: How long does it take to load the task
- Asymptomatic consultation: How long does it take to go through the consultation without any finding
- Symptomatic consultation : How long does it take to go through a consultation where there was a finding. **Note:** Here the Algorithms were different so not the same finding was taken

 ![Loading_screen](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/4/4ad681fe3c000229f004826f7d0547b0765b8b52.png)  
 ![Next_page](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/1/1824161d1f242e8430eb0d257f99ead921c1e192.png)  
 ![submit](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/0/05411203b108a01b8be20c010cfb78632823716c.png)  
 ![tasks](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/7/7aa328a5c364bbcf39cf767c7a981ac9e9bc80c2.png)  
 ![asymptomatic_consultation](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/8/85082175be027e861c1c6056b10d3c6476dea032.png)  
 ![symptomatic_consultation](https://communityhealthtoolkit.b-cdn.net/uploads/default/original/2X/4/4808db6ec0d726ab9337e7f94e5a48ace3935056.png)

I had three values, per category per algorithm and I plotted the fastest since I might be slower because of different reasons in one run but I can’t be faster than what’s possible. But here are all the values so that you can have all of it if interested:  
Bottom line is, it improved by a lot, with loading screen time being cut by half! Even the “next page” seemed to be faster, being almost immediately in the 4.6 which made it hard to time it.  
4.5:

- Alg 1  
Loading screen
  - ~7.44 s
  - ~8 s
  - ~7.66 s  
Next page
  - 0.8 s
  - 0.7 s
  - 0.6 s  
Submit
  - 3.4 s
  - 3.55 s
  - 3.3 s  
Tasks:
  - 5.5 s
  - 5.6 s
  - 5.4 s  
asymptomatic consultation
  - 58.61 s
  - 58.45 s
  - 56.26 s  
symptomatic consultation
  - 1:07.71 min
  - 1:09.20 min
  - 1:07.10 min

- Alg 2  
Loading screen
  - ~7.55 s
  - ~7.21 s
  - ~6.93 s  
Next page
  - ~0.66 s
  - ~1 s
  - ~1.1 s  
Submit  
-2.31 s  
-2.21 s  
-2.3 s  
Tasks:  
-4.3 s  
-4.06 s  
-4.34 s  
asymptomatic consultation  
-1:07.1 m  
-57.80 s  
-57.90 s  
symptomatic consultation  
-1:18 min  
-1:13.9 min  
-1:12.43 min

4.6 Benchmark

- Alg 1  
Loading screen
  - ~3.8s
  - ~3.8s
  - ~3.7s  
Next page
  - ~0.16s
  - ~0.15s
  - ~0.16s  
Submit
  - ~2.18 s
  - ~2.3s
  - ~2.17s  
Tasks
  - 3.78s
  - 3.73s
  - 3.6s  
asymptomatic consultation
  - 46.52s
  - 42.79s
  - 45.69s  
symptomatic consultation
  - 49.63s
  - 50.23s
  - 47.55s

- Alg 2  
Loading screen  
-4.05s  
-3.65s  
-3.9s  
Next page  
-0.16s  
-0.2s  
-0.15s  
Submit
  - 2.33s
  - 2.22s
  - 2.51s  
Tasks
  - 4.21s
  - 4.05s
  - 3.98s  
asymptomatic consultation
  - 49.12s
  - 42.74s
  - 41.69s  
symptomatic consultation
  - 47.96s
  - 49.09s
  - 54.12s

---

<div class="post-metadata">

**Author:** ![mrjones](https://communityhealthtoolkit.b-cdn.net/user_avatar/forum.communityhealthtoolkit.org/mrjones/32/681_2.png) [@mrjones](https://forum.communityhealthtoolkit.org/u/mrjones)\
**Post date:** [March 28, 2024, 1:59pm UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418/2 "2024-03-28T13:59:34Z")

</div>

@magp18 - wow! Thanks so much for taking the time to share all these results, that’s really great to hear! This echos our [earlier testing efforts](https://forum.communityhealthtoolkit.org/t/feature-testing-enketo-7-uplift-for-cht-core/3196/2) we made with a [Feature Release](https://docs.communityhealthtoolkit.org/contribute/code/releasing/feature_releases/) of the CHT. Very happy to see some real world results around this - thanks again!

---

<div class="post-metadata">

**Author:** ![michael](https://communityhealthtoolkit.b-cdn.net/user_avatar/forum.communityhealthtoolkit.org/michael/32/319_2.png) [@michael](https://forum.communityhealthtoolkit.org/u/michael)\
**Post date:** [March 28, 2024, 3:40pm UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418/3 "2024-03-28T15:40:01Z")

</div>

Thanks for sharing @magp18 ! I’d love to know more about how you measured these, as we are currently working on [improvements](https://github.com/medic/cht-core/issues/8821) to telemetry that will give us a more comprehensive look at client performance across the entire CHT (_the video hasn’t dropped yet, but we presented about APDEX in the CHT on the [March 2024 CHT Round-up](https://forum.communityhealthtoolkit.org/t/cht-round-up-call-thursday-march-14-2024/3368) call_).

You mentioned that you “plotted the fastest”… so I assume you are looking at [telemetry](https://docs.communityhealthtoolkit.org/apps/guides/performance/telemetry/), and specifically the **`min`** property, but I wanted to confirm a few things. Would you mind sharing some more details on these specifically 👇🏽 ?

> **Loading screen** : How long does it take to open the form

I assume you are using → `enketo:contacts:<form>:add:render`

> **Submit** : How long does it take to submit the form

I assume you are using → `enketo:contacts:<form>:add:submit`

> **Next page** : How long does it take to go to the next page of the questionnaire

Not sure on this one…

> **Tasks** : How long does it take to load the task

Are you looking at `enketo:tasks:<form>:add:render`? Or something else?

---

<div class="post-metadata">

**Author:** ![magp18](https://communityhealthtoolkit.b-cdn.net/user_avatar/forum.communityhealthtoolkit.org/magp18/32/1319_2.png) [@magp18](https://forum.communityhealthtoolkit.org/u/magp18)\
**Post date:** [April 4, 2024, 7:25am UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418/4 "2024-04-04T07:25:25Z")

</div>

Hi @michael,

The benchmark was done manually, I had a stopwatch and timed the different times.

I was having a “telemetry service error” in the medic-user-meta in our test server and still figuring out why.

But I also thought the form specific times would come in version 4.7 or am I wrong ?

---

<div class="post-metadata">

**Author:** ![michael](https://communityhealthtoolkit.b-cdn.net/user_avatar/forum.communityhealthtoolkit.org/michael/32/319_2.png) [@michael](https://forum.communityhealthtoolkit.org/u/michael)\
**Post date:** [April 4, 2024, 5:25pm UTC](https://forum.communityhealthtoolkit.org/t/benchmark-4-6-vs-4-5/3418/5 "2024-04-04T17:25:22Z")

</div>

Gotcha… thanks @magp18 .

> [@magp18](#):
>
> form specific times would come in version 4.7

The [telemetry](https://docs.communityhealthtoolkit.org/apps/guides/performance/telemetry/#performance-data) system has been recording Enketo (ie form specific) related telemetry data since 3.4.0. So you can already know the fastest (`min`) and slowest (`max`) times for things like loading a form (`render`) or submitting a form (`save`), but you didn’t really have visibility into any of the measurements between the `min` and `max`.

The [apdex work in 4.7.0](https://github.com/medic/cht-core/issues/8821) will give you another level of granularity, disaggregating those times (in seconds) based on whether they were…

- `< 3s`
- `3s to 12s`
- `> 12s`