I have some problem today, after I submit some tasks and forms that I updated, this is the problem I got.
I have issue like the website will return as 404 Not Found, Nginx/1.13.6
From the startup logs you have provided, these error messages can be relevant:
nginx: [emerg] SSL_CTX_use_PrivateKey_file("/srv/settings/medic-core/nginx/private/custom.key") failed (SSL: error:02001002:system library:fopen:No such file or directory:fopen('/srv/settings/medic-core/nginx/private/custom.key','r') error:20074002:BIO routines:FILE_CTRL:system lib error:140B0002:SSL routines:SSL_CTX_use_PrivateKey_file:system lib)
nginx: [emerg] host not found in upstream "haproxy:5984" in /srv/software/medic-core/v2.1.1/x64/etc/nginx/nginx.conf:20
Have you looked at the certificates? Also the couchdb seems to be failing.
@yuv would you be able to look into this tomorrow?
Hi @Marcelo_De_Guzman ,
I took a look at the logs you provided and the log doesn’t appear to be recent one which makes it difficult to see what’s happening across these services. I could only see logs up to February 21 on the pastebin link you provided. Also, the log you’ve pasted is from 2023-02-07 which is more than a year old. Can you please provide the latest log. If possible from the time when you started to see the logs for the first time. If that’s way too past in the future, please provide most recent logs for these services.
[2024-06-30 23:19:30] 2024-06-30 23:19:30 INFO: Waiting for API to be ready…
[2024-06-30 23:19:40] 2024-06-30 23:19:40 INFO: Waiting for API to be ready…
[2024-06-30 23:19:50] 2024-06-30 23:19:50 INFO: Waiting for API to be ready…
[2024-06-30 23:20:00] 2024-06-30 23:20:00 INFO: Waiting for API to be ready…
[2024-06-30 23:20:10] 2024-06-30 23:20:10 INFO: Waiting for API to be ready…
[2024-06-30 23:20:20] 2024-06-30 23:20:20 INFO: Waiting for API to be ready…
[2024-06-30 23:20:30] 2024-06-30 23:20:30 INFO: Waiting for API to be ready…
[2024-06-30 23:20:40] 2024-06-30 23:20:40 INFO: Waiting for API to be ready…
[2024-06-30 23:20:50] 2024-06-30 23:20:50 INFO: Waiting for API to be ready…
[2024-06-30 23:21:00] 2024-06-30 23:21:00 INFO: Waiting for API to be ready…
[2024-06-30 23:21:10] 2024-06-30 23:21:10 INFO: Waiting for API to be ready…
[2024-06-30 23:21:20] 2024-06-30 23:21:20 INFO: Waiting for API to be ready…
[2024-06-30 23:21:30] 2024-06-30 23:21:30 INFO: Waiting for API to be ready…
[2024-06-30 23:21:40] 2024-06-30 23:21:40 INFO: Waiting for API to be ready…
[2024-06-30 23:21:50] 2024-06-30 23:21:50 INFO: Waiting for API to be ready…
[2024-06-30 23:22:00] 2024-06-30 23:22:00 INFO: Waiting for API to be ready…
[2024-06-30 23:22:10] 2024-06-30 23:22:10 INFO: Waiting for API to be ready…
[2024-06-30 23:22:20] 2024-06-30 23:22:20 INFO: Waiting for API to be ready…
[2024-06-30 23:22:30] 2024-06-30 23:22:30 INFO: Waiting for API to be ready…
[2024-06-30 23:22:40] 2024-06-30 23:22:40 INFO: Waiting for API to be ready…
[2024-06-30 23:22:50] 2024-06-30 23:22:50 INFO: Waiting for API to be ready…
[2024-06-30 23:23:00] 2024-06-30 23:23:00 INFO: Waiting for API to be ready…
[2024-06-30 23:23:10] 2024-06-30 23:23:10 INFO: Waiting for API to be ready…
[2024-06-30 23:23:20] 2024-06-30 23:23:20 INFO: Waiting for API to be ready…
[2024-06-30 23:23:30] 2024-06-30 23:23:30 INFO: Waiting for API to be ready…
[2024-06-30 23:23:40] 2024-06-30 23:23:40 INFO: Waiting for API to be ready…
[2024-06-30 23:23:50] 2024-06-30 23:23:50 INFO: Waiting for API to be ready…
[2024-06-30 23:24:00] 2024-06-30 23:24:00 INFO: Waiting for API to be ready…
[2024-06-30 23:24:10] 2024-06-30 23:24:10 INFO: Waiting for API to be ready…
[2024-06-30 23:24:20] 2024-06-30 23:24:20 INFO: Waiting for API to be ready…
[2024-06-30 23:24:30] 2024-06-30 23:24:30 INFO: Waiting for API to be ready…
[2024-06-30 23:24:40] 2024-06-30 23:24:40 INFO: Waiting for API to be ready…
[2024-06-30 23:24:51] 2024-06-30 23:24:51 INFO: Waiting for API to be ready…
[2024-06-30 23:25:01] 2024-06-30 23:25:01 INFO: Waiting for API to be ready…
[2024-06-30 23:25:11] 2024-06-30 23:25:11 INFO: Waiting for API to be ready…
[2024-06-30 23:25:21] 2024-06-30 23:25:21 INFO: Waiting for API to be ready…
[2024-06-30 23:25:31] 2024-06-30 23:25:31 INFO: Waiting for API to be ready…
[2024-06-30 23:25:41] 2024-06-30 23:25:41 INFO: Waiting for API to be ready…
[2024-06-30 23:25:51] 2024-06-30 23:25:51 INFO: Waiting for API to be ready…
[2024-06-30 23:26:01] 2024-06-30 23:26:01 INFO: Waiting for API to be ready…
[2024-06-30 23:26:11] 2024-06-30 23:26:11 INFO: Waiting for API to be ready…
[2024-06-30 23:26:21] 2024-06-30 23:26:21 INFO: Waiting for API to be ready…
[2024-06-30 23:26:31] 2024-06-30 23:26:31 INFO: Waiting for API to be ready…
[2024-06-30 23:26:41] 2024-06-30 23:26:41 INFO: Waiting for API to be ready…
[2024-06-30 23:26:51] 2024-06-30 23:26:51 INFO: Waiting for API to be ready…
[2024-06-30 23:27:01] 2024-06-30 23:27:01 INFO: Waiting for API to be ready…
[2024-06-30 23:27:11] 2024-06-30 23:27:11 INFO: Waiting for API to be ready…
[2024-06-30 23:27:21] 2024-06-30 23:27:21 INFO: Waiting for API to be ready…
[2024-06-30 23:27:31] 2024-06-30 23:27:31 INFO: Waiting for API to be ready…
[2024-06-30 23:27:41] 2024-06-30 23:27:41 INFO: Waiting for API to be ready…
[2024-06-30 23:27:51] 2024-06-30 23:27:51 INFO: Waiting for API to be ready…
[2024-06-30 23:28:01] 2024-06-30 23:28:01 INFO: Waiting for API to be ready…
[2024-06-30 23:28:11] 2024-06-30 23:28:11 INFO: Waiting for API to be ready…
[2024-06-30 23:28:21] 2024-06-30 23:28:21 INFO: Waiting for API to be ready…
[2024-06-30 23:28:31] 2024-06-30 23:28:31 INFO: Waiting for API to be ready…
[2024-06-30 23:28:41] 2024-06-30 23:28:41 INFO: Waiting for API to be ready…
[2024-06-30 23:28:51] 2024-06-30 23:28:51 INFO: Waiting for API to be ready…
[2024-06-30 23:29:01] 2024-06-30 23:29:01 INFO: Waiting for API to be ready…
[2024-06-30 23:29:11] 2024-06-30 23:29:11 INFO: Waiting for API to be ready…
[2024-06-30 23:29:21] 2024-06-30 23:29:21 INFO: Waiting for API to be ready…
[2024-06-30 23:29:31] 2024-06-30 23:29:31 INFO: Waiting for API to be ready…
[2024-06-30 23:29:41] 2024-06-30 23:29:41 INFO: Waiting for API to be ready…
[2024-06-30 23:29:51] 2024-06-30 23:29:51 INFO: Waiting for API to be ready…
[2024-06-30 23:30:01] 2024-06-30 23:30:01 INFO: Waiting for API to be ready…
[2024-06-30 23:30:11] 2024-06-30 23:30:11 INFO: Waiting for API to be ready…
[2024-06-30 23:30:21] 2024-06-30 23:30:21 INFO: Waiting for API to be ready…
[2024-06-30 23:30:31] 2024-06-30 23:30:31 INFO: Waiting for API to be ready…
[2024-06-30 23:30:41] 2024-06-30 23:30:41 INFO: Waiting for API to be ready…
[2024-06-30 23:30:51] 2024-06-30 23:30:51 INFO: Waiting for API to be ready…
[2024-06-30 23:31:01] 2024-06-30 23:31:01 INFO: Waiting for API to be ready…
[2024-06-30 23:31:11] 2024-06-30 23:31:11 INFO: Waiting for API to be ready…
[2024-06-30 23:31:21] 2024-06-30 23:31:21 INFO: Waiting for API to be ready…
[2024-06-30 23:31:31] 2024-06-30 23:31:31 INFO: Waiting for API to be ready…
[2024-06-30 23:31:41] 2024-06-30 23:31:41 INFO: Waiting for API to be ready…
[2024-06-30 23:31:51] 2024-06-30 23:31:51 INFO: Waiting for API to be ready…
[2024-06-30 23:32:01] 2024-06-30 23:32:01 INFO: Waiting for API to be ready…
[2024-06-30 23:32:11] 2024-06-30 23:32:11 INFO: Waiting for API to be ready…
[2024-06-30 23:32:21] 2024-06-30 23:32:21 INFO: Waiting for API to be ready…
[2024-06-30 23:32:31] 2024-06-30 23:32:31 INFO: Waiting for API to be ready…
[2024-06-30 23:32:41] 2024-06-30 23:32:41 INFO: Waiting for API to be ready…
[2024-06-30 23:32:51] 2024-06-30 23:32:51 INFO: Waiting for API to be ready…
[2024-06-30 23:33:01] 2024-06-30 23:33:01 INFO: Waiting for API to be ready…
[2024-06-30 23:33:11] 2024-06-30 23:33:11 INFO: Waiting for API to be ready…
[2024-06-30 23:33:21] 2024-06-30 23:33:21 INFO: Waiting for API to be ready…
[2024-06-30 23:33:31] 2024-06-30 23:33:31 INFO: Waiting for API to be ready…
[2024-06-30 23:33:41] 2024-06-30 23:33:41 INFO: Waiting for API to be ready…
[2024-06-30 23:33:51] 2024-06-30 23:33:51 INFO: Waiting for API to be ready…
[2024-06-30 23:34:01] 2024-06-30 23:34:01 INFO: Waiting for API to be ready…
[2024-06-30 23:34:11] 2024-06-30 23:34:11 INFO: Waiting for API to be ready…
[2024-06-30 23:34:21] 2024-06-30 23:34:21 INFO: Waiting for API to be ready…
[2024-06-30 23:34:31] 2024-06-30 23:34:31 INFO: Waiting for API to be ready…
[2024-06-30 23:34:41] 2024-06-30 23:34:41 INFO: Waiting for API to be ready…
[2024-06-30 23:34:51] 2024-06-30 23:34:51 INFO: Waiting for API to be ready…
[2024-06-30 23:35:01] 2024-06-30 23:35:01 INFO: Waiting for API to be ready…
[2024-06-30 23:35:11] 2024-06-30 23:35:11 INFO: Waiting for API to be ready…
[2024-06-30 23:35:21] 2024-06-30 23:35:21 INFO: Waiting for API to be ready…
[2024-06-30 23:35:31] 2024-06-30 23:35:31 INFO: Waiting for API to be ready…
[2024-06-30 23:35:41] 2024-06-30 23:35:41 INFO: Waiting for API to be ready…
[2024-06-30 23:35:51] 2024-06-30 23:35:51 INFO: Waiting for API to be ready…
[2024-06-30 23:36:01] 2024-06-30 23:36:01 INFO: Waiting for API to be ready…
[2024-06-30 23:36:11] 2024-06-30 23:36:11 INFO: Waiting for API to be ready…
[2024-06-30 23:36:21] 2024-06-30 23:36:21 INFO: Waiting for API to be ready…
[2024-06-30 23:36:31] 2024-06-30 23:36:31 INFO: Waiting for API to be ready…
[2024-06-30 23:36:41] 2024-06-30 23:36:41 INFO: Waiting for API to be ready…
[2024-06-30 23:36:51] 2024-06-30 23:36:51 INFO: Waiting for API to be ready…
[2024-06-30 23:37:01] 2024-06-30 23:37:01 INFO: Waiting for API to be ready…
[2024-06-30 23:37:11] 2024-06-30 23:37:11 INFO: Waiting for API to be ready…
[2024-06-30 23:37:21] 2024-06-30 23:37:21 INFO: Waiting for API to be ready…
[2024-06-30 23:37:31] 2024-06-30 23:37:31 INFO: Waiting for API to be ready…
[2024-06-30 23:37:41] 2024-06-30 23:37:41 INFO: Waiting for API to be ready…
[2024-06-30 23:37:51] 2024-06-30 23:37:51 INFO: Waiting for API to be ready…
[2024-06-30 23:38:01] 2024-06-30 23:38:01 INFO: Waiting for API to be ready…
[2024-06-30 23:38:11] 2024-06-30 23:38:11 INFO: Waiting for API to be ready…
[2024-06-30 23:38:21] 2024-06-30 23:38:21 INFO: Waiting for API to be ready…
[2024-06-30 23:38:31] 2024-06-30 23:38:31 INFO: Waiting for API to be ready…
[2024-06-30 23:38:41] 2024-06-30 23:38:41 INFO: Waiting for API to be ready…
[2024-06-30 23:38:51] 2024-06-30 23:38:51 INFO: Waiting for API to be ready…
[2024-06-30 23:39:01] 2024-06-30 23:39:01 INFO: Waiting for API to be ready…
[2024-06-30 23:39:11] 2024-06-30 23:39:11 INFO: Waiting for API to be ready…
[2024-06-30 23:39:21] 2024-06-30 23:39:21 INFO: Waiting for API to be ready…
[2024-06-30 23:39:31] 2024-06-30 23:39:31 INFO: Waiting for API to be ready…
[2024-06-30 23:39:41] 2024-06-30 23:39:41 INFO: Waiting for API to be ready…
[2024-06-30 23:39:51] 2024-06-30 23:39:51 INFO: Waiting for API to be ready…
[2024-06-30 23:40:01] 2024-06-30 23:40:01 INFO: Waiting for API to be ready…
[2024-06-30 23:40:11] 2024-06-30 23:40:11 INFO: Waiting for API to be ready…
[2024-06-30 23:40:21] 2024-06-30 23:40:21 INFO: Waiting for API to be ready…
[2024-06-30 23:40:31] 2024-06-30 23:40:31 INFO: Waiting for API to be ready…
[2024-06-30 23:40:41] 2024-06-30 23:40:41 INFO: Waiting for API to be ready…
[2024-06-30 23:40:51] 2024-06-30 23:40:51 INFO: Waiting for API to be ready…
[2024-06-30 23:41:01] 2024-06-30 23:41:01 INFO: Waiting for API to be ready…
[2024-06-30 23:41:11] 2024-06-30 23:41:11 INFO: Waiting for API to be ready…
[2024-06-30 23:41:21] 2024-06-30 23:41:21 INFO: Waiting for API to be ready…
[2024-06-30 23:41:31] 2024-06-30 23:41:31 INFO: Waiting for API to be ready…
[2024-06-30 23:41:41] 2024-06-30 23:41:41 INFO: Waiting for API to be ready…
[2024-06-30 23:41:51] 2024-06-30 23:41:52 INFO: Waiting for API to be ready…
[2024-06-30 23:42:02] 2024-06-30 23:42:02 INFO: Waiting for API to be ready…
[2024-06-30 23:42:12] 2024-06-30 23:42:12 INFO: Waiting for API to be ready…
[2024-06-30 23:42:22] 2024-06-30 23:42:22 INFO: Waiting for API to be ready…
[2024-06-30 23:42:32] 2024-06-30 23:42:32 INFO: Waiting for API to be ready…
[2024-06-30 23:42:42] 2024-06-30 23:42:42 INFO: Waiting for API to be ready…
[2024-06-30 23:42:52] 2024-06-30 23:42:52 INFO: Waiting for API to be ready…
[2024-06-30 23:43:02] 2024-06-30 23:43:02 INFO: Waiting for API to be ready…
[2024-06-30 23:43:12] 2024-06-30 23:43:12 INFO: Waiting for API to be ready…
[2024-06-30 23:43:22] 2024-06-30 23:43:22 INFO: Waiting for API to be ready…
[2024-06-30 23:43:32] 2024-06-30 23:43:32 INFO: Waiting for API to be ready…
[2024-06-30 23:43:42] 2024-06-30 23:43:42 INFO: Waiting for API to be ready…
[2024-06-30 23:43:52] 2024-06-30 23:43:52 INFO: Waiting for API to be ready…
[2024-06-30 23:44:02] 2024-06-30 23:44:02 INFO: Waiting for API to be ready…
[2024-06-30 23:44:12] 2024-06-30 23:44:12 INFO: Waiting for API to be ready…
Hi @Marcelo_De_Guzman , glad to know it worked after restart. In order to what had happened, we should also look at API log since it appears that Sentinel was waiting for API to be ready. If you have this issue next time, please attach latest Sentinel and API logs and we can debug from there.
I have another issue with this CHT Error 404 not found,
this time it has error.
[stack]: ‘Error: CouchDB security seems to be misconfigured, see: cht-core/DEVELOPMENT.md at master · medic/cht-core · GitHub at ClientRequest.net.get (/srv/software/medic-api/md5-cdTbX9bB8ZfHZmsqbv4Zw==/node_modules/@medic/server-checks/src/checks.js:63:16)\n at Object.onceWrapper (events.js:315:30)\n at emitOne (events.js:116:13)\n at ClientRequest.emit (events.js:211:7)\n at HTTPParser.parserOnIncomingClient [as onIncoming] (_http_client.js:543:21)\n at HTTPParser.parserOnHeadersComplete (_http_common.js:112:17)\n at Socket.socketOnData (_http_client.js:440:20)\n at emitOne (events.js:116:13)\n at Socket.emit (events.js:211:7)\n at addChunk (_stream_readable.js:263:12)’,
[2024-05-21 14:56:48] [message]: ‘CouchDB security seems to be misconfigured, see: cht-core/DEVELOPMENT.md at master · medic/cht-core · GitHub’ }
[2024-05-21 14:56:51] 2024-05-21 14:56:51 INFO: Running server checks…
How to fix this one?
This one is our staging medic, we are testing the changes here first before pushing to production.
Hi @Marcelo_De_Guzman , Can you explain which CHT version are you using? Was it a fresh installation of CHT or upgrade from previous version? How did you install CHT on this environment? Using docker helper or using a standalone Couchdb setup? For me it looks like, you’ve standalone or custom couchdb instance running.
Can you try applying this setting on your couchdb installation if your couchdb was standalone installation?
it was not a fresh installation, it was just another CHT, we are using that one as staging site. We are developing forms, and then on this site (test-flourish.caremin.com), we tested it out and having approval. Once approved and the forms are working fine, we are gonna push it to production.
Sure, will that that setting. Is that the whole .ini file or line 21 to 32 only?
Hi @Marcelo_De_Guzman , checking on if this problem has been fixed after we identified that the server was low on space and we added more space to the server.
Hi @Marcelo_De_Guzman , yes, please try installing the clean instance of CHT (same version as your production one). If your production is on 3.x, this guide can be helpful. For 4.x, you can follow from here.
Right now, I have most of the requirements on AWS that is stored.
What is the simplest process to re-do it, it is remove the medic-os and haproxy and re-install again, then push the forms that is working right now on the production? Do you think this will work? and gave me less time to install it again?
@Marcelo_De_Guzman and I connected and we installed 3.9 using this instruction. We had to run docker network prune -f as well to remove the old network.