Cometa Installation on M1 Chip

[tcolo]

./cometa.sh
[2022-10-03T20:40:15][INFO][cometa.sh:21] - This is ./cometa.sh version 2022-09-08 running for your convinience
sed: 1: "docker-compose.yml": extra characters at the end of d command
[2022-10-03T20:40:15][INFO][cometa.sh:76] - Created schedules directory
[2022-10-03T20:40:15][INFO][cometa.sh:91] - Created crontab file
[2022-10-03T20:40:15][INFO][cometa.sh:99] - Created browsers.json file
sed: 1: "docker-compose.yml": extra characters at the end of d command
sed: 1: "docker-compose.yml": extra characters at the end of d command
[2022-10-03T20:40:15][INFO][cometa.sh:119] - The default string in accounts.google.com.client was replaced with something else - hopefully your google oAuth client credentials
[2022-10-03T20:40:15][INFO][cometa.sh:125] - Starting containers
1 error(s) decoding:

• error decoding 'Ports': Invalid hostPort: <outside_port>
  ./cometa.sh: line 126: warn: command not found
  [2022-10-03T20:40:18][INFO][cometa.sh:137] - Downloading latest browser versions
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:8] - Executing Deploy Selenoid Script
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:24] - *********************** COMETA ***********************
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:25] - This script automatically retrieves the latest browsers
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:26] - for Selenoid and recreates/updates the docker.
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:27] - ******************************************************
  [2022-10-03T20:40:19][INFO][deploy_selenoid.sh:31] - jq: already installed.
  ./getLatestBrowsers.sh: line 36: realpath: command not found
  usage: dirname string [...]
  ./getLatestBrowsers.sh: line 84: /../../helpers/logger.sh: No such file or directory
  ./getLatestBrowsers.sh: line 143: log_wfr: command not found
  ./getLatestBrowsers.sh: line 172: log_res: command not found
  ./getLatestBrowsers.sh: line 143: log_wfr: command not found
  Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
  ./getLatestBrowsers.sh: line 172: log_res: command not found
  ./getLatestBrowsers.sh: line 143: log_wfr: command not found
  ./getLatestBrowsers.sh: line 194: log_wfr: command not found
  ./getLatestBrowsers.sh: line 195: log_res: command not found

Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
[2022-10-03T20:41:11][INFO][deploy_selenoid.sh:38] - pulling selenoid/video-recorder
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
[2022-10-03T20:41:11][INFO][deploy_selenoid.sh:51] - Replacing background image volume in Selenoid images ...
sed: 1: "browsers.json": undefined label 'rowsers.json'
[2022-10-03T20:41:11][INFO][deploy_selenoid.sh:58] - Replacing downloads folder in Selenoid Chrome Image ...
sed: 1: "browsers.json": undefined label 'rowsers.json'
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
[2022-10-03T20:41:12][INFO][deploy_selenoid.sh:71] - Selenoid docker was not found or exited, recreating docker ... -> [failed]
[2022-10-03T20:41:12][INFO][cometa.sh:153] - Waiting for parseBrowsersCannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
Error response from daemon: dial unix docker.raw.sock: connect: connection refused
Error: No such container: cometa_django
Error: No such container: cometa_django

jq is also not normally installed - there are no arm64 packages. I compiled it myself for other purposes.

[ArslanSB]

I've update the scripts so sed commands should be working now. Also added check for docker if it's installed and running.
Missing jq I'll try adding a compile function to the script if jq package is missing in package manager.

[raro42]

Closing this issue, as M1 installation without native support of JQ is a real pain.

Recommend to use Vmware or VirtualBox to run linux flavors that support jq.

If that is not ok for you, you might as well re-open this issue.

[isoctcolo]

If this should work on M1 https://formulae.brew.sh/formula/jq

the jq was already ported

[raro42]

Re-opening and testing

[tcolo]

.cometa.sh is working

The cometa_front docker imgage is not starting (it is going in a strange loop)

Adding logfile from docker.
docker.log

[raro42]

Thanks for testing!

So bringing up the front container is the problem.

2023-12-05 11:38:21 make: g++: Command not found

It should be installed via start.sh in ./front directory

Can you please attache the docker-compose file you used?

2023-12-05 11:44:39 httpd: Syntax error on line 589 of /usr/local/apache2/conf/httpd.conf: Syntax error on line 45 of /usr/local/apache2/conf/openidc.conf: Cannot load modules/mod_auth_openidc.so into server: /usr/local/apache2/modules/mod_auth_openidc.so: cannot open shared object file: No such file or directory
This is a followup from the before.

There are permission issues in the cometa_front docker container.
2023-12-05 11:35:11 sed: couldn't open temporary file /code/src/sedDNZQp1: Permission denied

Can you check the permissions on /front are "rw" for "root" and did you execute the ./cometa.sh as "root"?

[tcolo]

Adding docker-compose.tgz - yml upload is not allowed.
I really have to check the issue here:
The permissions shouldn't be an issue because I check it out as my mac user and run it as my mac user so it should be readable and writeable for all directories.
I check some szenarios and test.

docker-compose.tgz

[tcolo]

The path /data/cometa/videos is not shared from the host and is not known to Docker.
You can configure shared paths from Docker -> Preferences... -> Resources -> File Sharing.
This has to be configured in the Docker Desktop so this directory points to a local director

On the / direcory on mac you cannot create a directory - Solution is to change in the docker-compose.yml the data directory. The best solution is to use /Users/[User]/ as a base directory due to permissions.

[tcolo]

It is important to start cometa.sh with "bash cometa.sh" otherwise zsh is used.

[tcolo]

I added g++ to the start.sh and the error g++ command not found is gone.

apt-get install -y pkg-config make gcc g++ gdb lcov valgrind vim curl iputils-ping wget

[tcolo]

I get in cometa_django

2024-01-13 17:31:49 Internal Server Error: /parseBrowsers/
2024-01-13 17:31:49 Traceback (most recent call last):
2024-01-13 17:31:49 File "/usr/local/lib/python3.9/site-packages/django/core/handlers/exception.py", line 47, in inner
2024-01-13 17:31:49 response = get_response(request)
2024-01-13 17:31:49 File "/opt/code/backend/middlewares/authentication.py", line 75, in call
2024-01-13 17:31:49 result = self.createSession(request)
2024-01-13 17:31:49 File "/opt/code/backend/middlewares/authentication.py", line 114, in createSession
2024-01-13 17:31:49 superuser = Permissions.objects.filter(permission_name="SUPERUSER")[0]
2024-01-13 17:31:49 File "/usr/local/lib/python3.9/site-packages/django/db/models/query.py", line 318, in getitem
2024-01-13 17:31:49 return qs._result_cache[0]
2024-01-13 17:31:49 IndexError: list index out of range
2024-01-13 17:31:59 Internal Server Error: /parseBrowsers/