Thomas Peetz
127 lines
8.7 KiB
Markdown
127 lines
8.7 KiB
Markdown
---
|
||
tags:
|
||
- process/task
|
||
reference:
|
||
- "[[Hoyer SE]]"
|
||
---
|
||
|
||
> [!task]+
|
||
> Bar:: `$= dv.view('total-progress-bar', {file: "Hoyer Installation Data Movement Gateway"})`
|
||
|
||
## Aufgabenbeschreibung
|
||
|
||
## Überlegungen
|
||
|
||
Linux **project quotas** (`prjquota`) allow you to set limits on directories and their future subdirectories, but they require manual configuration for each specific path rather than automatic inheritance for newly created directories.
|
||
|
||
To implement this, you must:
|
||
- **Enable the feature**: Add `prjquota` to the mount options in `/etc/fstab` and remount the filesystem.
|
||
- **Define projects**: Edit `/etc/projects` to assign a unique Project ID to the target directory (e.g., `/app/project1`).
|
||
- **Map IDs**: Edit `/etc/projid` to link the Project ID to a human-readable name.
|
||
- **Set limits**: Use `xfs_quota` to set soft and hard limits for that Project ID.
|
||
|
||
|
||
This method applies quotas to the specified directory and all its contents, including **future subdirectories** created within that path, but you must manually define the quota for each new top-level project directory you wish to limit.
|
||
## Links
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Gateways/dm-gateway-setting-up.htm
|
||
- https://community.qlik.com/t5/Official-Support-Articles/Qlik-Data-Gateway-installation-requirements-Data-Movement/ta-p/2091557
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Gateways/dm-gateway-setting-up.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/SourcesConnections/supported-sources.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/Landing/connecting-data-2.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/SourcesConnections/AzureSQLMSCDC/Prereqs-sql-server-cdc.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/TargetConnections/postgresql-target.htm
|
||
- https://search.brave.com/ask?q=How+do+I+reset+or+modify+existing+prjquota+limits%3F&conversation=0904310594262d07a7936d9aa689d413fdc4
|
||
- https://search.brave.com/search?q=prjquota+set+limits+for+subdirectories+of+given+path&summary=1&conversation=0904da0eee1946f8461b4a15b8888452d6b1
|
||
- https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/8/html/managing_file_systems/assembly_limiting-storage-space-usage-on-xfs-with-quotas_managing-file-systems
|
||
|
||
## Termine
|
||
```dataview
|
||
LIST
|
||
FROM [[]] AND !outgoing([[]]) AND "Journal"
|
||
SORT file.name DESC
|
||
LIMIT 20
|
||
```
|
||
|
||
## Installationslog
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev bin] fdisk /dev/sda
|
||
[root@vsrv-qlik-dmgw-dev bin] mkfs.xfs /dev/sda1
|
||
[root@vsrv-qlik-dmgw-dev bin] mkdir /data
|
||
[root@vsrv-qlik-dmgw-dev bin] blkid /dev/sda1 > /etc/fstab
|
||
[root@vsrv-qlik-dmgw-dev bin] cat /etc/fstab
|
||
|
||
#
|
||
# /etc/fstab
|
||
# Created by anaconda on Fri Apr 10 10:38:06 2026
|
||
#
|
||
# Accessible filesystems, by reference, are maintained under '/dev/disk/'.
|
||
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info.
|
||
#
|
||
# After editing this file, run 'systemctl daemon-reload' to update systemd
|
||
# units generated from this file.
|
||
#
|
||
/dev/mapper/rl-root / xfs defaults 0 0
|
||
UUID=12d381e2-428a-4a8b-bbd4-eb5cbf972065 /boot xfs defaults 0 0
|
||
/dev/mapper/rl-home /home xfs defaults 0 0
|
||
/dev/mapper/rl-swap none swap defaults 0 0
|
||
/dev/sda1 /opt xfs defaults 0 0
|
||
|
||
[root@vsrv-qlik-dmgw-dev bin] systemctl daemon-reload
|
||
[root@vsrv-qlik-dmgw-dev bin] mount -a
|
||
````
|
||
|
||
````Shell
|
||
[root@vsrv-qlik-dmgw-dev rpm] QLIK_CUSTOMER_AGREEMENT_ACCEPT=yes rpm -ivh qlik-data-gateway-data-movement.rpm
|
||
warning: qlik-data-gateway-data-movement.rpm: Header V4 RSA/SHA512 Signature, key ID 0a45233c: NOKEY
|
||
Verifying... ################################# [100%]
|
||
Preparing... ################################# [100%]
|
||
Updating / installing...
|
||
1:qlik-data-gateway-data-movement-2################################# [100%]
|
||
|
||
To set up connectivity between the Data Movement gateway and your Qlik Cloud tenant,
|
||
change your working directory to /opt/qlik/gateway/movement/bin and perform the following steps:
|
||
1.Set the Qlik Cloud tenant URL by running:
|
||
$ ./repagent agentctl qcs set_config --tenant_url URL
|
||
(where URL is replaced by the actual URL e.g. mytenant.us.qlikcloud.com)
|
||
2.Generate a registration key by running:
|
||
$ ./repagent agentctl qcs get_registration
|
||
The key is used to establish an authenticated connection between the Data Movement gateway and your Qlik Cloud tenant.
|
||
3.Create a Data Movement gateway in Management Console and paste the generated key into the “Key” field.
|
||
4.After the Data Movement gateway has been created in Management Console, start the data gateway service by running (as root):
|
||
$ systemctl start repagent
|
||
[root@vsrv-qlik-dmgw-dev rpm] cd /opt/qlik/gateway/movement/bin/
|
||
[root@vsrv-qlik-dmgw-dev bin] ls
|
||
agentctl arep_csv2prq fix_permissions kinit libmongocrypt.so nav_util repctl.cfg uconv
|
||
agentctl.dll.config arep_login.sh irpcd klist libsolclient.so repagent repctl.sh upgrade_services.sh
|
||
arepbq arep.sh kdestroy libe_sqlite3.so makeconv repctl site_arep_login.sh
|
||
[root@vsrv-qlik-dmgw-dev bin] ./repagent agentctl qcs set_config --tenant_url hoyer.de.qlikcloud.com
|
||
[root@vsrv-qlik-dmgw-dev bin] ./repagent agentctl qcs get_registration
|
||
{"agentType":"data-movement","kid":"cc055914-9918-4930-a482-e3bad6132212","publicKey":"-----BEGIN CERTIFICATE-----\nMIIE4TCCAsmgAwIBAgIJAP5E6EgJ9YJmMA0GCSqGSIb3DQEBCwUAMB4xHDAaBgNVBAMTE1FDU0Nv\r\nbm5lY3Rpb25Ccm9rZXIwHhcNMjYwNTEyMjIwMDAwWhcNMzYwNTA5MjIwMDAwWjAeMRwwGgYDVQQD\r\nExNRQ1NDb25uZWN0aW9uQnJva2VyMIICIjANBgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAwNuc\r\nqtuQoMBurPYCZTgCnsRUpSxBnyku57WN0th21dMZWGbR+KkZVyk5NH1tgZ1pxdy0TinWsghjjKHY\r\nzeOpZdRQgRAsgLLKcdt9k2I/EUQFtxZ0i6Fh/iwuEuawM0EJWThivEDfTCW2K2/b/FCOGvf6yp4C\r\nd2Z5ChzQ/XZyehQdaESxuW4FH4YeaLAG0t9ZgNsKxwRDU51Uf26UQX+SETj9BX2gCEGcR8ig+Vqe\r\nhtv0/K22FgnnyFfqDHdnIkNuNB6DK6yoBYEaday7juAbYb1nO7x1PM56p3yiowX+3R2N/wH0pctw\r\nwYE+pidqXzkcMy+32q+v1MdPcckKli0v5D62W+2eM7poN3KRlP6qykOCKj4cSL9ATJVYqOq3dgi1\r\nYdsKyoEehXiZtUDDpIaraXgN6awAPQWUAlNmXrTiOzrJTiYcDd/6x8JqSrcN7ezPo1cq50yO1MjU\r\nJTvjdc7NrUE7GILRLnwbkCIpbF980QYH2GLsOuVIFro/3mOUiZIudMYLvNQ1lEPlLwF28s35fRVl\r\nHwVYY4NdNRrkLAbSnL6oUTvFHib41Gw68vEaSeP+QmRxnK8JLnXzJ79DTUKYM9l/U8ndWcgQqW0J\r\nlM1vDHJD0Kc7iErAXaYsYAZC7ld8QD965xZgEScfiaXRuqqh63VlvC81mOXgQh/0Fvt4CVUCAwEA\r\nAaMiMCAwHgYDVR0RBBcwFYITUUNTQ29ubmVjdGlvbkJyb2tlcjANBgkqhkiG9w0BAQsFAAOCAgEA\r\nQJ8k3jcv9YTValHZGFsFs5ijFVHaRRzSOzeT43QSQHrobdtHivOmpWwaIgP3MPVShVlnJwMmi6vE\r\nYORVa2QEQ0STxExmT7jFREGe9i1mBIjvYjQh6Oel1neS02G7puTC0CjpeiFXHYymIcwL5rheeGxS\r\ngcVbiDG9y/x+JFs6eJavAdyoKvDub6wPh7VcSRq0raWbdfGUZLyHpmXqZ7YQUdk2o6q+aE2X6fgL\r\nbCG0ssnXJQ/1FhZL6S8ueSJ0UbjNQ7SgQUVyGSF+uXnlCmdl1pwqxgIu+CtJxfn3QD6jV8ifBD1Z\r\n02FP4sFnPErCjZETssodRnAnd+rv7fbO/8G/QFalRl+xKWsUwxeMYa6BWrXH0hXxqsT+D3r9NAhK\r\nN1z9vuin4ElJf1fBPdP3dnJ9XeQLIrrIQ8TdNiH+TeKx8btaToiOvu/d+hfjk+xvY1XL7t55w8N4\r\ngp/nBaggelAh5C57dPk/B47mGDNyQBbSVq1fe7JIJZ+vYD2tFRyrhqJuuZnXSKUHdrNhOROltnr8\r\n8RNVxuww3icYJI7HrqBb7WDsl6vBpvnFULBZzbIOdtZL5L3cH4oNcrsNWUeHMcn/fQxNedpTnRDg\r\nubC4Vq+apguqjmAD0ytVnA0TJyCMYn++gfSIuG+jfW8RSntfgp0US1SNlTdEJovsOHjGH20CT+g=\n-----END CERTIFICATE-----\n"}
|
||
ReplicateAgent Control Program completed successfully.
|
||
[root@vsrv-qlik-dmgw02 bin] systemctl start repagent
|
||
````
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev etc] nvim fstab
|
||
[root@vsrv-qlik-dmgw-dev bin] cat fstab
|
||
|
||
````
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev rpm] cd /opt/qlik/gateway/movement/drivers/bin/
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install mysql
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install sqlserver
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install postgres
|
||
[root@vsrv-qlik-dmgw-dev bin] systemctl restart repagent
|
||
````
|
||
|
||
## Unteraufgaben
|
||
|
||
- [x] Hoyer Installation Data Movement Gateway on vsrv-qlik-dmgw-dev [start:: 2026-04-21] [scheduled:: 2026-04-22] [completion:: 2026-04-23]
|
||
- [x] Verzeichnis /opt nicht als Mountpoint eingerichtet mit mindestens 300GB Kapazität [[Viktor Becker]] [start:: 2026-04-21] [scheduled:: 2026-04-22] [completion:: 2026-04-22]
|
||
- [x] Anfrage bezüglich Erweiterung Festplattenkapazität weitergeleitet [start:: 2026-04-22] [scheduled:: 2026-04-22] [completion:: 2026-04-22]
|
||
- [x] Konfiguration des Mountpoint /opt zur Einrichtung von Project-Quotas [completion:: 2026-04-27]
|
||
- [x] Installation des MySQL Datenbanktreibers [completion:: 2026-04-27]
|
||
- [x] Installation des MS-SQL Datenbanktreibers [start:: 2026-04-27] [scheduled:: 2026-04-28] [completion:: 2026-04-28]
|