Thomas Peetz
116 lines
6.4 KiB
Markdown
116 lines
6.4 KiB
Markdown
---
|
||
tags:
|
||
- process/task
|
||
reference:
|
||
- "[[Hoyer SE]]"
|
||
---
|
||
|
||
> [!task]+
|
||
> Bar:: `$= dv.view('total-progress-bar', {file: "Hoyer Installation Data Movement Gateway"})`
|
||
|
||
## Aufgabenbeschreibung
|
||
|
||
## Überlegungen
|
||
|
||
Linux **project quotas** (`prjquota`) allow you to set limits on directories and their future subdirectories, but they require manual configuration for each specific path rather than automatic inheritance for newly created directories.
|
||
|
||
To implement this, you must:
|
||
- **Enable the feature**: Add `prjquota` to the mount options in `/etc/fstab` and remount the filesystem.
|
||
- **Define projects**: Edit `/etc/projects` to assign a unique Project ID to the target directory (e.g., `/app/project1`).
|
||
- **Map IDs**: Edit `/etc/projid` to link the Project ID to a human-readable name.
|
||
- **Set limits**: Use `xfs_quota` to set soft and hard limits for that Project ID.
|
||
|
||
|
||
This method applies quotas to the specified directory and all its contents, including **future subdirectories** created within that path, but you must manually define the quota for each new top-level project directory you wish to limit.
|
||
## Links
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Gateways/dm-gateway-setting-up.htm
|
||
- https://community.qlik.com/t5/Official-Support-Articles/Qlik-Data-Gateway-installation-requirements-Data-Movement/ta-p/2091557
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/Gateways/dm-gateway-setting-up.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/SourcesConnections/supported-sources.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/Landing/connecting-data-2.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/SourcesConnections/AzureSQLMSCDC/Prereqs-sql-server-cdc.htm
|
||
- https://help.qlik.com/en-US/cloud-services/Subsystems/Hub/Content/Sense_Hub/DataIntegration/TargetConnections/postgresql-target.htm
|
||
- https://search.brave.com/ask?q=How+do+I+reset+or+modify+existing+prjquota+limits%3F&conversation=0904310594262d07a7936d9aa689d413fdc4
|
||
- https://search.brave.com/search?q=prjquota+set+limits+for+subdirectories+of+given+path&summary=1&conversation=0904da0eee1946f8461b4a15b8888452d6b1
|
||
- https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/8/html/managing_file_systems/assembly_limiting-storage-space-usage-on-xfs-with-quotas_managing-file-systems
|
||
|
||
## Termine
|
||
```dataview
|
||
LIST
|
||
FROM [[]] AND !outgoing([[]]) AND "Journal"
|
||
SORT file.name DESC
|
||
LIMIT 20
|
||
```
|
||
|
||
## Installationslog
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev bin] cat /etc/fstab
|
||
|
||
#
|
||
# /etc/fstab
|
||
# Created by anaconda on Fri Apr 10 10:38:06 2026
|
||
#
|
||
# Accessible filesystems, by reference, are maintained under '/dev/disk/'.
|
||
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info.
|
||
#
|
||
# After editing this file, run 'systemctl daemon-reload' to update systemd
|
||
# units generated from this file.
|
||
#
|
||
/dev/mapper/rl-root / xfs defaults 0 0
|
||
UUID=12d381e2-428a-4a8b-bbd4-eb5cbf972065 /boot xfs defaults 0 0
|
||
/dev/mapper/rl-home /home xfs defaults 0 0
|
||
/dev/mapper/rl-swap none swap defaults 0 0
|
||
/dev/sda1 /opt xfs defaults 0 0
|
||
````
|
||
|
||
````Shell
|
||
[root@vsrv-qlik-dmgw-dev rpm] QLIK_CUSTOMER_AGREEMENT_ACCEPT=yes rpm -ivh qlik-data-gateway-data-movement.rpm
|
||
warning: qlik-data-gateway-data-movement.rpm: Header V4 RSA/SHA512 Signature, key ID 0a45233c: NOKEY
|
||
Verifying... ################################# [100%]
|
||
Preparing... ################################# [100%]
|
||
Updating / installing...
|
||
1:qlik-data-gateway-data-movement-2################################# [100%]
|
||
|
||
To set up connectivity between the Data Movement gateway and your Qlik Cloud tenant,
|
||
change your working directory to /opt/qlik/gateway/movement/bin and perform the following steps:
|
||
1.Set the Qlik Cloud tenant URL by running:
|
||
$ ./repagent agentctl qcs set_config --tenant_url URL
|
||
(where URL is replaced by the actual URL e.g. mytenant.us.qlikcloud.com)
|
||
2.Generate a registration key by running:
|
||
$ ./repagent agentctl qcs get_registration
|
||
The key is used to establish an authenticated connection between the Data Movement gateway and your Qlik Cloud tenant.
|
||
3.Create a Data Movement gateway in Management Console and paste the generated key into the “Key” field.
|
||
4.After the Data Movement gateway has been created in Management Console, start the data gateway service by running (as root):
|
||
$ systemctl start repagent
|
||
[root@vsrv-qlik-dmgw-dev rpm] cd /opt/qlik/gateway/movement/bin/
|
||
[root@vsrv-qlik-dmgw-dev bin] ls
|
||
agentctl arep_csv2prq fix_permissions kinit libmongocrypt.so nav_util repctl.cfg uconv
|
||
agentctl.dll.config arep_login.sh irpcd klist libsolclient.so repagent repctl.sh upgrade_services.sh
|
||
arepbq arep.sh kdestroy libe_sqlite3.so makeconv repctl site_arep_login.sh
|
||
[root@vsrv-qlik-dmgw-dev bin] ./repagent agentctl qcs set_config --tenant_url hoyer.de.qlikcloud.com
|
||
````
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev etc] nvim fstab
|
||
[root@vsrv-qlik-dmgw-dev bin] cat fstab
|
||
|
||
````
|
||
|
||
````shell
|
||
[root@vsrv-qlik-dmgw-dev rpm] cd /opt/qlik/gateway/movement/drivers/bin/
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install mysql
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install sqlserver
|
||
[root@vsrv-qlik-dmgw-dev bin] ./install postgres
|
||
[root@vsrv-qlik-dmgw-dev bin] systemctl restart repagent
|
||
````
|
||
|
||
## Unteraufgaben
|
||
|
||
- [x] Hoyer Installation Data Movement Gateway on vsrv-qlik-dmgw-dev [start:: 2026-04-21] [scheduled:: 2026-04-22] [completion:: 2026-04-23]
|
||
- [x] Verzeichnis /opt nicht als Mountpoint eingerichtet mit mindestens 300GB Kapazität [[Viktor Becker]] [start:: 2026-04-21] [scheduled:: 2026-04-22] [completion:: 2026-04-22]
|
||
- [x] Anfrage bezüglich Erweiterung Festplattenkapazität weitergeleitet [start:: 2026-04-22] [scheduled:: 2026-04-22] [completion:: 2026-04-22]
|
||
- [x] Konfiguration des Mountpoint /opt zur Einrichtung von Project-Quotas [completion:: 2026-04-27]
|
||
- [x] Installation des MySQL Datenbanktreibers [completion:: 2026-04-27]
|
||
- [x] Installation des MS-SQL Datenbanktreibers [start:: 2026-04-27] [scheduled:: 2026-04-28] [completion:: 2026-04-28]
|