Commit Graph

593 Commits (85ca21be00b2521db5c6eb2f4dc6118fd85173ea)
 

Author SHA1 Message Date
OpenGnSys Support Team 85ca21be00 rest: validate name in repository/{add,update}
do not allow request without name.
2024-09-30 14:41:49 +02:00
OpenGnSys Support Team 760a82af2c rest: remove unused probe
unused since 87be2ce08
2024-09-30 14:41:49 +02:00
Alejandro Sirgo Rica 491bf6f5e9 rest: add free and used cache to GET /cache/list
Add "used_cache" and "free_cache" fields to the payload of GET
/cache/list.
2024-09-26 12:45:11 +02:00
OpenGnSys Support Team 3c395ecea2 client: move image list to cache data to consolidate it
Move list of images in the cache to cache_data. Add new functions to
initialize cache data (image list) and release it.
2024-09-25 14:49:17 +02:00
OpenGnSys Support Team 65aee8f3f3 json: move list_head at the tip of struct og_cache_image
this is accessed on list iterations in first place, improve cache locality.
2024-09-25 14:48:49 +02:00
Alejandro Sirgo Rica c7bfc370ae src: add used_size and free_size to partition data
Extend database table ordenadores_particiones to add new "used_size" and "free_size" fields.

  FIELD       TYPE
| tamano    | bigint   |
| uso       | tinyint  |
| used_size | bigint   |
| free_size | bigint   |

"tamano" is the field storing the total size of the partition.
"uso" is a field storing the integer percentage of use, it is preserved for backwards compatibility with scritps that access the database.
"used_size" and "free_size" contain the used and free partition
size in bytes.

Old response from ogClient for /cache/delete, /cache/fetch
and /image/restore:
{
  'cache': [
    {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
    {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
  ]
}

New response:
{
  'cache': {
    'used_size': 4520232322423,
    'free_size': 48273465287452945,
    'images': [
      {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
      {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
    ]
  }
}

Parse the new "free_size" and "used_size" fields of each partition data in the response payload of /refresh

Parse "free_size" and "used_size" fields of the cache data in the reponse payload of /image/restore, /cache/delete and /cache/fetch

Replace "used_size" field of GET /client/setup with the value
of the new database field "used_size"
2024-09-25 12:09:32 +02:00
OpenGnSys Support Team b74a05cf38 client: log error on refresh
Report failure when trying to refresh client information.
2024-09-23 13:51:14 +02:00
OpenGnSys Support Team bdf4c60411 client: remove redundant refresh validation
json parser already validates attributes must be set on.
2024-09-23 13:51:14 +02:00
OpenGnSys Support Team 5d97a721d0 ogAdmServer: replace old actualizaConfiguracion
Reimplement the legacy funcion actualizaConfiguracion with
og_update_client_config in src/client.c

if disk does not exist, add it, otherwise update disk contents.

if partition size, code, filesystem or os is different, reset image id,
otherwise update partition usage only.

delete partitions that are gone at the end.
2024-09-23 13:51:07 +02:00
OpenGnSys Support Team ad31c3832d rest: remove scheduler code
Put ogserver into diet, remove this feature, including pending command queue.
2024-09-17 17:46:07 +02:00
OpenGnSys Support Team 32b9a53f57 rest: better json clients validation
- check maximum limit of clients
- reject empty array
2024-09-17 17:46:00 +02:00
Alejandro Sirgo Rica e3a73a504f rest: add GET /efi
Add GET /efi request to obtain information about the client's
boot entries.

Field inside the /refresh payload
'efi': {
  'entries': [
    {
      "order": 0,
      "name": "Boot0000",
      "active": false,
      "description": "grub"
    },
    {
      "order": 1,
      "name": "Boot0001",
      "active": true,
      "description": "UEFI: PXE IP4 Realtek PCIe GBE Family Controller"
    }
  ]
}

If the client is not a EFI system it won't add the 'efi' field.
If an entry is not in the boot order it won't have the 'order' field.

GET /efi resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
}

GET /efi response's structure:
{
  'clients': [
    {
      'ip': '10.141.10.21',
      'entries': [
        {
          "order": 0,
          "name": "Boot0000",
          "active": false,
          "description": "grub"
        },
        {
          "order": 1,
          "name": "Boot0001",
          "active": true,
          "description": "UEFI: PXE IP4 Realtek PCIe GBE Family Controller"
        }
      ]
    },
    {
      'ip': '10.141.10.22',
      'entries': []
    }
  ]
}

The client with ip 10.141.10.22 is a BIOS system.

If an entry does not appear in the boot order it won't have the
'order' field.
2024-09-11 14:09:51 +02:00
OpenGnSys Support Team 1fa3813b92 rest: restore change client repository
use correct format for mac SQL query to fix 568d709
2024-09-10 14:22:38 +02:00
OpenGnSys Support Team 7f325a4b67 repo: allow 128 IPs per repository
rise this artificial limit.
2024-09-10 12:05:05 +02:00
OpenGnSys Support Team 568d709361 rest: use integer for repository ID
ID is integer, fix inconsistency in dc68d0f ('rest: add POST /client/repo')
2024-09-09 16:18:26 +02:00
OpenGnSys Support Team 4567bce90b src: fallback to use first repository/server found
use first repository/server in the list in case no specific repository/server
is found in the same network, this is a fallback that works if repository/server
is reachable through gateway.
2024-09-04 12:19:58 +02:00
OpenGnSys Support Team 7977711ee9 rest: use integer for server id
id is not a string, use integer instead
2024-09-03 14:24:09 +02:00
OpenGnSys Support Team 38076677c7 rest: memleak in error path of image/create
if obtaining repository IP fails, json object for client is leaked, move it
after query to infer repository IP.
2024-08-30 13:04:34 +02:00
OpenGnSys Support Team 8c37aa3688 rest: adapt cache/fetch to support repository with multiple IP adddress
take repository_id as json attributo, then infer repository IP from client.
2024-08-30 13:03:22 +02:00
OpenGnSys Support Team d8af32cbcb rest: adapt restore/image to support repository with multiple IP adddress
take repository_id as json attributo, then infer repository IP from client.
2024-08-30 13:01:54 +02:00
OpenGnSys Support Team cd9650108a src: infer server IP when it has more than one IP address
infer server IP for a given client. User does not have to attach a client to
a given server IP anymore through ordenadores.identorno.

this simplifies previous work to allow a server to have more than one IP address

a0a3470682 ('#1074 rest: set_mode: add support for different ogserver addresses')
44745a3f22 ('rest: add POST client/server method')

POST /client/server is removed, it is only used by ogcli and explicit association
between server and client is not required.

server_id json attribute is also removed in GET client/info.
2024-08-28 15:28:47 +02:00
OpenGnSys Support Team 9ee9d66b7c schema: incorrect error log
fix incorrect error report when updating table.
2024-08-28 13:01:11 +02:00
OpenGnSys Support Team 5eba9f4e1b rest: allow repository to have more than one IP address
Repository can have more than one single IP address.

* Add alias field to database to represent the extra IPs that are attached to
  the repository, update schema and add version 9.
* Use og_dbi_get_repository_ip() to infer the repository IP address.
* Add helper functions (src/repo.c) to build a list of repositories and update
  rest API to use it.
2024-08-21 21:58:48 +02:00
Alejandro Sirgo Rica 4e0f9aac9e rest: simplify SQL in set_client_mode
Build boot file parameters in C and simplify SQL statement that
obtains the client configuration from the database.
2024-08-21 21:33:51 +02:00
OpenGnSys Support Team 1d64b21241 rest: use json integer for repository id instead of string
use integer not string, it breaks backwards compatibility.
2024-08-21 21:33:46 +02:00
Alejandro Sirgo Rica d383ff1c1a rest: add cache/fetch
Add POST cache/fetch request to request download of images in
the client's cache.

Resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
    'image': 'windows.img'
    'type': 'TIPTORRENT'
    'repository': '12.141.10.2'
}

The clients listed in the 'clients' field will receive a
cache/fetch POST request with the payload received by the server
without the 'clients' field.
The clients respond with the contents of their cache so the server
can update the database.
2024-08-09 10:47:18 +02:00
OpenGnSys Support Team 6bc71b201d rest: use JSON_ENSURE_ASCII in json dumps
escape non-ascii characters in json otherwise ogclient len() and Content-Length:
report a mismatch when utf-8 representation is used in any of the string fields.
For consistency, enable this flag too for json dumps that are consumed by ogcp
and ogcli.
2024-08-06 16:50:55 +02:00
OpenGnSys Support Team a675dbb083 client: split revision query when updating image information
a simple cleanup to help diagnose problems, not behaviour change expected.
2024-07-19 14:23:30 +02:00
OpenGnSys Support Team a67c0d3d57 dbi: use repository_id field if front-end offers it
If repository_id json field is provided, use it to narrow down the image lookup.

After this, search use this same repository ID to fetch the IP address.

Old web console may not provide repository_id, infer it from the image name.

Always set image id field for creation and update.
2024-07-19 14:20:16 +02:00
Alejandro Sirgo Rica 075725b1fe rest: delete pxe files on client delete and update
call og_delete_tftpboot_file for both pxe configuration files
in client/delete and client/update.
Delete files for client/update only if the MAC changes.
2024-07-18 09:26:11 +02:00
Alejandro Sirgo Rica 8a23579cab rest: update client ip in /client/update
Use idordenador as discriminator value instead of the client's ip.
Update client ip if the new ip is not used by other clients.
2024-07-18 09:26:11 +02:00
OpenGnSys Support Team e9a8f467f1 rest: add GET,POST /image/restrict
Allow to restrict image to scope:

 POST /image/restrict
 { "image" : 49, "scopes" : [ 1,3 ] }

 response: 200 OK

This restricts image with ID 49 to scopes 1 and 3.

You can also fetch the current list of restrictions:

 GET /image/restrict
 { "image" : 49 }

 response: 200 OK

 { "image" : 49, "scopes" : [ 1,3 ] }

Existing limitations in this interface:

 - Only restriction of image to center is possible at this moment.
 - This is only used by ogCP to validate if this is possible, no existing code
   in the ogserver uses this to restrict POST image/restore.

This is a usability feature.
2024-07-17 17:15:27 +02:00
Alejandro Sirgo Rica e62a55ae37 src: port setclientmode code to C
Implement most of the code from the script setclientmode into
ogServer to improve error handling and logs.

Use a reduced version legacy script to replace the contents of
the base PXE template. This file is now called updategrubprofile.
Add updategrubprofile to the new extras/ folder.

Create BIOS and UEFI files for PXE boot configuration. Each file
is located in a different directory and requires a different name
pattern.

-BIOS-
File format:
/opt/opengnsys/tftpboot/menu.lst/01-XX-XX-XX-XX-XX-XX

Template dir:
/opt/opengnsys/tftpboot/menu.lst/templates/

-UEFI-
File format:
/opt/opengnsys/tftpboot/grub/01-xx:xx:xx:xx:xx:xx

Template dir:
/opt/opengnsys/tftpboot/grub/templates/
2024-07-16 13:44:40 +02:00
Alejandro Sirgo Rica df52acba04 src: add str_toupper and str_tolower functions
Add auxiliar string case change functions.
2024-07-15 16:36:45 +02:00
Alejandro Sirgo Rica 59ccaaebf6 rest: replace strcat with strncat in og_set_client_mode
Improve string handling security by replacing strcat with the
more secure strncat.
2024-07-15 14:25:22 +02:00
Alejandro Sirgo Rica d6284b6138 rest: add dbi query checks in og_set_client_mode
Check if the the execution of the main SQL query is not
successfull.
2024-07-15 14:25:22 +02:00
Alejandro Sirgo Rica 3bfdf6b477 rest: add default value to og_set_client_mode vga field
Define a default value of 788 for the vga field to assign the
value from ogServer instead of modifying it through the legacy
script setclientmode.
2024-07-15 14:23:06 +02:00
OpenGnSys Support Team 88330288e6 client: fortify check for mandatory cmd json field in shell/output
Revisit 6cbe69e89e ("rest: add cmd to shell/output") to reject response with
no 'cmd' field, otherwise strdup() crashes when dealing with NULL string.

Set retcode to zero, otherwise this value remains uninitialized if no retcode
json field is provided by the client.
2024-07-15 11:56:26 +02:00
OpenGnSys Support Team 3f02d64104 rest: add checksum to GET /images
Add a new checksum attribute to GET /images, extend database to add a new
checksum field to images table.
2024-07-05 13:32:31 +02:00
OpenGnSys Support Team 23bd5f1a07 rest: create new shell folder automagically
If folder does not exist, create it.

This makes it easier to transition from existing deployments.
2024-06-28 15:29:24 +02:00
Alejandro Sirgo Rica 814daceeee rest: enable shell/output as a GET request
shell/output does not modify state, add check to consider GET
shell/output a valid request.

Keep POST shell/output compatibility.
2024-06-25 13:50:15 +02:00
Alejandro Sirgo Rica c0ca4b8cbc rest: add shell/list
Add GET shell/list request to obtain the list of scripts available
in /opt/opengnsys/client/shell

Resquest payload structure: no paylaod

Response's structure:
{
    'scripts': ['script', 'script2']
}
2024-06-25 13:50:10 +02:00
OpenGnSys Support Team 51dd1c4b1a rest: shell/output does not fail if command was never run
skip including client in the listing if command never run or it did not finished
yet.
2024-06-21 15:23:27 +02:00
OpenGnSys Support Team 6a65b72114 rest: add timestamp to shell/output
Provide a timestamp that tells when the command output from client was received.
2024-06-21 15:12:39 +02:00
OpenGnSys Support Team 6cbe69e89e rest: add cmd to shell/output
Add "cmd" field to json that provides the original command string, so it is
provided with the output and the return code.
2024-06-21 15:05:26 +02:00
OpenGnSys Support Team 12d5caf6a6 rest: add retcode to shell/output
Add retcode field to specify return code of shell invocation.
2024-06-21 14:12:02 +02:00
Alejandro Sirgo Rica 98fab52b74 rest: fix memory leak in folder/delete
Free dbi result after use in og_delete_computer_folder().
2024-06-18 11:22:21 +02:00
OpenGnSys Support Team 86beb111d4 rest: Add /client/move
Add URI to allow a POST request to move clients to a new room/folder.

Request POST /client/move:

    {
      "clients": [
        "192.168.56.11"
      ],
      "room": 10,
      "folder_id": 0,
    }

If folder_id is zero then that means computer is not stored in a folder.
2024-06-17 13:35:19 +02:00
Alejandro Sirgo Rica 5103a2eacd rest: allow the same center name in center update
Exclude centerid of the center we update from the search of
centers with the same name.
Report when other center have the same name as the one in the
payload of the update request.
2024-06-12 12:44:11 +02:00
Alejandro Sirgo Rica cdc339659f rest: validate mac in client/update
Check if the requested new MAC exists in another client and refuse
update request if that's the case.
2024-06-12 11:42:33 +02:00