Commit Graph

204 Commits (d1734b30ec57588fe6fbaffe3482453b92e5a949)

Author SHA1 Message Date
Alejandro Sirgo Rica d1734b30ec rest: add fetch param to boot mode configuration
Add "fetch=http://IP_REPO/OGLIVEDIR/filesystem.squashfs" string
to the client boot mode configuration.
2024-10-03 12:17:00 +02:00
OpenGnSys Support Team 89ba3f1b4f src: inet_aton() returns 0 on error
not < 0, fix this.
2024-10-01 12:35:13 +02:00
OpenGnSys Support Team e81685bba0 rest: do not allow two repositories to use the same IP address
repository need to have unique IP address, otherwise bail out.
2024-10-01 12:33:59 +02:00
OpenGnSys Support Team 85ca21be00 rest: validate name in repository/{add,update}
do not allow request without name.
2024-09-30 14:41:49 +02:00
OpenGnSys Support Team 760a82af2c rest: remove unused probe
unused since 87be2ce08
2024-09-30 14:41:49 +02:00
Alejandro Sirgo Rica 491bf6f5e9 rest: add free and used cache to GET /cache/list
Add "used_cache" and "free_cache" fields to the payload of GET
/cache/list.
2024-09-26 12:45:11 +02:00
Alejandro Sirgo Rica c7bfc370ae src: add used_size and free_size to partition data
Extend database table ordenadores_particiones to add new "used_size" and "free_size" fields.

  FIELD       TYPE
| tamano    | bigint   |
| uso       | tinyint  |
| used_size | bigint   |
| free_size | bigint   |

"tamano" is the field storing the total size of the partition.
"uso" is a field storing the integer percentage of use, it is preserved for backwards compatibility with scritps that access the database.
"used_size" and "free_size" contain the used and free partition
size in bytes.

Old response from ogClient for /cache/delete, /cache/fetch
and /image/restore:
{
  'cache': [
    {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
    {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
  ]
}

New response:
{
  'cache': {
    'used_size': 4520232322423,
    'free_size': 48273465287452945,
    'images': [
      {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
      {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
    ]
  }
}

Parse the new "free_size" and "used_size" fields of each partition data in the response payload of /refresh

Parse "free_size" and "used_size" fields of the cache data in the reponse payload of /image/restore, /cache/delete and /cache/fetch

Replace "used_size" field of GET /client/setup with the value
of the new database field "used_size"
2024-09-25 12:09:32 +02:00
OpenGnSys Support Team ad31c3832d rest: remove scheduler code
Put ogserver into diet, remove this feature, including pending command queue.
2024-09-17 17:46:07 +02:00
OpenGnSys Support Team 32b9a53f57 rest: better json clients validation
- check maximum limit of clients
- reject empty array
2024-09-17 17:46:00 +02:00
Alejandro Sirgo Rica e3a73a504f rest: add GET /efi
Add GET /efi request to obtain information about the client's
boot entries.

Field inside the /refresh payload
'efi': {
  'entries': [
    {
      "order": 0,
      "name": "Boot0000",
      "active": false,
      "description": "grub"
    },
    {
      "order": 1,
      "name": "Boot0001",
      "active": true,
      "description": "UEFI: PXE IP4 Realtek PCIe GBE Family Controller"
    }
  ]
}

If the client is not a EFI system it won't add the 'efi' field.
If an entry is not in the boot order it won't have the 'order' field.

GET /efi resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
}

GET /efi response's structure:
{
  'clients': [
    {
      'ip': '10.141.10.21',
      'entries': [
        {
          "order": 0,
          "name": "Boot0000",
          "active": false,
          "description": "grub"
        },
        {
          "order": 1,
          "name": "Boot0001",
          "active": true,
          "description": "UEFI: PXE IP4 Realtek PCIe GBE Family Controller"
        }
      ]
    },
    {
      'ip': '10.141.10.22',
      'entries': []
    }
  ]
}

The client with ip 10.141.10.22 is a BIOS system.

If an entry does not appear in the boot order it won't have the
'order' field.
2024-09-11 14:09:51 +02:00
OpenGnSys Support Team 1fa3813b92 rest: restore change client repository
use correct format for mac SQL query to fix 568d709
2024-09-10 14:22:38 +02:00
OpenGnSys Support Team 568d709361 rest: use integer for repository ID
ID is integer, fix inconsistency in dc68d0f ('rest: add POST /client/repo')
2024-09-09 16:18:26 +02:00
OpenGnSys Support Team 7977711ee9 rest: use integer for server id
id is not a string, use integer instead
2024-09-03 14:24:09 +02:00
OpenGnSys Support Team 38076677c7 rest: memleak in error path of image/create
if obtaining repository IP fails, json object for client is leaked, move it
after query to infer repository IP.
2024-08-30 13:04:34 +02:00
OpenGnSys Support Team 8c37aa3688 rest: adapt cache/fetch to support repository with multiple IP adddress
take repository_id as json attributo, then infer repository IP from client.
2024-08-30 13:03:22 +02:00
OpenGnSys Support Team d8af32cbcb rest: adapt restore/image to support repository with multiple IP adddress
take repository_id as json attributo, then infer repository IP from client.
2024-08-30 13:01:54 +02:00
OpenGnSys Support Team cd9650108a src: infer server IP when it has more than one IP address
infer server IP for a given client. User does not have to attach a client to
a given server IP anymore through ordenadores.identorno.

this simplifies previous work to allow a server to have more than one IP address

a0a3470682 ('#1074 rest: set_mode: add support for different ogserver addresses')
44745a3f22 ('rest: add POST client/server method')

POST /client/server is removed, it is only used by ogcli and explicit association
between server and client is not required.

server_id json attribute is also removed in GET client/info.
2024-08-28 15:28:47 +02:00
OpenGnSys Support Team 5eba9f4e1b rest: allow repository to have more than one IP address
Repository can have more than one single IP address.

* Add alias field to database to represent the extra IPs that are attached to
  the repository, update schema and add version 9.
* Use og_dbi_get_repository_ip() to infer the repository IP address.
* Add helper functions (src/repo.c) to build a list of repositories and update
  rest API to use it.
2024-08-21 21:58:48 +02:00
Alejandro Sirgo Rica 4e0f9aac9e rest: simplify SQL in set_client_mode
Build boot file parameters in C and simplify SQL statement that
obtains the client configuration from the database.
2024-08-21 21:33:51 +02:00
OpenGnSys Support Team 1d64b21241 rest: use json integer for repository id instead of string
use integer not string, it breaks backwards compatibility.
2024-08-21 21:33:46 +02:00
Alejandro Sirgo Rica d383ff1c1a rest: add cache/fetch
Add POST cache/fetch request to request download of images in
the client's cache.

Resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
    'image': 'windows.img'
    'type': 'TIPTORRENT'
    'repository': '12.141.10.2'
}

The clients listed in the 'clients' field will receive a
cache/fetch POST request with the payload received by the server
without the 'clients' field.
The clients respond with the contents of their cache so the server
can update the database.
2024-08-09 10:47:18 +02:00
OpenGnSys Support Team 6bc71b201d rest: use JSON_ENSURE_ASCII in json dumps
escape non-ascii characters in json otherwise ogclient len() and Content-Length:
report a mismatch when utf-8 representation is used in any of the string fields.
For consistency, enable this flag too for json dumps that are consumed by ogcp
and ogcli.
2024-08-06 16:50:55 +02:00
OpenGnSys Support Team a67c0d3d57 dbi: use repository_id field if front-end offers it
If repository_id json field is provided, use it to narrow down the image lookup.

After this, search use this same repository ID to fetch the IP address.

Old web console may not provide repository_id, infer it from the image name.

Always set image id field for creation and update.
2024-07-19 14:20:16 +02:00
Alejandro Sirgo Rica 075725b1fe rest: delete pxe files on client delete and update
call og_delete_tftpboot_file for both pxe configuration files
in client/delete and client/update.
Delete files for client/update only if the MAC changes.
2024-07-18 09:26:11 +02:00
Alejandro Sirgo Rica 8a23579cab rest: update client ip in /client/update
Use idordenador as discriminator value instead of the client's ip.
Update client ip if the new ip is not used by other clients.
2024-07-18 09:26:11 +02:00
OpenGnSys Support Team e9a8f467f1 rest: add GET,POST /image/restrict
Allow to restrict image to scope:

 POST /image/restrict
 { "image" : 49, "scopes" : [ 1,3 ] }

 response: 200 OK

This restricts image with ID 49 to scopes 1 and 3.

You can also fetch the current list of restrictions:

 GET /image/restrict
 { "image" : 49 }

 response: 200 OK

 { "image" : 49, "scopes" : [ 1,3 ] }

Existing limitations in this interface:

 - Only restriction of image to center is possible at this moment.
 - This is only used by ogCP to validate if this is possible, no existing code
   in the ogserver uses this to restrict POST image/restore.

This is a usability feature.
2024-07-17 17:15:27 +02:00
Alejandro Sirgo Rica e62a55ae37 src: port setclientmode code to C
Implement most of the code from the script setclientmode into
ogServer to improve error handling and logs.

Use a reduced version legacy script to replace the contents of
the base PXE template. This file is now called updategrubprofile.
Add updategrubprofile to the new extras/ folder.

Create BIOS and UEFI files for PXE boot configuration. Each file
is located in a different directory and requires a different name
pattern.

-BIOS-
File format:
/opt/opengnsys/tftpboot/menu.lst/01-XX-XX-XX-XX-XX-XX

Template dir:
/opt/opengnsys/tftpboot/menu.lst/templates/

-UEFI-
File format:
/opt/opengnsys/tftpboot/grub/01-xx:xx:xx:xx:xx:xx

Template dir:
/opt/opengnsys/tftpboot/grub/templates/
2024-07-16 13:44:40 +02:00
Alejandro Sirgo Rica 59ccaaebf6 rest: replace strcat with strncat in og_set_client_mode
Improve string handling security by replacing strcat with the
more secure strncat.
2024-07-15 14:25:22 +02:00
Alejandro Sirgo Rica d6284b6138 rest: add dbi query checks in og_set_client_mode
Check if the the execution of the main SQL query is not
successfull.
2024-07-15 14:25:22 +02:00
Alejandro Sirgo Rica 3bfdf6b477 rest: add default value to og_set_client_mode vga field
Define a default value of 788 for the vga field to assign the
value from ogServer instead of modifying it through the legacy
script setclientmode.
2024-07-15 14:23:06 +02:00
OpenGnSys Support Team 3f02d64104 rest: add checksum to GET /images
Add a new checksum attribute to GET /images, extend database to add a new
checksum field to images table.
2024-07-05 13:32:31 +02:00
OpenGnSys Support Team 23bd5f1a07 rest: create new shell folder automagically
If folder does not exist, create it.

This makes it easier to transition from existing deployments.
2024-06-28 15:29:24 +02:00
Alejandro Sirgo Rica 814daceeee rest: enable shell/output as a GET request
shell/output does not modify state, add check to consider GET
shell/output a valid request.

Keep POST shell/output compatibility.
2024-06-25 13:50:15 +02:00
Alejandro Sirgo Rica c0ca4b8cbc rest: add shell/list
Add GET shell/list request to obtain the list of scripts available
in /opt/opengnsys/client/shell

Resquest payload structure: no paylaod

Response's structure:
{
    'scripts': ['script', 'script2']
}
2024-06-25 13:50:10 +02:00
OpenGnSys Support Team 51dd1c4b1a rest: shell/output does not fail if command was never run
skip including client in the listing if command never run or it did not finished
yet.
2024-06-21 15:23:27 +02:00
OpenGnSys Support Team 6a65b72114 rest: add timestamp to shell/output
Provide a timestamp that tells when the command output from client was received.
2024-06-21 15:12:39 +02:00
OpenGnSys Support Team 6cbe69e89e rest: add cmd to shell/output
Add "cmd" field to json that provides the original command string, so it is
provided with the output and the return code.
2024-06-21 15:05:26 +02:00
OpenGnSys Support Team 12d5caf6a6 rest: add retcode to shell/output
Add retcode field to specify return code of shell invocation.
2024-06-21 14:12:02 +02:00
Alejandro Sirgo Rica 98fab52b74 rest: fix memory leak in folder/delete
Free dbi result after use in og_delete_computer_folder().
2024-06-18 11:22:21 +02:00
OpenGnSys Support Team 86beb111d4 rest: Add /client/move
Add URI to allow a POST request to move clients to a new room/folder.

Request POST /client/move:

    {
      "clients": [
        "192.168.56.11"
      ],
      "room": 10,
      "folder_id": 0,
    }

If folder_id is zero then that means computer is not stored in a folder.
2024-06-17 13:35:19 +02:00
Alejandro Sirgo Rica 5103a2eacd rest: allow the same center name in center update
Exclude centerid of the center we update from the search of
centers with the same name.
Report when other center have the same name as the one in the
payload of the update request.
2024-06-12 12:44:11 +02:00
Alejandro Sirgo Rica cdc339659f rest: validate mac in client/update
Check if the requested new MAC exists in another client and refuse
update request if that's the case.
2024-06-12 11:42:33 +02:00
Alejandro Sirgo Rica c4d71193a5 rest: fix memory leak in client/update
Free dbi result after use in og_cmd_post_client_update().
2024-06-12 11:42:33 +02:00
OpenGnSys Support Team 9891276246 rest: Add /center/info
Add URI to allow a GET request to obtain info about a center (name, id
and comment of the center as of now).

To use this uri, simply send a GET request with a json containing the id
of the center whose info needs to be consulted:

curl -X GET -H "Authorization: $API_KEY" http://127.0.0.1:8888/center/info -d '{"id":1}'

based on work from Javier Hernandez.
2024-06-12 11:38:08 +02:00
Alejandro Sirgo Rica 111f077d17 rest: add cache/delete
Add POST cache/delete request to request deletion of images in
the client's cache.

Resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
    'images': ['windows.img', 'linux.img']
}

The clients listed in the 'clients' field will receive a
cache/delete POST request with the 'clients' field removed and
only containing 'images' from the payload received by the server.
Each client will try to delete as many images as available in
their cache from the list of files in 'images'.
The clients will give response with the contents of the cache so
the server can update the database.
2024-05-30 11:16:25 +02:00
Alejandro Sirgo Rica 6666aba8b7 rest: add cache/list
Add GET cache/list request to obtain information about the client's
cache.

Resquest payload structure:
{
    'clients': ['10.141.10.21', '10.141.10.22']
}

Response's structure:
{
    'clients': [
        {
            'ip': '10.141.10.21',
            'cache_size': 2894572304857,
            'images': [
                {name:'img1', size: 87283902343, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
                {name:'img2', size: 894572304857, checksum: '3eb22f888f88a55ad954f55644e1192e'}
            ]
        },
        {
            'ip': '10.141.10.22',
            'cache_size': 49872839023434,
            'images': [
                {name:'img2', size: 894572304857, checksum: '3eb22f888f88a55ad954f55644e1192e'}
            ]
        }
    ]
}

Both 'cache_size' and the values in 'image_sizes' are provided
as bytes.

If a client has no cache partition the payload will include it as:
...
	{
            'ip': '10.141.10.22',
            'cache_size': 0,
            'images': []
        }
...
2024-05-30 11:16:20 +02:00
OpenGnSys Support Team b63bbfd832 rest: extend GET /session to support for more than one client
GET /session only supports for one single client IP address, extend
it to remove this artificial limit.

Add "clients" json attribute which is an alias of the existing "client"
for consistency with other existing endpoints.
2024-05-14 18:02:01 +02:00
Alejandro Sirgo Rica 5ea25a11b2 rest: delete images that belong to deleted centers
When og_cmd_post_center_delete is invoked by the REST API the
images that contain the same id as the center being deleted are
also deleted.

Move the image deletion functionality into its own function called
og_delete_image to prevent code duplication as it is now required
in og_cmd_post_center_delete and og_cmd_delete_image.
2024-02-19 12:46:51 +01:00
OpenGnSys Support Team abfe81c1fa rest: remove .full.sum file when image is removed
Remove .full.sum file too when user requests to remove an image.
2024-02-15 13:12:25 +01:00
Alejandro Sirgo Rica 892f049135 rest: allow room update keeping the same name
Fix the code tha checked the existence of other rooms with the same
name in the center but only check the rooms other than the one being
updated.
2024-02-13 12:14:24 +01:00