Commit Graph

576 Commits (38076677c7113bae4b50f7989ec45ebf521eae23)
 

Author SHA1 Message Date
Jose M. Guisado 829f8d8ac9 #997 Remove unnecessary strdup in og_dbi_queue_*
After executing an scheduled command/proc/task valgrind reported
leaks inside og_dbi_queue_{command,procedure,task}. String
duplication is not being freed after using them.

==21281== 36 bytes in 1 blocks are definitely lost in loss record 470 of
592
...
==21281==    by 0x113DCB: og_dbi_queue_procedure (rest.c:2748)
==21281==    by 0x113F91: og_dbi_queue_task (rest.c:2804)
==21281==    by 0x114392: og_schedule_run (rest.c:2916)
==21281==    by 0x112059: og_agent_timer_cb (schedule.c:441)
...
==21281==    by 0x10E2A5: main (main.c:100)

These strdup are not necessary because the dbi result is not freed
before using them, it's safe to use the dbi result's reference to
this string.

Fix previous memleaks when executing scheduled commands, procedures
and tasks.
2021-03-11 14:39:07 +01:00
Jose M. Guisado e68fefeac7 #997 Set stale check flag when processing schedule/create
If you schedule a command in the past, the scheduler executes such
command immediately.

When expanding a schedule that result in commands that run weekly,
commands in the past are also executed, which is not expected.

Fix this by using the check_stale flag (formerly on_start) so
commands in the past that result from expansions are skipped.
2021-03-11 12:22:36 +01:00
Jose M. Guisado 76e6375720 #1004 Fix memleak in og_cmd_images
image_json object is created to store the json representation of
an image returned by the database. This object is going to be appended
to a json list that will compose the overall root json object.

Use json_array_append_new to let "images" steal the reference of
image_json so when further decref(root) there is no json reference
hanging around.
2021-02-24 14:33:22 +01:00
OpenGnSys Support Team 1c52b78e72 #942 memleak in og_send_request() 2021-02-23 12:35:53 +01:00
OpenGnSys Support Team 0d9d72eb42 #980 memleak in json ogclient path 2021-02-23 12:35:16 +01:00
OpenGnSys Support Team 9b708e0a7b #942 memleak in error path
Fix memleaks in error path.

json_decref() checks for null objects.
2021-02-23 12:32:57 +01:00
Javier Sánchez Parra 7caffaf56c #915 Fix big request test
ogServer now responses with "413 Payload Too Large" when the payload is
too large.
2021-02-23 11:38:06 +01:00
Javier Sánchez Parra f798e03e18 #915 Add Valgrind to python tests
ogServer has some memory bugs we want to solve and avoid in the future.
Run ogServer with Valgrind to help us find those errors.
2021-02-23 10:53:00 +01:00
Jose M. Guisado a46b69b590 #990 Fix og_cmd_wol memory leak
Allocated strings using dbi_result_get_string_copy are not being freed
after using them. This patch fix this memory leak.

Fixes: e4cb91b ("#990 wol: migrate mac and netmask query to ogServer")
2021-02-23 10:49:12 +01:00
OpenGnSys Support Team 3b3405bc2f #1019 UAF in schedule run
Otherwise accessing IP address results in use-after-free.
2021-02-23 10:48:13 +01:00
Javier Sánchez Parra 031e5708d3 #915 Fix test POST /wol
Commit e4cb91b changed MAC and netmask retrieving, now ogServer take these
addresses from the database instead of from the JSON.

Remove MAC and netmask from the JSON body.
2021-02-23 10:46:46 +01:00
Javier Sánchez Parra ed0d86b010 #1019 Fix queued Wake on LAN
UMA and UPV report that Wake on LAN command (in queue mode) does not
work.

We improved WoL command, now ogServer calculates the broadcast address
of the network to which the client belongs. To calculate this address
ogServer needs the IP and the netmask of the client. We updated ogServer
to retrieve the netmask from the database in non-queue mode, but we forgot
to add this in queue mode.

This patch adds netmask retrieving to queued WoL.
2021-02-22 11:05:34 +01:00
Jose M. Guisado e4cb91b5f6 #990 wol: migrate mac and netmask query to ogServer
ogServer WoL rest function is expecting ip, mac and netmask from the
request's payload. This makes the client responsible for providing such
data.

ogServer should be the owner of the database, this patch adjusts the
parameter expected in a request payload for /wol action so clients only
need to provide the ips and wol type (broadcast, unicast).

Database is expected to contain valid data for the netmask and mac of
target computers.
2021-02-15 16:26:21 +01:00
OpenGnSys Support Team 6ced18fcd8 #915 refresh SQL schema
Bring updates from opengnsys repository.
2021-02-09 13:16:53 +01:00
Jose M. Guisado 4d2e1dd31c #1004 Fix client setup disk size showing as 0
og_cmd_get_client_setup is querying the database for computers disk
setup information. This includes the size of a disk or a partition,
which are stored as BIGINT in the database.

Using dbi_result_get_int will result in an error as libdbi expects to
store this kind of data type in a long long instead of an int.

Fix disk size variable declaration and use the correct dbi_result_get
function for this particular data column.
2021-02-09 13:13:53 +01:00
Javier Sánchez Parra 6a7a846e6e #1019 Fix setup legacy string parser
UMA reports that the setup command (in queue mode) does not work.

WebConsole stores queued commands in the database using the deprecated
SocketHidra legacy string format and ogServer parses them with sscanf().
The setup command has a new field "ttp" since commit 0dd3edd, however,
the ogServer legacy parser was not updated to use this new field.

This patch adds legacy setup support to work with GPT tables. Add new field
table type to legacy setup that expects a string with "MSDOS" or "GPT".
2021-02-08 22:38:25 +01:00
Javier Sánchez Parra 0e4857a538 #1019 Fix restore-image legacy string parser
UMA reports that the restore image command (in queue mode) does not work,
the non-queue mode works fine though.

WebConsole stores queued commands in the database using the deprecated
SocketHidra legacy string format and ogServer parses them with sscanf().
The restore-image command has the field "ptc" which stores a string
with whitespaces, however, ogServer expects no whitespaces ("%s").

Update parser to read until carriage return, whitespaces included.
2021-02-08 22:36:29 +01:00
OpenGnSys Support Team f3905fe0f9 #1021 remove LOG_DEBUG syslog
Some distros enable *.* in syslog.conf to add all logging information
to /var/log/syslog. The existing LOG_DEBUG syslog() entries that ogserver
generates fill up the log files very quickly. Remove most of the LOG_DEBUG
syslog() calls.
2021-02-04 13:36:15 +01:00
OpenGnSys Support Team 0a09c5b09c #1022 increase maximum API REST request size
Software inventory generates a request larger that 64 Kbytes.
Rise the maximum API REST request size to 128 Kbytes.
2021-02-04 13:29:24 +01:00
Jose M. Guisado 85d092864c #802 add uefi folder for post_modes pxe template lookup
When executing og_cmd_post_modes ogServer is looking up for the template
related to the mode coming as a parameter. This lookup is only done for
the bios boot mode. (ie. /opt/opengnsys/tftpboot/menu.lst/templates/)

Templates can be created for a given boot mode, for example you can
create a UEFI-only template (it.
/opt/opengnsys/tftpboot/grub/templates).

When a UEFI only template was coming as a parameter to og_cmd_post_modes
the file can't be located because the UEFI template folder is never
tested.

Add UEFI folder to the lookup of pxe templates, try this folder if bios
mode fails.

PS: Later on a bash script "setclientmode" is to be executed, which will
take its own way of updating these pxe files (ie. templates/../), this
script updates every boot mode if an available template is found.
2021-01-13 09:58:22 +01:00
Isabel Arrans 1472ff276f #915 add test POST /client/delete 2020-12-17 19:18:54 +01:00
Diego Crespo Quinta 1ed772ba80 #915 Fix GET /software test 2020-12-15 20:03:46 +01:00
Isabel Arrans 10b07ba2b9 #915 Fix test POST /client/add 2020-12-15 20:02:46 +01:00
Isabel Arrans 646355d3c7 #915 Fix GET /client/info test 2020-12-15 20:01:51 +01:00
Diego Crespo Quinta be9816eb4e #915 Add GET /software test 2020-12-12 19:32:39 +01:00
Diego Crespo Quinta ca633e62fe #915 Add GET /hardware test 2020-12-12 19:32:11 +01:00
Isabel Arrans 6386d37bf9 #915 Test for GET /client/info and POST /client/add 2020-12-11 23:16:43 +01:00
Javier Sánchez Parra 6d628dc1b2 #1010 Fix /software missing body in queued mode
ogServer do not send /software parameters to ogClient in queued mode.

Add parameters as JSON body.
2020-12-02 14:11:55 +01:00
Javier Sánchez Parra 8d914564c8 #1010 Adapt ogServer to send GET /software
ogClient changed /software from POST to GET.

Adapt ogServer to work with ogClient /software new method.
2020-12-02 14:11:49 +01:00
Diego Crespo Quinta a043fca7f8 #915 Add POST /mode test 2020-12-02 09:50:03 +01:00
Diego Crespo Quinta 5b42e34b59 #915 Fix POST /setup test
Add new type field to json.
2020-12-02 09:48:13 +01:00
Diego Crespo Quinta aeb53bd351 #915 Test GET /scopes
And fix ogserver, report error if GET /scopes have a JSON body.
2020-12-01 19:29:37 +01:00
Javier Sánchez Parra 0dd3edd27c #1008 Add support to work with GPT tables
ogServer /setup do not support to indicate which table type the user
want to use. It always supposes that the partition table is MBR/MSDOS.

Add ogServer support to work with GPT tables. Add new field table type
to /setup that expects a string with "MSDOS" or "GPT".

Example old JSON:
{
  "clients": [...],
  "disk": "1",
  "cache": "0",
  "cache_size": "0",
  "partition_setup": [...]
}

Example new JSON:
{
  "clients": [...],
  "type": "GPT",
  "disk": "1",
  "cache": "0",
  "cache_size": "0",
  "partition_setup": [...]
}
2020-11-27 12:52:21 +01:00
Javier Sánchez Parra 24e6fbf1de #1008 Restore support for 4 disks and 16 partitions
ogServer expects to receive information of 1 disk and 4 partitions
from ogClient. Previous ogServer versions support several disks and
partitions.

Add ogServer support for 4 disks and 16 partitions.
2020-11-18 13:10:34 +01:00
Diego Crespo Quinta 727f31a88b #915 add GET /session test 2020-11-17 00:33:23 +01:00
Isabel Arrans 8bb855344c #915 test malformed body in GET /client/setup 2020-11-10 14:47:47 +01:00
Isabel Arrans 09a064c3ff #915 fix POST /hardware test 2020-10-27 17:05:01 +01:00
Javier Sánchez Parra 4f5c357dcd #941 Fix get computer center id
Creating a software profile failed. ogServer obtained the information of
a computer without center id because commit cbd9421 removed it
unintentionally, making all computer had center id equal to zero.

This commit restores the gathering of computer center id from the
database.
2020-10-27 17:04:26 +01:00
Isabel Arrans b11608152e #915 restore more tests 2020-10-24 12:53:11 +02:00
OpenGnSys Support Team b0d18cd887 #915 remove old REST API from run-test.sh 2020-10-23 13:27:36 +02:00
Diego Crespo Quinta 45711db04f #915 Fix expected returned codes in GET /session and GET /software tests
Fix incorrect status code.
2020-10-22 22:37:36 +02:00
Diego Crespo Quinta 1d451acff5 #915 Fix several test errors
Test 0006: add json to GET /session and update expected return code.
Test 0012: add json to GET /software and update expected return code (200),
in this case json fields are integer, not string.
Test 0020: remove it, /image/create/incremental does not exist anymore.
Test 0021: same as before for /image/restore/basic
Test 0022: same as before for /image/restore/incremental
Test 0023: rename to test_0020.
2020-10-22 18:58:56 +02:00
Roberto Hueso Gómez 7f5ab4ac35 #942 Add GET /session REST API function
This function returns the installed and available OSs in a client to be
booted from.

Request:
GET /session
{
  "client": ["192.168.56.11"]
}

Response
200 OK
{
  "sessions": [
    {
      "disk": 1,
      "name": "Ubuntu 18.04.4 LTS",
      "partition": 1
    }
  ]
}
2020-10-20 15:34:15 +02:00
Roberto Hueso Gómez 2958d23db2 #942 Use client's IP as filter in GET /hardware
This patch uses client's IP instead of scope ID as a filter for the
request.

Request:
GET /hardware
{
  "client": ["192.168.56.11"]
}

Response:
200 OK
{
  "hardware": [
    {
      "description": "BIOS",
      "type": "Tipo de proceso de arranque"
    },
    {
      "description": "QEMU Standard PC (i440FX + PIIX, 1996)  v.pc-i440fx-5.1",
      "type": "Marca y modelo del equipo"
    },
    {
      "description": "Intel Corp. Intel Core Processor (Haswell, no TSX, IBRS) 2GHz v.pc-i440fx-5.1",
      "type": "Microprocesadores"
    },
    {
      "description": "QEMU  2049MiB  (DIMM 0)",
      "type": "Memorias"
    },
    {
      "description": "Red Hat, Inc. Virtio network device  v.00",
      "type": "Tarjetas de Red"
    }
  ]
}
2020-10-20 13:44:44 +02:00
Roberto Hueso Gómez 25c1c16e99 #942 Add GET /software REST API function
This function retrieves a list of the software installed in a specific
disk and partition of a client. This list can be updated by using POST
/software beforehand.

Request:
GET /software
{
  "client": ["192.168.56.11"],
  "disk": 1,
  "partition": 1
}

Response:
200 OK
{
  "software": [
    "grub-pc-bin 2",
    "grub-pc 2.02",
    "grub2-common 2.02",
    "groff-base 1.22.3",
    "gpg 2.2.4",
    "gnupg-utils 2.2.4",
    "gnupg-l10n 2.2.4",
    "gnupg 2.2.4",
    "gnome-video-effects 0.4.3",
    "gnome-user-guide 3.28.2+git20180715",
    "gnome-user-docs 3.28.2+git20180715",
    "gnome-todo-common 3.28.1",
    "gnome-mines 3.28.0",
    "gnome-menus 3.13.3",
    "gnome-mahjongg 3.22.0",
    "gnome-keyring-pkcs11 3.28.0.2",
    "gnome-keyring 3.28.0.2",
    "gnome-initial-setup 3.28.0",
    "accountsservice 0.6.45"
  ]
}
2020-10-16 14:40:33 +02:00
Roberto Hueso Gómez d8b78bb922 #942 Extend GET /images function
This extension removes replaces the field 'filename' for 'name' and adds
new fields (software_id, type and id). These new fields are useful when
restoring an image.

Request:
GET /images

Response:
200 OK
{
  "disk": {
    "free": 37091418112,
    "total": 52573995008
  },
  "images": [
    {
      "datasize": 5939200000,
      "id": 25,
      "modified": "Wed Oct 14 11:49:00 2020",
      "name": "archlinux",
      "permissions": "744",
      "size": 1844222333,
      "software_id": 19,
      "type": 1
    }
  ]
}
2020-10-14 17:31:43 +02:00
Roberto Hueso Gómez d2f20d0be0 #942 Create DB image when calling POST /image/create
In case the DB entry for an image does not exist when POST /image/create
is called, this patch takes care of calling it.

This adds few optional json parameters to the POST /image/create API. If
optional parameters are included then this patch creates the DB entry,
otherwise it just creates the actual image and updates the existing
entry.

Request:
POST /image/create
{
  "clients":["192.168.56.11"],
  "disk":"1",
  "partition":"1",
  "name":"archlinux",
  "repository":"192.168.56.10",
  "id":"24",
  "code":"131",
  "description":"This is a test",
  "group_id":0,
  "center_id":1
}
Response:
200 OK
2020-10-14 12:05:25 +02:00
Roberto Hueso Gómez 24c8b940e6 Add REST POST /client/delete method
This method deletes a client from the DB.

Request:
POST /client/delete
{
  "clients": ["192.168.56.30"]
}

Response:
200 OK

Co-authored-by: Javier Sánchez Parra <jsanchez@soleta.eu>
2020-10-08 12:56:32 +02:00
Roberto Hueso Gómez 068c0f2794 #915 Use string for tests config port
This adapts the test configuration to the changes made in the commit
fe1ce97c50
2020-10-07 16:56:26 +02:00
Roberto Hueso Gómez 4a06c7a391 #915 Update run-tests.py to the latest changes
This handles changes in:
- The host of the DB.
- New json config file.
2020-10-07 14:05:56 +02:00