Commit Graph

394 Commits (fcfa5f9fbc3b955d746416e30804b19979164ffb)
 

Author SHA1 Message Date
OpenGnSys Support Team fcfa5f9fbc live: add logging to indicate image file copy from samba
For consistency with tiptorrent download.
2024-07-21 21:59:27 +02:00
OpenGnSys Support Team 59ab9204ce utils: consolidate logging to write checksum file to cache
Move log message to function that is called both by unicast and tiptorrent.
2024-07-21 21:56:09 +02:00
OpenGnSys Support Team 8ac8dc306e utils: missing f-string with filesystem resize error
... failed to resize {partdev} with ext4
2024-07-15 09:50:38 +02:00
OpenGnSys Support Team 8453a8d9ca utils: clean up error reporting related to checksum
When checksum is not available, it displays:

(2024-07-15 09:04:14) ogClient: [ERROR] - URL error when fetching checksum: Not Found

"URL error" is leaking an internal implementation details, reword this report.
2024-07-15 09:50:37 +02:00
OpenGnSys Support Team 9d8a95cc74 live: add checksum field to image/create response
Report image checksum to ogserver through HTTP response.
2024-07-15 09:50:30 +02:00
OpenGnSys Support Team 43039749c5 live: check permissions when trying to fetch file via unicast
check sufficient permissions and bail out in case of issues.
2024-06-27 12:16:14 +02:00
OpenGnSys Support Team a9d8cdd210 live: revisit error log when failing to validate checksum
Add explicit check for .full.sum after downloading it.

Rewrite errors log, one of them is misleading when checksum validation
fails, it refers to missing .full.sum, but it could be a different
reason.
2024-06-27 11:46:30 +02:00
Alejandro Sirgo Rica 6282cb41a8 live: add restricted execution mode to shell/run
Try to find the script to run for a shell/run request in
/opt/opengnsys/shell/, restricted mode is enabled if the
script is found.

Excute the script without shell=True and executable=OG_SHELL in
restricted mode.

Restricted mode is a safer execution method as it only executes
code manually defined by the administrator.

Each script needs to define a shebang, this way more than just bash
is supported.
2024-06-25 13:41:41 +02:00
OpenGnSys Support Team 1c9a13cd96 rest: add cmd field to POST /shell/run
echo command that has been run for storage in ogserver, until GET /shell/output
is invoked.
2024-06-21 14:59:48 +02:00
OpenGnSys Support Team 19cd1b9a78 rest: add retcode field to POST /shell/run
provide return code as result to ogserver.

Update virtual mode driver to return dummy value, although this command
is unimplemented, this seems to be broken due to possible TypeError when
accessing result from caller.
2024-06-21 14:47:30 +02:00
Alejandro Sirgo Rica 399a5dceb8 live: handle no cache in tiptorrent and unicast restore
Properly report the lack of cache partition when restoring an
image using TIPTORRENT and UNICAST as methods.
Abort any restore in case of no cache partition.
2024-06-07 10:09:50 +02:00
Alejandro Sirgo Rica ec132cfb95 utils: remove bogus cache not found error after refresh command
Remove log message "Cannot find device path to cache" spamming
logs during operations such as refresh in clients without CACHE
partition.
2024-06-07 09:12:51 +02:00
Alejandro Sirgo Rica 5698aa66d2 utils: fix get_image_info regression
Fix image size, permissions and creation time.
Improve error report related to these parameters now showing the
exact cause of the problem if any occurred during the definition
of image size, file permissions or image creation time values.
2024-06-03 11:29:57 +02:00
OpenGnSys Support Team a1774c795b live: add winrecov partition type
DE94BBA4-06D1-4D40-A16A-BFD50179D6AC is already set in in GUID_MAP as partition
code, but not in GPT_PARTTYPES.
2024-06-02 00:48:31 +02:00
OpenGnSys Support Team d732a214bf live: revisit logging for checksum file creation
Add logging before calculating checksum to provide a hint to user on what is
going on while ogClient is still busy.
2024-05-31 17:26:20 +02:00
Alejandro Sirgo Rica 914bd993fc src: cleanup ogGetImageInfo
Rename ogGetImageInfo to get_image_info.
Move code from ogOperations.py to obtain image data into
get_image_info.
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica 34007857f6 src: rename legacy.py into image.py
legacy.py contais mostly functions related to system images.
Rename the file to better represent the contents in it.
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica 9a5e83ea1a src: stop using hardcoded paths to cache image directory
Use the constant OG_CACHE_IMAGE_PATH from cache.py to obtain the
location of the directory where images are stored.
This way the path can be changed from one single point.
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica dd003e688f tiptorrent: check cache availability in tip_write_csum
Remove old TODO message.
Check if the cache is available before trying to generate an
image's checksum.
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica 60803fe0ed src: add cache info to the image/restore response
Add a 'cache' field into the json payload the client sends to
the server after a restore operation so the server can update
the new cache contents.

Resquest response structure:
{
    ...
    'cache': [
        {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
        {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
    ]
    ...
}
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica 72d8943576 virtual: handle copy error in image restore
Add a proper error report for the shutil.copy operation in
image_restore() instead of silently returning.
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica 8de2b785a9 src: add POST cache/delete method
Add API REST method to delete cache contents.

Resquest payload structure:
{
    'images': ['windows.img', 'linux.img']
}

The client will try to delete as many images in cache as available
with names matching the list of filenames in the 'images' field.

Resquest response structure:
{
    'cache': [
        {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
        {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
    ]
}
2024-05-30 17:22:23 +02:00
Alejandro Sirgo Rica e2d48ba3a0 live: add cache contents to the /refresh payload
Add the list of images in the client's cache partition in the
payload sent to the server.
The information sent is a list of {image_name, img_size, checksum}
elements where img_size is the size of the respective image in bytes.

Resquest response structure:
{
    ...
    'cache': [
        {'name': 'windows.img', 'size': 2432370213, checksum: '5d4dcc677bc19f40a647d0002f4ade90'},
        {'name': 'linux.img', 'size': 243234534213, checksum: '3eb22f888f88a55ad954f55644e1192e'}
    ]
    ...
}
2024-05-30 17:22:18 +02:00
Alejandro Sirgo Rica 03d33d4fa9 utils: cache: redefine cache path constants
Rename OGIMG as OG_IMAGE_PATH.
Rename OGCACHE_MOUNTPOINT as OG_CACHE_PATH.
Define OG_CACHE_IMAGE_PATH as OG_CACHE_PATH + OG_IMAGE_PATH.

This will serve to have a unique point to obtain cache related
paths.
2024-05-27 17:09:10 +02:00
OpenGnSys Support Team 4626383cc4 live: remove unused return value in image_restore()
Never used what configureOs() returns, remove it.
2024-05-27 11:31:19 +02:00
OpenGnSys Support Team 9952c3cc85 live: incorrect reference to image checksum file in logs
checksum file name end by .img.full.sum, not .full.sum
2024-05-25 09:57:17 +02:00
OpenGnSys Support Team fa5b37b2a6 live: rename variable that stores json body in refresh()
Just a simple cleanup.
2024-05-21 11:51:29 +02:00
OpenGnSys Support Team b9ca7278a9 live: parttypes: add EFI partition type in MBR partition scheme
Add 0xef partition type for EFI in MBR.
2024-05-14 11:49:54 +02:00
OpenGnSys Support Team 3eb4332b38 live: partcodes: remove reference to website
Remove reference to external website in code.
2024-05-14 11:35:16 +02:00
OpenGnSys Support Team d109e99dbe utils: rename cache_probe() to get_cache_dev_path()
This method reports the /dev path to cache partition, rename it.

Add explicit check if blkid is successful.

And add logging to report that device path to cache is not found.
2024-05-09 11:47:06 +02:00
Alejandro Sirgo Rica 6bfbf6cc7b utils: add error checks to checksum file creation in tip_write_csum
Add a check for potential permission or IO errors during the
creation of the image checksum.
2024-05-07 20:47:05 +02:00
Alejandro Sirgo Rica abea6583d3 utils: add mkdir error report in mount_mkdir
Add exception checks to the os.mkdir operation and log the error
found. The previous implementation was too optimistic and only
handled mount related errors.
2024-05-07 17:24:41 +02:00
Alejandro Sirgo Rica 493d998a4e utils: remove unused json import
The json library was a dependency during the development of the
boot OS functions and it is no longer needed in that file.
2024-05-07 16:08:38 +02:00
Alejandro Sirgo Rica b0d03ce588 utils:fs: fix logging statement in get_filesystem_type
Call the error() logging function from the logging object instead
of the non existent log variable previously referenced.
2024-05-07 12:20:26 +02:00
Alejandro Sirgo Rica de17bb6812 utils:fs: add mkfs logs when return code is not 0
Report mkfs failure for every partition. This does not raise an
exception as that would skip partprobe operations and the mkfs
operations in the next potentially well formated partitions.
2024-05-07 12:20:26 +02:00
OpenGnSys Support Team 9ffe1c81bf live: report LINUX-SWAP instead of SWAP
ogCP expects LINUX-SWAP to specify a swap filesystem.

Add a similar workaround to the one that is done for VFAT for symmetry between
inputs and outputs that circulate over the API.
2024-05-07 11:54:39 +02:00
OpenGnSys Support Team 1ca3639389 live: rewrite log in case tiptorrent client fails
Specify that image file cannot be found in cache because tiptorrent has failed,
otherwise it is confusing.
2024-05-06 19:10:48 +02:00
OpenGnSys Support Team 8ecd57552a live: restore partprobe before building filesystem
Otherwise mkfs silently fails because OS reports out-of-sync partition table.
2024-05-06 19:08:12 +02:00
OpenGnSys Support Team 2dd5105995 live: force flush to disk after partition table is written 2024-05-06 18:51:57 +02:00
OpenGnSys Support Team f42e2ba201 live: partprobe breaks with mounted partitions
partprobe requires that all disk partitions are unmounted.

partprobe needs to be called to report the OS that the partition table
has changed, otherwise ogclient reports incorrect partition information.

iterate over the partition list and mount cache after partprobe is
called.
2024-05-06 18:33:41 +02:00
OpenGnSys Support Team 170d7e1be9 live: umount all partitions before partition setup
If new partition layout is specified, unmount cache and any other partition
under /mnt.
2024-05-06 18:32:54 +02:00
Alejandro Sirgo Rica 8171ddd15f live: fix omited error report in tip_client_get
tip_client_get raises the proper error exceptions but the except
block in _restore_image_tiptorrent overwrites the reported error.
Move the raise statements in _restore_image_tiptorrent outside
of the except block.
2024-05-06 14:23:29 +02:00
OpenGnSys Support Team 5ea6f73343 live: add fat32 to get_parttype()
Use "Microsoft basic data partition" to store FAT32 in case of GPT partition
scheme and 0xB according in case of MBR partition scheme according to
documentation.
2024-04-23 10:56:44 +02:00
OpenGnSys Support Team 84c2944bf3 live: revisit logging for partition setup, image create and restore 2024-04-23 10:55:37 +02:00
OpenGnSys Support Team 7d26f0f69b utils: add logging for checksum validation
Display if checksum validation is correct or not.
2024-04-22 14:56:09 +02:00
OpenGnSys Support Team 8661a99a36 utils: fs: incorrect indentation 2024-04-22 13:56:39 +02:00
OpenGnSys Support Team bddbea942e utils: fs: skip shrink/extend operation for fat
fat does not support this operation, skip it
2024-04-19 12:19:54 +02:00
OpenGnSys Support Team 481ce5794f utils: fs: remove unused variable in _reduce_resize2fs
ret is set but never used in this method
2024-04-19 11:32:53 +02:00
OpenGnSys Support Team 85bbdcfcb8 utils: fs: report error when failing to grow
not really a warning, report an error instead
2024-04-19 11:32:17 +02:00
OpenGnSys Support Team db23ea76f9 utils: fs: set return value in ogReduceFs
otherwise error path uses uninitialized variable

 File "/opt/opengnsys/ogClient/src/utils/fs.py", line 112, in ogReduceFs
 return ret
 UnboundLocalError: local variable 'ret' referenced before assignment
2024-04-19 11:29:24 +02:00