Integration of QuickEMU with Open OnDemand

Shadowphax · June 20, 2023, 10:20am

Good Day,

I am looking to make use of Open OnDemand to front the QuickEMU project. It would be great for our researchers to spin up ephemeral instances of various operating systems or applications which provide visualization capabilities or a suite of applications specific to a research domain within HPC. I am aware of on-premise cloud solutions which will provide this but Open OnDemand provides a one-click up-and-running interface ( Science Gateway ) approach to lower the barriers.

Just putting the idea out there or if anyone has done something similar with another tool, let me know.

Cheers
Tim

jeff.ohrstrom · July 5, 2023, 5:35pm

Hi! Thanks for the topic. I’m not aware of anyone who’s implemented QuickEMU as an adapter (that’s the term we use to talk about different schedulers).

I know someone has done something with OpenStack, though to my knowledge it was never open sourced.

pescobar · July 6, 2023, 7:24am

We use Open Ondemand with a slurm cluster using cloud scheduling on top of an OpenStack cloud to start/stop the Ondemand nodes dynamically. We deploy and configure slurm using this ansible role GitHub - scicore-unibas-ch/ansible-role-slurm: Configure a slurm cluster

If you don’t have an Openstack cloud deploying it only for this use case can be overkill but maybe you can adapt the slurm config in your environment so the slurm master uses the QuickEMU api instead of the openstack api. In our setup the slurm master is using these two scripts to start/stop the machines using the Openstack api, you would only need to adapt those two script to use the quickemu api

github.com

scicore-unibas-ch/ansible-role-slurm/blob/master/templates/slurm_resume_openstack.py.j2

#!{{ slurm_openstack_venv_path }}/bin/python3
# -*- coding: utf-8 -*-

# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
#      http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.

""" A Slurm ResumeProgram to create OpenStack instances.

    Usage:

        resume HOSTLIST_EXPRESSION [debug]

This file has been truncated. show original

github.com

scicore-unibas-ch/ansible-role-slurm/blob/master/templates/slurm_suspend_openstack.py.j2

#!{{ slurm_openstack_venv_path }}/bin/python3
# -*- coding: utf-8 -*-

# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
#      http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.

""" A Slurm SuspendProgram to delete OpenStack instances.

    Usage:

        suspend HOSTLIST_EXPRESSION

This file has been truncated. show original

Topic		Replies	Views
Cloud VM support (OpenStack) Feature Requests and Roadmap Discussion feature-request , ondemand2	4	1018	May 26, 2022
New to HPC and Open OnDemand General Discussion	6	605	April 19, 2024
Install on single server Get Help	5	1409	May 26, 2022
Running Open OnDemand in a Docker Swarm Get Help question	4	363	April 26, 2023
SLURM Queue for OnDemand Get Help	2	1080	May 26, 2022

Integration of QuickEMU with Open OnDemand

Related topics