# Interactive app status change to completed

**URL:** <https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532>\
**Category:** Get Help\
**Created:** [September 22, 2025, 7:54pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532 "2025-09-22T19:54:52Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 22, 2025, 7:54pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/1 "2025-09-22T19:54:52Z")

</div>

Hi,

We have just installed OnDemand 4.0.7. The system is running, but whenever we submit an interactive app, its status immediately changes to “Completed,” even though the job is still running when I check via active tabs.

Could you please advise on how to resolve this? We are using the LSF scheduler.

Thank you,  
Sumit Saluja

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 22, 2025, 8:03pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/2 "2025-09-22T20:03:45Z")

</div>

This can happen when you submit a job through `bsub` but then cannot read back that same job through `bjobs`. When `bjobs` is issued - if OnDemand can’t find the job, if `bjobs` fails for that job id, it assumes it’s completed and thus completes it in the UI.

This can happen when you have two separate portals running and you’re actively interacting with two separate instances of OnDemand and somehow your clusters are setup differently on the two different instances. For example you have a two instances of OnDemand pointing to two different clusters, but both clusters have the same name to OnDemand. I.e., one is a test cluster the other your production cluster.

Basically, you’ve submitted the job to your test cluster, but the other instance of OnDemand is querying the production cluster for that job id, doesn’t find it and completes it.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 22, 2025, 8:19pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/3 "2025-09-22T20:19:39Z")

</div>

I have 2 separate instance of Ondemand, one is version 3 and one is version 4. Both are pointing to same one cluster. Version 3 is running fine everything is as expected as we want. But version 4 has issue.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 22, 2025, 8:22pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/4 "2025-09-22T20:22:30Z")

</div>

This is what logs shows when I submit jobs,  
App 92674 output: [2025-09-22 10:56:24 -0400] INFO “execve = [{“LSF\_BINDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin”, “LSF\_LIBDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib”, “LSF\_ENVDIR”=\>“/hpc/lsf/conf”, “LSF\_SERVERDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc”}, “/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin/bsub”, “-cwd”, “/hpc/users/salujs01/ondemand/data/sys/dashboard/batch\_connect/sys/bc\_desktop/chimera/output/5ed180f3-f747-429a-a79d-7e2501cbe71e”, “-J”, “sys/dashboard/sys/bc\_desktop/chimera”, “-W”, “60”, “-L”, “/bin/bash”, “-o”, “/hpc/users/salujs01/ondemand/data/sys/dashboard/batch\_connect/sys/bc\_desktop/chimera/output/5ed180f3-f747-429a-a79d-7e2501cbe71e/output.log”, “-B”, “-P”, “acc\_hpcstaff”, “-q”, “ondemand”, “-n”, “2”, “-R”, “rusage[mem=3000]”, “-R”, “span[hosts=1]”]”  
App 92674 output: [2025-09-22 10:56:24 -0400] INFO “execve = [{“LSF\_BINDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin”, “LSF\_LIBDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib”, “LSF\_ENVDIR”=\>“/hpc/lsf/conf”, “LSF\_SERVERDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc”}, “/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin/bjobs”, “-a”, “-w”, “-W”, “201941624”]”

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 22, 2025, 8:36pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/5 "2025-09-22T20:36:43Z")

</div>

> [@sumitsaluja](#):
>
> App 92674 output: [2025-09-22 10:56:24 -0400] INFO “execve = [{“LSF\_BINDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin”, “LSF\_LIBDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib”, “LSF\_ENVDIR”=\>“/hpc/lsf/conf”, “LSF\_SERVERDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc”}, “/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin/bjobs”, “-a”, “-w”, “-W”, “201941624”]”

OK, what happens when you issue this same command from the CLI on the same machine that’s running OOD 4.0?

Or conversely, is that the same command issued on the 3.1 instance? And in either case, what does _that_ command return when run on _that_ instance.

Somehow one or both of these instances isn’t able to find this job when querying the scheduler. I’d also double check to be sure that they’re pointing to the same cluster. We do the same thing at OSC, run multiple instances at different versions, but in our case we _always_ point to the same cluster so it’s safe for us. I’ve only ever seen this when two instances point to different clusters that are named the same.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 22, 2025, 8:44pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/6 "2025-09-22T20:44:21Z")

</div>

This is from server which is running OOD4  
[root@ondemand01 ~]# bjobs -a -w -W 201986510  
JOBID USER STAT QUEUE FROM\_HOST EXEC\_HOST JOB\_NAME SUBMIT\_TIME PROJ\_NAME CPU\_USED MEM SWAP PIDS START\_TIME FINISH\_TIME SLOTS  
201986510 salujs01 RUN ondemand ondemand01 2\*lh06c11 sys/dashboard/sys/bc\_desktop/chimera 09/22-16:42:08 acc\_hpcstaff 000:00:01.00 19 0 465717 09/22-16:42:10 - 2

This is from server which is running OOD3

[root@ondemand ~]# bjobs -a -w -W 201986510  
JOBID USER STAT QUEUE FROM\_HOST EXEC\_HOST JOB\_NAME SUBMIT\_TIME PROJ\_NAME CPU\_USED MEM SWAP PIDS START\_TIME FINISH\_TIME SLOTS  
201986510 salujs01 RUN ondemand ondemand01 2\*lh06c11 sys/dashboard/sys/bc\_desktop/chimera 09/22-16:42:08 acc\_hpcstaff 000:00:01.00 19 0 465717 09/22-16:42:10 - 2  
[root@ondemand ~]#

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 22, 2025, 9:12pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/7 "2025-09-22T21:12:15Z")

</div>

> [@sumitsaluja](#):
>
> [root@ondemand01 ~]

Don’t run these commands as root. Run them as your regular user with the environment variables as shown above. Remember the idea here is to replicate what OnDemand is seeing in the shell. to do this, you need to issue the same exact command under the same circumstances.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 23, 2025, 2:01pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/8 "2025-09-23T14:01:12Z")

</div>

Here is as regular user  
(base) [salujs01@ondemand01 ~]$ bjobs -a -w -W 202015200  
JOBID USER STAT QUEUE FROM\_HOST EXEC\_HOST JOB\_NAME SUBMIT\_TIME PROJ\_NAME CPU\_USED MEM SWAP PIDS START\_TIME FINISH\_TIME SLOTS  
202015200 salujs01 RUN ondemand ondemand01 2\*lh06c25 sys/dashboard/sys/bc\_desktop/chimera 09/23-09:56:20 acc\_hpcstaff 000:00:00.00 4 0 1912734,1912889,1912890 09/23-09:56:25 - 2  
(base) [salujs01@ondemand01 ~]$

(base) [salujs01@ondemand ~]$ bjobs -a -w -W 202015200  
JOBID USER STAT QUEUE FROM\_HOST EXEC\_HOST JOB\_NAME SUBMIT\_TIME PROJ\_NAME CPU\_USED MEM SWAP PIDS START\_TIME FINISH\_TIME SLOTS  
202015200 salujs01 RUN ondemand ondemand01 2\*lh06c25 sys/dashboard/sys/bc\_desktop/chimera 09/23-09:56:20 acc\_hpcstaff 000:00:01.00 6 0 1912734,1912889,1912890 09/23-09:56:25 - 2  
(base) [salujs01@ondemand ~]$

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 23, 2025, 2:04pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/9 "2025-09-23T14:04:24Z")

</div>

What about the environment variables? Also when it goes into completed state, is there anything in the logs after the `bjobs` log line?

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 23, 2025, 2:10pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/10 "2025-09-23T14:10:36Z")

</div>

This is environment variables  
(base) [salujs01@ondemand01 ~]$ env|grep lsf  
MANPATH=/hpc/lsf/10.1/man:  
LSF\_SERVERDIR=/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc  
LSF\_LIBDIR=/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib  
LD\_LIBRARY\_PATH=/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib  
LSF\_BINDIR=/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin  
PATH=/hpc/packages/minerva-rocky9/anaconda3/2024.06/bin:/hpc/packages/minerva-rocky9/anaconda3/2024.06/condabin:/hpc/users/salujs01/.local/bin:/hpc/users/salujs01/bin:/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc:/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin  
LSF\_ENVDIR=/hpc/lsf/conf

This after bjobs log line  
INFO “execve = [{“LSF\_BINDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin”, “LSF\_LIBDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/lib”, “LSF\_ENVDIR”=\>“/hpc/lsf/conf”, “LSF\_SERVERDIR”=\>“/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/etc”}, “/hpc/lsf/10.1/linux3.10-glibc2.17-x86\_64/bin/bjobs”, “-a”, “-w”, “-W”, “202015200”]”  
App 19861 output: [2025-09-23 09:56:21 -0400] INFO “method=GET path=/pun/sys/dashboard/batch\_connect/sessions format=html controller=BatchConnect::SessionsController action=index status=200 allocations=240636 duration=390.43 view=210.40”  
App 19861 output: [2025-09-23 09:56:21 -0400] WARN “Announcement file not found: /etc/ood/config/announcement.md”  
App 19861 output: [2025-09-23 09:56:21 -0400] WARN “Announcement file not found: /etc/ood/config/announcement.yml”  
App 19861 output: [2025-09-23 09:56:21 -0400] INFO “method=GET path=/pun/sys/dashboard/apps/icon/bc\_mssm\_matlab/sys/sys format=html controller=AppsController action=icon status=200 allocations=44140 duration=123.19 view=0.00”

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 23, 2025, 4:23pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/11 "2025-09-23T16:23:49Z")

</div>

Do you have the 3.0 window open? Can you try this while only logged into the 4.0 instance? Again, this is an issue of conflicts between these 2 portals. If you’re not accessing the 3.0 portal - then it won’t conflict with the 4.0 portal.

Also please confirm that the cluster.d files are the exact same. Again, we do this at OSC - interact with the same cluster on multiple portals and it works fine. This only happens when there’s some mismatch between the two portals. I.e., they’re actually configured differently or interact with different schedulers that are named the same.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 24, 2025, 4:12pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/12 "2025-09-24T16:12:07Z")

</div>

Hi Jeff,

I have confirmed my 3.0 windows is not opened and 4.0 portal is logged in only and I also confirmed that we have same cluster.d files on both servers.

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 24, 2025, 4:31pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/13 "2025-09-24T16:31:17Z")

</div>

I feel like we’re missing something obvious. Are there any logs on the LSF side that may help us diagnose what’s going on here?

You’re submitting to a queue `ondemand` do you need to specify that queue when you issue `bjobs`?

Also I guess I’d just confirm that when you do this manually you issue `bjobs` you’re in fact using `/hpc/lsf/10.1/linux3.10-glibc2.17-x86_64/bin/bjobs`.

Are both servers using LSF 10.1?

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 24, 2025, 5:19pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/14 "2025-09-24T17:19:06Z")

</div>

We have one cluster /hpc is nfs mounted on all servers same as on demand. So on everywhere we have `/hpc/lsf/10.1/linux3.10-glibc2.17-x86_64/bin/bjobs`  
I noticed bjobs report little late around 5-6 seconds. How can I add delay in dashboard so that it can delayed reporting.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 26, 2025, 9:35pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/15 "2025-09-26T21:35:09Z")

</div>

Hi Jeff  
We have one cluster /hpc is nfs mounted on all servers same as on demand. So on everywhere we have `/hpc/lsf/10.1/linux3.10-glibc2.17-x86_64/bin/bjobs`  
I noticed bjobs report little late around 5-6 seconds. How can I add delay in dashboard so that it can delayed reporting.

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 29, 2025, 2:13pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/16 "2025-09-29T14:13:22Z")

</div>

> [@sumitsaluja](#):
>
> How can I add delay in dashboard so that it can delayed reporting.

You’d have to add it before or after it calls `info` in the source code. Not sure if a delay is going to help anything.

Though I can look up somehow to print out what it’s seeing before it completes.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 29, 2025, 4:38pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/17 "2025-09-29T16:38:34Z")

</div>

Hi Jeff  
I just created a `bjobs` wrapper, added a 3-second sleep, and included that wrapper in the bin overrides. It works, and I can now see jobs on my interactive list. Do you have a better approach I could use instead of adding a sleep?

Sumit Saluja

---

<div class="post-metadata">

**Author:** ![jeff.ohrstrom](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/jeff.ohrstrom/32/136_2.png) [@jeff.ohrstrom](https://discourse.openondemand.org/u/jeff.ohrstrom)\
**Post date:** [September 29, 2025, 5:59pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/18 "2025-09-29T17:59:07Z")

</div>

See I knew it was something simple that we were just missing!

I’d try to lower it to maybe .5 seconds. Or at least keep lowering it until it’s reliably responding.

I’m not sure if there’s any other mechanism we can toggle here.

---

<div class="post-metadata">

**Author:** ![sumitsaluja](https://sea1.discourse-cdn.com/flex015/user_avatar/discourse.openondemand.org/sumitsaluja/32/3022_2.png) [@sumitsaluja](https://discourse.openondemand.org/u/sumitsaluja)\
**Post date:** [September 29, 2025, 8:01pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/19 "2025-09-29T20:01:50Z")

</div>

I tried if I do 2 seconds still see same issue. But now when I try sleep It is taking little time as it has to wait for 3 seconds.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex015/uploads/osc/original/2X/b/bae70bd0ed39a3ae769c2108155f4cb3e9da8385.png) [@system](https://discourse.openondemand.org/u/system)\
**Post date:** [March 28, 2026, 8:02pm UTC](https://discourse.openondemand.org/t/interactive-app-status-change-to-completed/4532/20 "2026-03-28T20:02:28Z")

</div>

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.