Authentication failed / Client temporarily blocked errors when connecting to a running session

Get Help
1

Hi,

We’re having this issue on OOD3.0 where a running session after a while stops allowing users to connect to it. When attempting to connect to a session, users see the following even though they’re logged in to ood already.

image
image

output.log logs from one of the sessions here:

Setting VNC password...
Starting VNC server...

WARNING:server1.example.com:5 is taken because of /tmp/.X5-lock
Remove this file if there is no X server aspmgui03.all.space:5
Killing Xvnc process ID 1978870
Xvnc process ID 1978870 already killed
Xvnc did not appear to shut down cleanly. Removing /tmp/.X11-unix/X5
Xvnc did not appear to shut down cleanly. Removing /tmp/.X5-lock

WARNING: server1.exaple.com:2 is taken because of /tmp/.X2-lock
Remove this file if there is no X server aspmgui03.all.space:2

Desktop 'TurboVNC: server1.example.com:5 (manas-suleman)' started on display server1.example.com:5

Log file is vnc.log
Successfully started VNC server on server1.example.com:5905...
Script starting...
Starting websocket server...
ERROR: Collection default cannot be found
+ cd /mnt/nfs/home/manas-suleman
+ export ANS_IGNOREOS=1
+ ANS_IGNOREOS=1
+ export ANS_DEPCHECK=0
+ ANS_DEPCHECK=0
+ echo 'Launching app...'
Launching app...
+ vglrun -d egl0 -v /mnt/nfs/tools/centos7/ansys_inc/v251/AnsysEM/ansysedt
+ export XDG_CACHE_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/cache
+ XDG_CACHE_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/cache
+ export XDG_CONFIG_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/config
+ XDG_CONFIG_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/config
+ export XDG_DATA_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/share
+ XDG_DATA_HOME=/mnt/nfs/home/manas-suleman/ondemand/data/sys/dashboard/batch_connect/sys/bc_ansys_ansysedt/output/ca0084ef-0deb-444f-a62a-b458557f470b/share
WebSocket server settings:
  - Listen on :64530
++ dbus-launch --sh-syntax
  - No SSL/TLS support (no cert file)
  - Backgrounding (daemon)
Scanning VNC log file for user authentications...
Generating connection YAML file...
+ eval 'DBUS_SESSION_BUS_ADDRESS='\''unix:abstract=/tmp/dbus-hy1zRNgbv3,guid=dd81ad725891762ad4de37be682dde10'\'';' export 'DBUS_SESSION_BUS_ADDRESS;' 'DBUS_SESSION_BUS_PID=2062965;' 'DBUS_SESSION_BUS_WINDOWID=2097153;'
++ DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-hy1zRNgbv3,guid=dd81ad725891762ad4de37be682dde10
++ export DBUS_SESSION_BUS_ADDRESS
++ DBUS_SESSION_BUS_PID=2062965
++ DBUS_SESSION_BUS_WINDOWID=2097153
+ xfsettingsd --daemon --display=:5 --sm-client-disable
+ xfwm4 --compositor=off --display=:5 --sm-client-disable
+ xfce4-panel --display=:5 --sm-client-disable
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.

(xfwm4:2062978): GLib-CRITICAL **: 15:07:13.116: g_str_has_prefix: assertion 'prefix != NULL' failed

(xfsettingsd:2062981): GLib-CRITICAL **: 15:07:13.134: g_str_has_prefix: assertion 'prefix != NULL' failed

(xfsettingsd:2062981): GLib-GObject-CRITICAL **: 15:07:13.151: g_value_get_string: assertion 'G_VALUE_HOLDS_STRING (value)' failed

(xfsettingsd:2062981): GLib-GObject-CRITICAL **: 15:07:13.152: g_value_get_string: assertion 'G_VALUE_HOLDS_STRING (value)' failed

(xfsettingsd:2062981): GLib-GObject-CRITICAL **: 15:07:13.158: g_value_get_string: assertion 'G_VALUE_HOLDS_STRING (value)' failed
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
xfce4-panel-Message: 15:07:13.825: Plugin "(null)-7" was not found and has been removed from the configuration
xfce4-panel-Message: 15:07:13.852: Plugin "notification-plugin-10" was not found and has been removed from the configuration
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libdlfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object 'libvglfaker.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.

** (wrapper-2.0:2063060): WARNING **: 15:07:14.849: No outputs have backlight property

(wrapper-2.0:2063071): libactions-WARNING **: 15:07:14.981: Calling CanShutdown failed GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.xfce.SessionManager was not provided by any .service files

(wrapper-2.0:2063071): libactions-WARNING **: 15:07:14.982: Calling CanRestart failed GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.xfce.SessionManager was not provided by any .service files

(wrapper-2.0:2063071): libactions-WARNING **: 15:07:14.982: Calling CanSuspend failed GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.xfce.SessionManager was not provided by any .service files

(wrapper-2.0:2063071): libactions-WARNING **: 15:07:14.982: Calling CanHibernate failed GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.xfce.SessionManager was not provided by any .service files

(wrapper-2.0:2063071): libactions-WARNING **: 15:07:14.982: Calling CanHybridSleep failed GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.xfce.SessionManager was not provided by any .service files

(wrapper-2.0:2063060): xfce4-power-manager-plugin-WARNING **: 15:07:14.995: Xfce4-power-manager: The panel plugin is present, so the tray icon gets disabled.

(wrapper-2.0:2063059): libnotify-WARNING **: 15:07:15.034: Failed to connect to proxy

(wrapper-2.0:2063060): Gtk-WARNING **: 15:07:15.051: Negative content width -3 (allocation 1, extents 2x2) while allocating gadget (node button, owner PowerManagerButton)

(wrapper-2.0:2063059): Gtk-WARNING **: 15:07:15.072: Negative content width -3 (allocation 1, extents 2x2) while allocating gadget (node button, owner PulseaudioButton)
Setting VNC password...
Generating connection YAML file...
Setting VNC password...
Generating connection YAML file...

We’re using SLURM as the scheduler, LDAP for auth and issue started just today.

output for /var/log/httpd/error_log:

[Wed May 21 15:54:48.518771 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 68498 still did not exit, sending a SIGTERM
[Wed May 21 15:54:48.518873 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 71760 still did not exit, sending a SIGTERM
[Wed May 21 15:54:50.521032 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 68498 still did not exit, sending a SIGTERM
[Wed May 21 15:54:50.521112 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 71760 still did not exit, sending a SIGTERM
[Wed May 21 15:54:52.523323 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 68498 still did not exit, sending a SIGTERM
[Wed May 21 15:54:52.523408 2025] [core:warn] [pid 2741059:tid 140664478079296] AH00045: child process 71760 still did not exit, sending a SIGTERM
[Wed May 21 15:54:54.525631 2025] [core:error] [pid 2741059:tid 140664478079296] AH00046: child process 68498 still did not exit, sending a SIGKILL
[Wed May 21 15:54:54.525864 2025] [core:error] [pid 2741059:tid 140664478079296] AH00046: child process 71760 still did not exit, sending a SIGKILL
[Wed May 21 15:54:55.527826 2025] [mpm_event:notice] [pid 2741059:tid 140664478079296] AH00491: caught SIGTERM, shutting down
[Wed May 21 15:54:56.007284 2025] [core:notice] [pid 711760:tid 139918748178752] SELinux policy enabled; httpd running as context system_u:system_r:httpd_t:s0
[Wed May 21 15:54:56.008673 2025] [suexec:notice] [pid 711760:tid 139918748178752] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Wed May 21 15:54:56.057139 2025] [lbmethod_heartbeat:notice] [pid 711760:tid 139918748178752] AH02282: No slotmem from mod_heartmonitor
[Wed May 21 15:54:56.069300 2025] [mpm_event:notice] [pid 711760:tid 139918748178752] AH00489: Apache/2.4.37 (Rocky Linux) OpenSSL/1.1.1k configured -- resuming normal operations
[Wed May 21 15:54:56.069329 2025] [core:notice] [pid 711760:tid 139918748178752] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'

Please suggest what could be the error and how to resolve this?

2

Hmmm, maybe you can share the other logs. IIRC off the top of my head there are 2 others like vnc.log and websockify.log?

3

@jeff.ohrstrom of course.

vnc.log:

TurboVNC Server (Xvnc) 64-bit v3.1 (build 20231117)
Copyright (C) 1999-2023 The VirtualGL Project and many others (see README.md)
Visit http://www.TurboVNC.org for more information on TurboVNC

21/05/2025 15:07:10 Using security configuration file /etc/turbovncserver-security.conf
21/05/2025 15:07:10 Enabled security type 'tlsvnc'
21/05/2025 15:07:10 Enabled security type 'tlsotp'
21/05/2025 15:07:10 Enabled security type 'tlsplain'
21/05/2025 15:07:10 Enabled security type 'x509vnc'
21/05/2025 15:07:10 Enabled security type 'x509otp'
21/05/2025 15:07:10 Enabled security type 'x509plain'
21/05/2025 15:07:10 Enabled security type 'vnc'
21/05/2025 15:07:10 Enabled security type 'otp'
21/05/2025 15:07:10 Enabled security type 'unixlogin'
21/05/2025 15:07:10 Enabled security type 'plain'
21/05/2025 15:07:10 Desktop name 'TurboVNC: server1.example.com:5 (manas-suleman)' (server1.example.com:5)
21/05/2025 15:07:10 Protocol versions supported: 3.3, 3.7, 3.8, 3.7t, 3.8t
21/05/2025 15:07:10 Listening for VNC connections on TCP port 5905
21/05/2025 15:07:10   Interface 0.0.0.0
21/05/2025 15:07:10 Framebuffer: BGRX 8/8/8/8
21/05/2025 15:07:10 New desktop size: 2560 x 1355
21/05/2025 15:07:10 New screen layout:
21/05/2025 15:07:10   0x00000040 (output 0x00000040): 2560x1355+0+0
21/05/2025 15:07:10 Maximum clipboard transfer size: 1048576 bytes
21/05/2025 15:07:10 VNC extension running!

21/05/2025 15:07:21 Got connection from client 127.0.0.1
21/05/2025 15:07:21 Normal socket connection
21/05/2025 15:07:21 Using protocol version 3.8
21/05/2025 15:07:21 Enabling TightVNC protocol extensions
21/05/2025 15:07:21 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:07:21 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:07:21 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:07:21 Full-control authentication enabled for 127.0.0.1
21/05/2025 15:07:21 Pixel format for client 127.0.0.1:
21/05/2025 15:07:21   32 bpp, depth 24, little endian
21/05/2025 15:07:21   true colour: max r 255 g 255 b 255, shift r 0 g 8 b 16
21/05/2025 15:07:21 Using tight encoding for client 127.0.0.1
21/05/2025 15:07:21 rfbProcessClientNormalMessage: ignoring unknown encoding -260 (fffffefc)
21/05/2025 15:07:21 Using JPEG subsampling 0, Q100 for client 127.0.0.1
21/05/2025 15:07:21 Interframe comparison enabled
21/05/2025 15:07:21 Enabling Desktop Size protocol extension for client 127.0.0.1
21/05/2025 15:07:21 Enabling LastRect protocol extension for client 127.0.0.1
21/05/2025 15:07:21 Enabling QEMU Extended Key Event protocol extension for client 127.0.0.1
21/05/2025 15:07:21 Enabling Extended Desktop Size protocol extension for client 127.0.0.1
21/05/2025 15:07:21 rfbProcessClientNormalMessage: ignoring unknown encoding -309 (fffffecb)
21/05/2025 15:07:21 Enabling Fence protocol extension for client 127.0.0.1
21/05/2025 15:07:21 Enabling Continuous Updates protocol extension for client 127.0.0.1
21/05/2025 15:07:21 rfbProcessClientNormalMessage: ignoring unknown encoding -307 (fffffecd)
21/05/2025 15:07:21 Enabling Extended Clipboard protocol extension for client 127.0.0.1
21/05/2025 15:07:21 rfbProcessClientNormalMessage: ignoring unknown encoding 1464686180 (574d5664)
21/05/2025 15:07:21 Enabling full-color cursor updates for client 127.0.0.1
21/05/2025 15:07:21 Using Tight compression level 1 for client 127.0.0.1
21/05/2025 15:07:21 WARNING: Disabling QEMU Extended Key Event extension because neither LED state
21/05/2025 15:07:21   extension is supported by the client.
21/05/2025 15:07:21 Using 4 threads for Tight encoding
21/05/2025 15:07:22 Client clipboard capabilities:
21/05/2025 15:07:22 - Plain text (limit = 0 bytes)
21/05/2025 15:07:22 Continuous updates enabled
21/05/2025 15:07:22 New desktop size: 1912 x 954
21/05/2025 15:07:22 Interframe comparison disabled
21/05/2025 15:07:22 Interframe comparison enabled
21/05/2025 15:07:22 New screen layout:
21/05/2025 15:07:22   0x00000000 (output 0x00000040): 1912x954+0+0
21/05/2025 15:07:22 Continuous updates enabled
21/05/2025 15:07:22 WARNING: Framebuffer update at 0,0 with dimensions 2560x1355 has been clipped to the screen boundaries
21/05/2025 15:07:22 Continuous updates enabled
21/05/2025 15:07:22 Continuous updates enabled
21/05/2025 15:07:23 New screen layout:
21/05/2025 15:07:23   0x00000000 (output 0x00000040): 1912x954+0+0
21/05/2025 15:07:23 Continuous updates enabled
21/05/2025 15:07:23 Continuous updates enabled
21/05/2025 15:11:48 Client 127.0.0.1 gone
21/05/2025 15:11:48 Statistics:
21/05/2025 15:11:48   key events received 0, pointer events 287
21/05/2025 15:11:48   framebuffer updates 248, rectangles 860, bytes 1558284
21/05/2025 15:11:48     LastRect markers 87, bytes 1044
21/05/2025 15:11:48     cursor shape updates 62, bytes 242304
21/05/2025 15:11:48     CopyRect rectangles 22, bytes 352
21/05/2025 15:11:48     Tight rectangles 689, bytes 1314584
21/05/2025 15:11:48   raw equivalent 56.977760 Mbytes, compression ratio 43.342807
21/05/2025 15:11:48 Interframe comparison disabled

21/05/2025 15:11:52 Got connection from client 127.0.0.1
21/05/2025 15:11:52 Normal socket connection
21/05/2025 15:11:52 Using protocol version 3.8
21/05/2025 15:11:52 Enabling TightVNC protocol extensions
21/05/2025 15:11:52 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:11:52 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:11:52 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:11:52 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 15:11:52 Client 127.0.0.1 gone
21/05/2025 15:11:52 Statistics:
21/05/2025 15:11:52   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 15:26:02 Got connection from client 127.0.0.1
21/05/2025 15:26:02 Normal socket connection
21/05/2025 15:26:02 Using protocol version 3.8
21/05/2025 15:26:02 Enabling TightVNC protocol extensions
21/05/2025 15:26:02 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:26:02 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:26:02 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:26:02 Full-control authentication enabled for 127.0.0.1
21/05/2025 15:26:02 Pixel format for client 127.0.0.1:
21/05/2025 15:26:02   32 bpp, depth 24, little endian
21/05/2025 15:26:02   true colour: max r 255 g 255 b 255, shift r 0 g 8 b 16
21/05/2025 15:26:02 Using tight encoding for client 127.0.0.1
21/05/2025 15:26:02 rfbProcessClientNormalMessage: ignoring unknown encoding -260 (fffffefc)
21/05/2025 15:26:02 Using JPEG subsampling 0, Q100 for client 127.0.0.1
21/05/2025 15:26:02 Interframe comparison enabled
21/05/2025 15:26:02 Enabling Desktop Size protocol extension for client 127.0.0.1
21/05/2025 15:26:02 Enabling LastRect protocol extension for client 127.0.0.1
21/05/2025 15:26:02 Enabling QEMU Extended Key Event protocol extension for client 127.0.0.1
21/05/2025 15:26:02 Enabling Extended Desktop Size protocol extension for client 127.0.0.1
21/05/2025 15:26:02 rfbProcessClientNormalMessage: ignoring unknown encoding -309 (fffffecb)
21/05/2025 15:26:02 Enabling Fence protocol extension for client 127.0.0.1
21/05/2025 15:26:02 Enabling Continuous Updates protocol extension for client 127.0.0.1
21/05/2025 15:26:02 rfbProcessClientNormalMessage: ignoring unknown encoding -307 (fffffecd)
21/05/2025 15:26:02 Enabling Extended Clipboard protocol extension for client 127.0.0.1
21/05/2025 15:26:02 rfbProcessClientNormalMessage: ignoring unknown encoding 1464686180 (574d5664)
21/05/2025 15:26:02 Enabling full-color cursor updates for client 127.0.0.1
21/05/2025 15:26:02 Using Tight compression level 1 for client 127.0.0.1
21/05/2025 15:26:02 WARNING: Disabling QEMU Extended Key Event extension because neither LED state
21/05/2025 15:26:02   extension is supported by the client.
21/05/2025 15:26:02 Using 4 threads for Tight encoding
21/05/2025 15:26:02 Client clipboard capabilities:
21/05/2025 15:26:02 - Plain text (limit = 0 bytes)
21/05/2025 15:26:02 Continuous updates enabled
21/05/2025 15:26:02 New screen layout:
21/05/2025 15:26:02   0x00000000 (output 0x00000040): 1912x954+0+0
21/05/2025 15:26:02 Continuous updates enabled
21/05/2025 15:26:03 Continuous updates enabled
21/05/2025 15:26:03 Continuous updates enabled
21/05/2025 15:47:14 Client 127.0.0.1 gone
21/05/2025 15:47:14 Statistics:
21/05/2025 15:47:14   key events received 0, pointer events 21
21/05/2025 15:47:14   framebuffer updates 25, rectangles 101, bytes 503957
21/05/2025 15:47:14     LastRect markers 22, bytes 264
21/05/2025 15:47:14     cursor shape updates 2, bytes 6624
21/05/2025 15:47:14     Tight rectangles 77, bytes 497069
21/05/2025 15:47:14   raw equivalent 7.877112 Mbytes, compression ratio 15.847120
21/05/2025 15:47:14 Interframe comparison disabled

21/05/2025 15:47:16 Got connection from client 127.0.0.1
21/05/2025 15:47:16 Normal socket connection
21/05/2025 15:47:16 Using protocol version 3.8
21/05/2025 15:47:16 Enabling TightVNC protocol extensions
21/05/2025 15:47:16 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:47:16 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:47:16 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:47:16 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 15:47:16 Client 127.0.0.1 gone
21/05/2025 15:47:16 Statistics:
21/05/2025 15:47:16   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 15:55:10 Got connection from client 127.0.0.1
21/05/2025 15:55:10 Normal socket connection
21/05/2025 15:55:10 Using protocol version 3.8
21/05/2025 15:55:10 Enabling TightVNC protocol extensions
21/05/2025 15:55:10 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:55:10 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:55:10 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:55:10 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 15:55:10 Client 127.0.0.1 gone
21/05/2025 15:55:10 Statistics:
21/05/2025 15:55:10   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 15:57:27 Got connection from client 127.0.0.1
21/05/2025 15:57:27 Normal socket connection
21/05/2025 15:57:27 Using protocol version 3.8
21/05/2025 15:57:27 Enabling TightVNC protocol extensions
21/05/2025 15:57:27 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 15:57:27 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 15:57:27 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 15:57:27 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 15:57:27 Client 127.0.0.1 gone
21/05/2025 15:57:27 Statistics:
21/05/2025 15:57:27   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 16:12:48 Got connection from client 127.0.0.1
21/05/2025 16:12:48 Normal socket connection
21/05/2025 16:12:48 Using protocol version 3.8
21/05/2025 16:12:48 Enabling TightVNC protocol extensions
21/05/2025 16:12:48 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 16:12:48 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 16:12:48 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 16:12:48 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 16:12:48 Client 127.0.0.1 gone
21/05/2025 16:12:48 Statistics:
21/05/2025 16:12:48   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 16:27:21 Got connection from client 127.0.0.1
21/05/2025 16:27:21 Normal socket connection
21/05/2025 16:27:21 Using protocol version 3.8
21/05/2025 16:27:21 Enabling TightVNC protocol extensions
21/05/2025 16:27:21 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 16:27:21 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 16:27:21 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 16:27:21 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 16:27:21 Client 127.0.0.1 gone
21/05/2025 16:27:21 Statistics:
21/05/2025 16:27:21   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 16:27:44 Got connection from client 127.0.0.1
21/05/2025 16:27:44 Normal socket connection
21/05/2025 16:27:44 Using protocol version 3.8
21/05/2025 16:27:44 Enabling TightVNC protocol extensions
21/05/2025 16:27:44 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 16:27:44 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 16:27:44 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 16:27:44 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 16:27:44 Client 127.0.0.1 gone
21/05/2025 16:27:44 Statistics:
21/05/2025 16:27:44   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 16:37:35 Got connection from client 127.0.0.1
21/05/2025 16:37:35 Normal socket connection
21/05/2025 16:37:35 Using protocol version 3.8
21/05/2025 16:37:35 Enabling TightVNC protocol extensions
21/05/2025 16:37:35 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 16:37:35 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 16:37:35 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 16:37:35 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 16:37:35 Client 127.0.0.1 gone
21/05/2025 16:37:35 Statistics:
21/05/2025 16:37:35   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 17:17:03 Got connection from client 127.0.0.1
21/05/2025 17:17:03 Normal socket connection
21/05/2025 17:17:03 Using protocol version 3.8
21/05/2025 17:17:03 Enabling TightVNC protocol extensions
21/05/2025 17:17:03 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 17:17:03 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 17:17:03 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 17:17:03 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 17:17:03 Client 127.0.0.1 gone
21/05/2025 17:17:03 Statistics:
21/05/2025 17:17:03   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 17:21:30 Got connection from client 127.0.0.1
21/05/2025 17:21:30 Normal socket connection
21/05/2025 17:21:31 Using protocol version 3.8
21/05/2025 17:21:31 Enabling TightVNC protocol extensions
21/05/2025 17:21:31 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 17:21:31 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 17:21:31 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 17:21:31 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 17:21:31 Client 127.0.0.1 gone
21/05/2025 17:21:31 Statistics:
21/05/2025 17:21:31   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 17:35:32 Got connection from client 127.0.0.1
21/05/2025 17:35:32 Normal socket connection
21/05/2025 17:35:32 Using protocol version 3.8
21/05/2025 17:35:32 Enabling TightVNC protocol extensions
21/05/2025 17:35:32 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 17:35:32 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 17:35:32 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 17:35:32 rfbVncAuthProcessResponse: authentication failed from 127.0.0.1
21/05/2025 17:35:32 Client 127.0.0.1 gone
21/05/2025 17:35:32 Statistics:
21/05/2025 17:35:32   framebuffer updates 0, rectangles 0, bytes 0

21/05/2025 21:15:08 Got connection from client 127.0.0.1
21/05/2025 21:15:08 Normal socket connection
21/05/2025 21:15:08 Using protocol version 3.8
21/05/2025 21:15:08 Enabling TightVNC protocol extensions
21/05/2025 21:15:08 Advertising Tight auth cap 'VENCRYPT'
21/05/2025 21:15:08 Advertising Tight auth cap 'VNCAUTH_'
21/05/2025 21:15:08 Advertising Tight auth cap 'ULGNAUTH'
21/05/2025 21:15:08 Full-control authentication enabled for 127.0.0.1
21/05/2025 21:15:08 Pixel format for client 127.0.0.1:
21/05/2025 21:15:08   32 bpp, depth 24, little endian
21/05/2025 21:15:08   true colour: max r 255 g 255 b 255, shift r 0 g 8 b 16
21/05/2025 21:15:08 Using tight encoding for client 127.0.0.1
21/05/2025 21:15:08 rfbProcessClientNormalMessage: ignoring unknown encoding -260 (fffffefc)
21/05/2025 21:15:08 Using JPEG subsampling 0, Q100 for client 127.0.0.1
21/05/2025 21:15:08 Interframe comparison enabled
21/05/2025 21:15:08 Enabling Desktop Size protocol extension for client 127.0.0.1
21/05/2025 21:15:08 Enabling LastRect protocol extension for client 127.0.0.1
21/05/2025 21:15:08 Enabling QEMU Extended Key Event protocol extension for client 127.0.0.1
21/05/2025 21:15:08 Enabling Extended Desktop Size protocol extension for client 127.0.0.1
21/05/2025 21:15:08 rfbProcessClientNormalMessage: ignoring unknown encoding -309 (fffffecb)
21/05/2025 21:15:08 Enabling Fence protocol extension for client 127.0.0.1
21/05/2025 21:15:08 Enabling Continuous Updates protocol extension for client 127.0.0.1
21/05/2025 21:15:08 rfbProcessClientNormalMessage: ignoring unknown encoding -307 (fffffecd)
21/05/2025 21:15:08 Enabling Extended Clipboard protocol extension for client 127.0.0.1
21/05/2025 21:15:08 rfbProcessClientNormalMessage: ignoring unknown encoding 1464686180 (574d5664)
21/05/2025 21:15:08 Enabling full-color cursor updates for client 127.0.0.1
21/05/2025 21:15:08 Using Tight compression level 1 for client 127.0.0.1
21/05/2025 21:15:08 WARNING: Disabling QEMU Extended Key Event extension because neither LED state
21/05/2025 21:15:08   extension is supported by the client.
21/05/2025 21:15:08 Using 4 threads for Tight encoding
21/05/2025 21:15:08 Client clipboard capabilities:
21/05/2025 21:15:08 - Plain text (limit = 0 bytes)
21/05/2025 21:15:08 Continuous updates enabled
21/05/2025 21:15:08 New desktop size: 1528 x 834
21/05/2025 21:15:08 Interframe comparison disabled
21/05/2025 21:15:08 Interframe comparison enabled
21/05/2025 21:15:08 New screen layout:
21/05/2025 21:15:08   0x00000000 (output 0x00000040): 1528x834+0+0
21/05/2025 21:15:08 Continuous updates enabled
21/05/2025 21:15:08 WARNING: Framebuffer update at 0,0 with dimensions 1912x954 has been clipped to the screen boundaries
21/05/2025 21:15:08 Continuous updates enabled
21/05/2025 21:15:08 Continuous updates enabled
21/05/2025 21:15:09 New screen layout:
21/05/2025 21:15:09   0x00000000 (output 0x00000040): 1528x834+0+0
21/05/2025 21:15:09 Continuous updates enabled
21/05/2025 21:15:09 Continuous updates enabled
21/05/2025 21:31:46 Client 127.0.0.1 gone
21/05/2025 21:31:46 Statistics:
21/05/2025 21:31:46   key events received 2, pointer events 80
21/05/2025 21:31:46   framebuffer updates 34, rectangles 186, bytes 714902
21/05/2025 21:31:46     LastRect markers 26, bytes 312
21/05/2025 21:31:46     cursor shape updates 5, bytes 17484
21/05/2025 21:31:46     Tight rectangles 155, bytes 697106
21/05/2025 21:31:46   raw equivalent 18.116996 Mbytes, compression ratio 25.988868
21/05/2025 21:31:46 Interframe comparison disabled

can’t find any websockify log file unfortunately.

4

OK I am re-reading your initial comment and re-thinking this now. These passwords are 1 time use passwords. So, for example, refreshing the page does not work with these sessions.

What users need to do to re-connect is to navigate back to OnDemand and press the button to connect again as the button has the new password available. I.e., you can’t just refresh the original page, because it’s already used the 1 time password. As soon as you use this password, it generates another one.

So I’d ask when you say

I’d ask how they are attempting to connect to an existing session? Through the OnDemand card that says Launch <app> or are they refreshing the page they had opened in the past?

5

@jeff.ohrstrom I could see the issue on my end as well. And I was always trying by clicking the Launch app but no luck. Is there a chance the password wasn’t updating with each click to the Launch button? It would be great if there’s a way to enable some debug logging that can report on if password is changing or not.

I wanted to restart the OOD VM but wasn’t sure if it will lead to running sessions crashing or maybe OOD not showing the sessions in the UI anymore even if they’re running. Can you please share if it’s safe to restart the OOD VM?

6

You can restart the OOD VM, but I don’t think it’ll do anything. You can restart your own webserver by clicking the menu item in the Help menu ‘Restart My Webserver’ - that’ll restart your own per user nginx. Though again, I don’t know if it’ll do anything.

What version of websockify are you using? Maybe there’s version mismatch because I see log lines about rfbProcessClientNormalMessage: ignoring unknown encoding -260