Hi and welcome!
Code server has a different marketplace than vscode for whatever reason. There is an extension, on the vscode market place that you can download. You may not be able to get it from the marketplace, but you should be able to download and install it.