Difference between revisions of "Linux Patch"

From eXo Wiki
Jump to navigation Jump to search
(eXoDOS 6 description, and installation process steps 1-2.)
(→‎Linux Flatpaks: completed flatpak runtime list)
 
(6 intermediate revisions by the same user not shown)
Line 3: Line 3:
=== Overview ===
=== Overview ===


The eXoDOS Linux patch is a complete conversion to make all features of eXoDOS work on Linux systems just as they would in Windows. An official Linux frontend, called exogui, is included as part of this conversion. Additionally, the patch is written to ensure that the collection works as expected in dual-boot environments. After the Linux patch is installed, if eXoDOS is updated or games are installed, this will be reflected in both Linux and Windows environments.
The eXoDOS Linux patch is a complete conversion to make all features of eXoDOS work on Linux systems just as they would in Windows, including both the lite and full versions. An official Linux frontend, called exogui, is included as part of this conversion. Additionally, the patch is written to ensure that the collection works as expected in dual-boot environments. After the Linux patch is installed, if eXoDOS is updated or games are installed, this will be reflected in both Linux and Windows environments.


As it is encouraged to seed the collection, installing the Linux patch will not alter any torrent files. The patch does not change the existing eXoDOS framework, but instead supplements it.
As it is encouraged to seed the collection, installing the Linux patch will not alter any torrent files. The patch does not change the existing eXoDOS framework, but instead supplements it.


At this time of this writing, the latest eXoDOS Linux Patch is for version 6.4.
At this time of this writing, the latest eXoDOS Linux Patch is for version 6.4.
An add-on zip is also available as a separate download to add Linux support to the Media Pack.
<nowiki>*</nowiki>Note: The German Language Pack has not yet been converted*




Line 48: Line 53:
: The final step is to run the eXoDOS Setup.
: The final step is to run the eXoDOS Setup.


:To do this through exogui, select "''eXoDOS Setup''" on the home tab. Alternatively, you may run '''Setup.sh''' from a terminal window.
:In your file manager, double-click on the '''eXoDOS Setup.command''' file to start the setup, and then follow the on-screen instructions. If you are asked whether you want to execute the file, click yes. If you are using Nautilus or Gnome and are not given this option, right click the file and select Run as Program.
:
:The setup file will check for required files and warn you if any are missing. It will also check for files from the Media Pack Add-On.


:This will unpack the required eXoDOS files, including the LaunchBox assets and the games front end assets/configs to run the collection. In addition, it will extract the Linux game launcher and setup files. It will make the collection work on both Windows and Linux computers and ensure updates work correctly for both operating systems.
:This will unpack the required eXoDOS files, including the LaunchBox assets and the games front end assets/configs to run the collection. In addition, it will extract the Linux game launcher and setup files. It will make the collection work on both Windows and Linux computers.


:Do not extract these files manually. They are location sensitive.
:It is important to run the setup and not extract any files manually. Not only are the files location sensitive, but the setup makes some changes to them.


:The eXoDOS Setup will give you the opportunity to customize your set. This includes the option to remove Adult games from the exogui and LaunchBox menu. This removes games with sex or nudity from the LaunchBox XML file. This does not remove violent games. Please make use of the ratings category in LaunchBox if you would like to filter the games further.
:The eXoDOS Setup will give you the opportunity to customize your set. This includes the option to remove Adult games from the exogui and LaunchBox menu. This removes games with sex or nudity from the LaunchBox XML file. This does not remove violent games. Please make use of the ratings category in LaunchBox if you would like to filter the games further.


:You will also be prompted as to if you would like your global defaults to be Fullscreen or Windowed and whether or not you would like to default to Aspect Ratio On or Off. If you choose windowed mode, you will have the option between 640x480 or 1280x960.
:You will also be prompted as to if you would like your global defaults to be Fullscreen or Windowed and whether or not you would like to default to Aspect Ratio On or Off.
 
:Once it is complete, you may either launch the game shell files directly or run exogui to dive right in.


:The eXoDOS collection can be run from any directory, as all launch files are designed to use relative paths to each other. Note, however, if you choose to add a desktop shortcut to exogui and then later move eXoDOS to a new location, you will need to rerun the setup to update the shortcut. Note that the setup gives an option to reconfigure previous installations of eXoDOS rather than running through the entire setup process over again.
:Once it is complete, run exogui to dive right in.


====Important Note====
:<span style="color: green">'''Note:'''</span> The eXoDOS collection can be run from any directory, as all launch files are designed to use relative paths to each other. However, if you choose to add a desktop shortcut to exogui and then later move eXoDOS to a new location, you will need to run the '''eXoDOS Updater''' to update the shortcut to point to the new location. The '''eXoDOS Updater''' will allow you to reconfigure all of the installation options instead of running through the entire setup process again.
:*<span style="color: red">'''DO NOT RUN'''</span> the main Windows '''Setup.bat''' file after installing the Linux patch. It will undo the changes necessary for Linux compatibility.
:*Running the '''Setup.sh''' installation on an eXoDOS instance that was previously installed in Windows will clear the Windows installed games playlist in LaunchBox (due to LaunchBox being reinstalled).


===Using eXoDOS===
===Using eXoDOS===
Line 70: Line 73:
====exogui====
====exogui====


:A member of our Discord, jelcynek, has currently created a Linux frontend, exogui, which is a fork of Flashpoint Launcher. It is still very much a work in progress, but it has been bundled with eXoDOS. As the frontend improves, newer versions will be included with updates.
:The official Linux frontend is exogui, a fork of Flashpoint Launcher. A member of our Discord, jelcynek, created exogui and has continued to maintain it over the years. More recently, Colin, the main Flashpoint Launcher developer, has also contributed to exogui. Together, they have made a very solid frontend. We are still looking for more volunteers to improve the UI experience, especially on the Steam Deck.
:Running '''start-exogui''' will start the frontend.
:Simply double-click on the '''eXoDOS''' desktop icon, or execute the '''exogui.command''' file to launch the frontend. You will be presented with a list of all included games.


:The website for exogui can be found at https://github.com/margorski/exodos-launcher/. At this time, jelcynek is looking for volunteers to help in the development of the frontend. If you are interested, please reach out to him in the #linux_port_for_nerds channel of our Discord.
:The website for exogui can be found at https://github.com/margorski/exodos-launcher/. At this time, jelcynek is looking for volunteers to help in the development of the frontend. If you are interested, please reach out to him in the #linux_port_for_nerds channel of our Discord.
====Playing Without Frontend ====
:After downloading the collection, installing the dependencies with '''install_linux_dependencies.sh''', and running '''Setup.sh''', you can play the games in the following way without a frontend:
:Navigate to the '''eXo/eXoDOS/!dos/''' directory. Here, you will find 7200 game directories that contain launcher and setup shell files. These files should be executed from a terminal window.
:For example, from the root directory of the collection, you could type:
<pre>
cd eXo/eXoDOS/\!dos/mi2/
bash Monkey\ Island\ 2\ -\ LeChuck\'s\ Revenge\ \(1991\).sh
</pre>
:<span style="color: green">'''Note:'''</span> if you have bash completion enabled, you can press the tab key to make typing name of a script easier.


:The first time you attempt to run a game it will ask if you want to install it. Subsequent runs will directly launch the game.
:The first time you attempt to run a game it will ask if you want to install it. Subsequent runs will directly launch the game.
Line 92: Line 82:
:Initial install may take some time depending on the size (a few of these games are upwards of 8 CDs!). During install you will be prompted to choose whether or not to enforce aspect ratio, full screen or windowed mode, and if you would like to apply a scaler. Scalers can smooth pixels, making older pixelated games look a bit more modern.  The default setting is normal2x.
:Initial install may take some time depending on the size (a few of these games are upwards of 8 CDs!). During install you will be prompted to choose whether or not to enforce aspect ratio, full screen or windowed mode, and if you would like to apply a scaler. Scalers can smooth pixels, making older pixelated games look a bit more modern.  The default setting is normal2x.


:If you run the install file a second time, it will ask if you would like to uninstall the game. Choosing "yes" will erase the installed files from your disk, but keep the original ZIP file.  You will lose any saved games, high scores, or other settings you have defined since the game was installed. If you choose not to uninstall the game you will get the chance to choose full screen or windowed again and another opportunity to change the scaler. If the scaler refuses to change, you will have to rerun the Setup file in order to extract clean copies of each games conf file.
:If you run the install file a second time, it will ask if you would like to uninstall the game. Choosing "yes" will erase the installed files from your disk, but keep the original ZIP file.  You will be given an option to keep your saved games. If you choose not to uninstall the game you will get the chance to choose full screen or windowed again and another opportunity to change the scaler.
:
:To launch a game or its setup from exogui, click on the game to select it, and then click on the 'Install', 'Play', or 'Setup' button in the right-hand pane.


====Creating Desktop Shortcuts====  
====Creating Desktop Shortcuts====  


: If you would like to create a desktop shortcut to a game, open a plain text editor, such as gedit or kate, and create a file with the .desktop extension and the following contents, making changes as appropriate:
: If you would like to create a desktop shortcut to a specific game, open a plain text editor, such as gedit or kate, and create a file with the .desktop extension and the following contents, making changes to the Exec, Icon, and Name lines as appropriate:
<pre>
<pre>
[Desktop Entry]
[Desktop Entry]
Exec=x-terminal-emulator -e "/home/username/eXoDOS/eXo/eXoDOS/\\!dos/mi1/Secret\\ of\\ Monkey\\ Island\\,\\ The\\ \\(1990\\).sh"
Encoding=UTF-8
Icon=/usr/share/icons/monkeyisland_icon.png
Version=1.0
Type=Application
Terminal=false
Exec="/home/username/eXoDOS/eXo/eXoDOS/!dos/mi1/Secret of Monkey Island, The (1990).command"
Icon=/usr/share/icons/Some Monkey Island Icon.png
Name[EN_US]=Secret of Monkey Island
Name[EN_US]=Secret of Monkey Island
Name=Secret of Monkey Island
Name=Secret of Monkey Island
Type=Application
</pre>
</pre>


===Changelog===
===Changelog===


====Changes to Version 5.1.linux1====
====Changes to the eXoDOS 6.04 Linux Patch====


:Utilities:
:*Launch scripts directly from any file-manager: Files ending in the *.command extension can be launched directly from any file manager.
:*Removed All-Seeing Eye 3 from Linux menu option (map tracking inaccurate)
:*Revamped dependency installer with update support: For many distributions, sudo access is no longer needed.
 
:*Improved compatibility: The eXoDOS Linux patch will now run on virtually any x86_64 distro with flatpak support, including the Steam Deck.
: Games:
:*Improved frontend: The exogui frontend is now feature packed with full support for extras, filters, images, playlists, and videos.
:*120 Degree Below Zero (2012) - Changed launcher to use ScummVM (sciAudio.exe not an option for Linux)
:*Improved backend: The backend has been completely revamped to include all eXoDOS 6 features.
:*Eye of the Beholder III - Assault on Myth Drannor (1993) - Replaced patched AESOP.EXE file with original (patched exe does not run properly in Linux)
:*Bug Squash: Hundreds of previously broken games have been fixed after thorough testing
:*LockerGnome Quest Redux (2012) - Changed launcher to use ScummVM (sciAudio.exe not an option for Linux)


===Files===
===Files===


====exodos5-linux-patch.zip====
====eXoDOS 6.4 Linux Patch.zip====
:'''exodos5-linux-patch.zip''' contains the following files and directories:
:'''eXoDOS 6.4 Linux Patch.zip''' contains the following files and directories:
<pre>
<pre>
├── Content
├── Content
│   ├── !DOSmetadata_linux.zip
│   ├── !DOS_linux_metadata.zip
│   └── Magazines_linux.zip
│   └── XODOS_linux_Metadata.zip
├── eXo
├── eXo
│   └── util
│   └── util
│      └── util_linux.zip
│      ├── eXoMerge.bsh
│      ├── install_dependencies.bsh
│      ├── Setup eXoDOS.bsh
│      └── utilDOS_linux.zip
├── eXoDOS Linux ReadMe.txt
├── eXoDOS Linux ReadMe.txt
├── exogui
├── eXoMerge.command
│   └── [exogui files]
├── install_dependencies.command
├── install_linux_dependencies.sh
└── Setup eXoDOS.command
├── Setup.sh
└── start-exogui
</pre>
</pre>


:This builds upon the existing file and directory structure of eXoDOS.  
:This builds upon the existing file and directory structure of eXoDOS.
 
:*'''Content/!DOS_linux_metadata.zip''' - This contains DOSBox configuration files as well as the launcher and setup files (bsh, command, conf) for games.
:*'''Content/!DOSmetadata_linux.zip''' - This contains DOSBox configuration files as well as the launcher and setup files (conf, sh, bat) for games; Note these files are also updated to have the content for Version 5.1.linux1.
:*'''Content/XODOS_linux_Metadata.zip''' - This contains the exogui files and some xml scripts.
:*'''Content/Magazines_linux.zip''' - This contains DOSBox configuration files as well as the launcher and setup files (conf, sh, bat) for disk magazines.
:*'''eXo/util/eXoMerge.bsh''' - This is a support file for eXoMerge.command.
:*'''eXo/util/util_linux.zip''' - This contains utilities needed to run eXoDOS. <span style="color: red">'''Note that several internal files are different than the ones in util.zip, despite having the same filenames.<span style="color: red">'''
:*'''eXo/util/install_dependencies.bsh''' - This is a support file for install_dependencies.command.
:*'''exogui''' - This directory contains the files needed to run exogui.
:*'''eXo/util/Setup eXoDOS.bsh''' - This is a support file for Setup eXoDOS.command.
:* '''install_linux_dependencies.sh''' - This guided setup script installs the Linux dependencies needed for eXoDOS.
:*'''eXo/util/utilDOS_linux.zip''' - This contains the eXoDOS Linux backend files.
:*'''Setup.sh''' - This guided setup script installs the eXoDOS collection for Linux.
:*'''eXoMerge.command''' - This script is used to help merge two eXo collections that have already been instal<span style="color: red">'''<span style="color: red">'''led.
:*'''start-exodus''' - This launches the Linux eXoDOS frontend, exogui.
:* '''install_dependencies.command''' - This launches the Linux/macOS setup to <span style="color: red">'''<span style="color: red">'''install system dependencies needed for eXo collections.
:*'''Setup eXoDOS.command''' - This launches the Linux/macOS setup for eXoDOS. While you cannot currently run eXoDOS on macOS, you can still install it for other systems.


====util_linux.zip====  
====util_linux.zip====  
:'''util_linux.zip''' contents:
:'''util_linux.zip''' contents:
:* '''aria.zip''' - Same as in eXoDOS 5 Lite torrent.
:* '''!english/texts_linux.txt''' - support file for the eXoDOS Updater
:*'''ASE3.zip''' - Same as in eXoDOS 5.1 update.
:*'''!languagepacks/Alternate Launcher.bsh''' - language pack support file for Linux alternate launcher (called by bsh script in the game Extras directory)
:*'''ASE.zip''' - Same file as in eXoDOS 5.1 update.
:*'''!languagepacks/Alternate Launcher.msh''' - language pack support file for macOS alternate launcher (called by msh script in the game Extras directory)
:*'''BRC32.exe''' - Same as in eXoDOS 5 torrent.
:*'''!languagepacks/install.bsh''' - language pack support file for Linux game installer (called by bsh script in game directory)
:*'''CHOICE.EXE''' - Same as in eXoDOS 5 torrent.
:*'''!languagepacks/install.msh''' - language pack support file for macOS game installer (called by msh script in game directory)
:*'''converter.sh''' - Script to assist in the development of the Linux patch; converts batch files to bash shell scripts for Linux.
:*'''!languagepacks/ip.bsh''' - language pack support file to determine IP address for multiplayer games in Linux (called by the launch.bsh script in the same directory)
:*'''deprotect.zip''' - Same as in eXoDOS 5 torrent.
:*'''!languagepacks/ip.msh''' - language pack support file to determine IP address for multiplayer games in macOS (called by the launch.msh script in the same directory)
:*'''dos2unix.exe''' - Added to eXoDOS Linux patch to ensure configuration changes in Windows do not add carriage returns.
:*'''!languagepacks/launch.bsh''' - language pack support file to launch games in Linux (called by the <game name>.bsh script in the game directory)
:*'''dosbox.zip''' - Modified for eXoDOS Linux patch to include Linux conf files.
:*'''!languagepacks/launch.msh''' - language pack support file to launch games in macOS (called by the <game name>.msh script in the game directory)
:*'''GBC.zip''' - Same as in eXoDOS 5.1 update.
:*'''Sumatra/CallSumatra.bsh''' - Linux support file for CallSumatra.command
:*'''LinuxPackages.zip''' - Contains Linux DOSBox packages needed for eXoDOS.
:*'''Sumatra/CallSumatra.command''' - exogui calls this to launch Sumatra for magazine articles in Linux
:*'''mt32.zip''' - Same as in eXoDOS 5 torrent.
:*'''AltLauncher.bsh''' - support file for Linux alternate launcher (called by bsh script in the game Extras directory)
:*'''regenerate.sh''' - Development tool that attempts to convert Windows eXoDOS '''Setup.bat''' file into a Linux shell script, which upon being executed will run through the installation and then systematically convert all files to work with Linux.
:*'''AltLauncher.msh''' - support file for macOS alternate launcher (called by msh script in the game Extras directory)
:*'''scummvm.ini''' - Same as in eXoDOS 5 torrent.
:*'''EXTDOS_linux.zip''' - contains Linux flatpaks, update files, AppImages, and emulator support files (bak, bsh, command, conf, txt)
:*'''scummvm.zip''' - Same as in eXoDOS 5 torrent.
:*'''alt_dosbox_linux.txt''' - defines the command to launch DOSBox for the alternate launcher (<span style="color: red">must be DOSBox Staging to not break conf files)
:*'''SetConsole.exe''' - Same as in eXoDOS 5 torrent.
:*'''alt_launch_linux.txt''' - defines the directory containing the DOSBox Staging resource folder used by eXoDOS for the alternate launcher
:*'''SHADERS.zip''' - Same as in eXoDOS 5 torrent.
:*'''converter.bash''' - support file for regenerate.bash that converts bat files to bash files using a long series of substitution commands
:*'''ssr.exe''' - Same as in eXoDOS 5 torrent.
:*'''dosbox_linux.txt''' - defines what version of DOSBox is used by each game in Linux
:* '''Ultimapper5.zip''' - Same as in eXoDOS 5.1 update.
:*'''eXoLBpm_linux.py''' - The LaunchBox Parents.xml merging tool for Linux
:*'''update_linux.zip''' - Linux branch update files; Linux bash files added and Windows batch files modified; changelog.txt and ver_linux.txt are used to track Linux branch; 5.1 game patch zips also included; Note the EOB3 executable (AESOP.EXE) was reverted to the 5.0 version for Linux compatibility.
:*'''eXoLPLBXMLedit_linux.py''' - The eXoDOS Language Pack LaunchBox XML edit tool for Linux
:*'''eXoLPPPM_linux.py''' - The eXoDOS Language Pack Playlist Parents Merger tool for Linux
:* '''exodos.png''' - png file that can be used as a custom icon in Steam
:*'''exodosvi_cover.jpg''' - Box art image that can be used as a custom background in Steam
:*'''install.bsh''' - support file for Linux game install scripts (gets called by the install.bsh script in the game directory)
:*'''install.msh''' - support file for macOS game install scripts (gets called by the install.msh script in the game directory)
:*'''ip.bsh''' - support file to determine IP address for multiplayer games in Linux (called by the launch.bsh script in the same directory)
:*'''ip.msh''' - support file to determine IP address for multiplayer games in macOS (called by the launch.msh script in the same directory)
:*'''launch.bsh''' - support file to launch games in Linux (called by the <game name>.bsh script in the game directory)
:*'''launch.msh''' - support file to launch games in macOS (called by the <game name>.msh script in the game directory)
:*'''regenerate.bash''' - location sensitive development script used to convert unzipped files from eXo collections to Linux and macOS
:*'''version.bsh''' - Linux support file for version.command
:*'''version.command''' - This tells the currently installed version of eXoDOS
:*'''version.msh''' - macOS support file for version.command
'''Content/DOS_linux_Magazines.zip''' - Linux supplement for the Media Pack - This contains Linux DOSBox configuration, launcher, and cue files related to magazines and disk magazines (bat, bsh, command, conf, cue).


====Custom Scripts====
====Development Scripts====
:<span style="color: green">'''Note:'''</span> For the rest of this document, files will be described using their locations after installing eXoDOS.
:<span style="color: green">'''Note:'''</span> For the rest of this document, files will be described using their locations after installing eXoDOS.


: The following files are not simply handled by the conversion script, but have custom modifications:
====eXo/util/converter.bash====
:*'''eXo/Update/update.bat'''
: The '''converter.bash''' script contains the <span style="color: blue">convertScript</span> function, which, when called, will attempt to convert a file's batch code to bash. The file that the <span style="color: blue">convertScript</span> function is ran against is determined by a variable, <span style="color: blue">$currentScript</span>. Note that the '''converter.bash''' script is not meant to be executed directly.
:*'''eXo/Update/update.sh'''
:*'''eXo/Update/update_installed.sh'''
:*'''Setup.sh'''


====eXo/util/converter.sh====
:To prevent direct execution, the '''converter.bash''' script checks that a variable, <span style="color: blue">$hideMessage</span>, has a value of <span style="color: blue">true</span>. Note that even when <span style="color: blue">$hideMessage</span> = <span style="color: blue">true</span>, executing '''converter.bash''' does not automatically call the <span style="color: blue">convertScript</span> function. Instead, the <span style="color: blue">source</span> command should be ran against '''converter.bash''' to bring the <span style="color: blue">convertScript</span> function into the shell session's memory. Then, assuming the value of <span style="color: blue">$currentScript</span> has been set, the <span style="color: blue">convertScript</span> function should be called.
: The '''converter.sh''' script contains the <span style="color: blue">convertScript</span> function, which, when called, will attempt to convert a file's batch code to bash. The file that the <span style="color: blue">convertScript</span> function is ran against is determined by a variable, <span style="color: blue">$currentScript</span>. Note that the '''converter.sh''' script is not meant to be executed directly.
 
:To prevent direct execution, the '''converter.sh''' script checks that a variable, <span style="color: blue">$hideMessage</span>, has a value of <span style="color: blue">true</span>. Note that even when <span style="color: blue">$hideMessage</span> = <span style="color: blue">true</span>, executing '''converter.sh''' does not automatically call the <span style="color: blue">convertScript</span> function. Instead, the <span style="color: blue">source</span> command should be ran against '''converter.sh''' to bring the <span style="color: blue">convertScript</span> function into the shell session's memory. Then, assuming the value of <span style="color: blue">$currentScript</span> has been set, the <span style="color: blue">convertScript</span> function should be called.


:Example use where bat files in a directory called '''filesToConvert''':
:Example use where bat files in a directory called '''filesToConvert''':
<pre>
<pre>
hideMessage='true'
hideMessage='true'
. eXo/util/converter.sh
. eXo/util/converter.bash
for file in filesToConvert/*.bat
for file in filesToConvert/*.bat
do
do
     cp "$file" "${file%.bat}.sh"
     cp "$file" "${file%.bat}.bsh"
done
done
chmod +x filesToConvert/*.sh
chmod +x filesToConvert/*.bsh
for currentScript in filesToConvert/*.sh
for currentScript in filesToConvert/*.bsh
do
do
     convertScript
     convertScript
Line 199: Line 203:
</pre>  
</pre>  


: Normally, the '''converter.sh''' script is called by the '''regenerate.sh''' script and the '''Setup_with_regeneration.sh''' script it creates. Details about those scripts will be described later in this document.
: Normally, the '''converter.bash''' script is called by the '''regenerate.bash''' script. Details about those scripts will be described later in this document. These scripts are intended for development purposes, and changes periodically have to be made to them to handle any conversions that do not succeed. This could involve anything from fixing case inconsistencies to parsing batch code that was written in an unforeseen way.


===== convertScript Function=====
===== convertScript Function=====


:The <span style="color: blue">convertScript</span> function runs a series of sed and Perl commands to convert a file from batch to bash. <span style="color: red">'''As this is a very complex text manipulation process, the order of each command is critically important.'''</span> It is heavily recommended to add any new commands at the bottom of the function. Each subsequent text manipulation command may search for and change something that was previously altered. If any existing text manipulation commands are changed, everything needs to be very carefully audited. Edge cases are everywhere.
:The <span style="color: blue">convertScript</span> function runs a series of sed, ed, and Perl commands to convert a file from batch to bash. <span style="color: red">'''As this is a very complex text manipulation process, the order of each command is critically important.'''</span> It is heavily recommended to add any new substitution commands close to the bottom of the function. Each subsequent text manipulation command may search for and change something that was previously altered, but not yet in a final state. If any existing text manipulation commands are changed or new ones added, everything needs to be very carefully audited. Edge cases are everywhere.


: Example code snippet from the <span style="color: blue">convertScript</span> function:
: Example code snippet from the <span style="color: blue">convertScript</span> function:
Line 255: Line 259:
:As shown in the above code snippet, comments are used to tell what every text manipulation operation does. This is necessary to ensure that the script continues to be maintainable.
:As shown in the above code snippet, comments are used to tell what every text manipulation operation does. This is necessary to ensure that the script continues to be maintainable.


:<span style="color: green">'''Note:'''</span> When doing a systematic conversion of the eXoDOS collection, it is important to remember that the <span style="color: blue">convertScript</span> function is ran against every batch file in eXoDOS, with the exception of those in game archives (e.g. '''run.bat'''). Additional game specific text manipulations are written in the '''regenerate.sh''' script.
:<span style="color: green">'''Note:'''</span> When doing a systematic conversion of the eXoDOS collection, it is important to remember that the <span style="color: blue">convertScript</span> function is ran against every batch file in eXoDOS, with the exception of those in game archives (e.g. '''run.bat'''). Additional game specific text manipulations are written in the '''regenerate.bash''' script.
 
====eXo/util/regenerate.sh====


:The purpose of the '''regenerate.sh''' script is to assist in the development of future Linux patches by automating the conversion of config files and Windows batch files to Linux compatible bash files. It creates a '''Setup_with_regeneration.sh''' file in the root directory of the eXoDOS collection. By executing the '''Setup_with_regeneration.sh''' script, a converted eXoDOS setup will run followed by conversion operations to prepare the rest of the collection for the creation of a Linux patch. This script is not intended for end-users. As new versions of eXoDOS come out, both the '''regenerate.sh''' script as well as the '''converter.sh''' will need to be altered. It is impossible to predict how the Windows batch files will be written. It is very common for eXo to do some extremely complex operations in batch files that can make updating these scripts very challenging.
====eXo/util/regenerate.bash====


:<span style="color: green">'''Note:'''</span> '''Setup_with_regeneration.sh''' does not handle the flatpak/native check in the '''update.sh''' or '''update.bat''' file. The '''util_linux.zip''' file is different from '''util.zip''' in many ways. This script does not focus on the contents of those files, even if was used to prepare them originally. If '''regenerate.sh''' or '''converter.sh''' have been updated, please ensure that you have also updated the '''util_linux.zip''' file with the newer versions.  
:The purpose of the '''regenerate.bash''' script is to assist in the development of future Linux and macOS patches by automating the conversion of config files and Windows batch files to their Linux and macOS equivalents. This script is not intended for end-users. As new versions of eXoDOS come out, both the '''regenerate.bash''' script as well as the '''converter.bash''' will need to be altered. It is impossible to predict how the Windows batch files will be written. It is very common for eXo to do some extremely complex operations in batch files that can make updating these scripts very challenging. Version 6 added much more complexity to eXoDOS than had ever previously existed. As a result, from version 5 to version 6, these files grew over 5 and a half times in size and complexity. As time goes on, new challenges are likely to be faced for maintaining these scripts.


:The '''regenerate.sh''' script first checks that the eXoDOS files are in the correct location in relation to it. Next, it loads the <span style="color: blue">convertScript</span> function into memory, copies the '''Setup.bat''' file to '''Setup_with_regeneration.sh''', and converts the newly created file to bash. From here, the script makes several changes to the '''Setup_with_regeneration.sh''' file:
:The '''regenerate.bash''' script first checks that the eXoDOS files are in the correct location in relation to it. Next, it loads the <span style="color: blue">convertScript</span> function into memory, and converts all of the unzipped bat, conf, and other known support files. As case inconsistencies are found, substitutions to correct the inconsistencies are manually placed into the regenerate.bash script.
:#Any file reference case inconsistencies are fixed, all '''util.zip''' references are changed to '''util_linux.zip''', and additionally needed unzip directives are added.
:#Checks are added to the beginning of the script to ensure it is located in the root directory of the eXoDOS collection.
:#Additional code is added to the end of the script to generate Linux versions for all config files and Windows batch files.


:All text manipulation for the above steps is done through sed commands. The final step will scare many people away as it involves numerous sed commands within a sed command. This means each line has a great deal of escape sequences.
:Most text manipulation for the above steps is done through sed commands, although there are a few situations where ed and Perl are used instead.


:Here is a code snippet to give an idea of what some of this looks like:
:In short, when executing the '''regenerate.bash''' script, it goes through the following steps:
<pre>
:#Gives a disclaimer that running the script will take a VERY long time
    sed -i -e '$a\
:#Checks that standard eXo files are located in their expected locations in relation to the script
\
clear\
echo "The rest of the setup is automated but could take over an hour."\
echo ""\
cd "$initialDir"\
cd eXo\
echo "Copying scummvm svn application data to Wine."\
[ -e "util/scummvm.ini" ] \&\& wine cmd /c "md %USERPROFILE%\\\AppData\\\Roaming\\\ScummVM" 2>/dev/null\
[ -e "util/scummvm.ini" ] \&\& wine cmd /c "copy .\\\util\\\scummvm.ini %USERPROFILE%\\\AppData\\\Roaming\\\ScummVM\\\scummvm.ini" 2>/dev/null\
\
echo "Fixing zip archive references."\
\
echo "Fixing batch file reference inconsistencies. This may take several minutes."\
[ `ls -1 Update/*.bat 2>/dev/null | wc -w` -gt 0 ] && sed -i -e "s/^goto :eof/goto :end/" Update/*.bat 2>/dev/null\
for file in eXoDOS/\\\!*/*/*.bat eXoDOS/\\\!*/*/*/*.bat Update/*.bat Magazines/*.bat\
do\
    sed -i -e "s/\\.\\\\\\download\\\\\\/.\\\\\\DOWNLOAD\\\\\\/Ig" "$file"\
    sed -i -e "s/exodos\\\\\\/eXoDOS\\\\\\/Ig" "$file"\
    sed -i -e "s/exo\\\\\\/eXo\\\\\\/Ig" "$file"\
    sed -i -e "s/exo\\\\\\update/eXo\\\\\\Update/Ig" "$file"\
    sed -i -e "s/PPMode/PPmode/I" "$file"\
    sed -i -e "s/c\\*\\.rom/C*.ROM/I" "$file"\
    sed -i -e "s/\\.rom/.ROM/I" "$file"\
    sed -i -e "s|mt32\\\\\\soundcanvas\\.sf2|mt32\\\\\\SoundCanvas.sf2|I" "$file"\
    sed -i -e "s/update\\.zip/update_linux.zip/Ig" "$file"\
    sed -i -e "s/ver\\.exo/ver_linux.exo/Ig" "$file"\
    sed -i -e "s/ver\\.txt/ver_linux.txt/Ig" "$file"\
    sed -i -e "/findstr \\/C/ s/\\"%GameName/\\":%GameName/" "$file"\
    sed -i -e "/fullindex=/ s/\\"\\$gamename/\\":\\$gamename/" "$file"\
done\
echo "Creating game shell files."\
echo "Preparing files for conversion..."\
for file in eXoDOS/\\\!*/*/*.bat eXoDOS/\\\!*/*/*/*.bat Update/*.bat Magazines/*.bat\
do\
    cp "$file" "${file%.bat}.sh"\
done\
chmod +x eXoDOS/\\\!*/*/*.sh\
chmod +x eXoDOS/\\\!*/*/*/*.sh\
chmod +x Update/*.sh\
chmod +x Magazines/*.sh\
\
echo "Creating Linux configuration references. Please wait."\
for file in eXoDOS/\\!*/*/install.sh\
do\
    sed -i -e "s/^\\(.*\\)\\.bat\\(.*\\)/&\\n\\1.sh\\2/" "$file"\
done\
</pre>
 
:In short, when the '''Setup_with_regeneration.sh''' script is executed, the code added to the bottom does the following:
:#Copies the ScummVM SVN application data to Wine
:#Fixes zip archive references
:#Fixes zip archive references
:#Fixes batch file reference inconsistencies
:#Fixes batch file reference inconsistencies
:#Creates shell files
:#Copies bat files to newly created bsh files
:# Makes shell files executable
:#Prepares bsh files for conversion
:#Prepares shell files for conversion
:#Converts syntax for the Linux shell files (bsh) from Windows batch to bash
:#Adds Linux configuration references to Linux game setups
:#Removes unnecessary dependency checks for eXoDREAMM and eXoScummVM
:#Adds Linux configuration references to Windows game setups
:#Creates universal launch files for Linux and macOS (command files)
:#Adds Linux configuration references to Linux game and magazine launchers
:#Adds Windows configuration references to Linux game setups
:#Converts syntax for the Linux shell files from Windows batch to bash
:#Fixes '''dosbox.conf''' typos with known solutions
:#Fixes '''dosbox.conf''' typos with known solutions
:#Fixes '''dosbox.conf''' file and directory reference inconsistencies
:#Fixes '''dosbox.conf''' file and directory reference inconsistencies
:#Creates DOSBox configuration files for Linux
:#Creates DOSBox configuration files for Linux
:#Makes necessary changes to Linux configuration files
:#Makes necessary changes to Linux configuration files
:#Applies game specific fixes to Linux files
:#Applies Linux-only backend fixes
:#Applies Linux-only game specific fixes
:#Converts shell script reference txt files
:#Prepares macOS shell files (this step is currently skipped for eXoDOS, eXoScummVM, and eXoWin3x)
:#Corrects xml inconsistencies with known solutions
:#Removes unnecessary files


: <span style="color: green">'''Note:'''</span> All of the inconsistency fixes and game specific changes are manually added to the '''regenerate.sh''' script. There is no magic voodoo code to determine what needs to be changed to make each game work correctly.
: <span style="color: green">'''Note:'''</span> All of the case inconsistency fixes and game specific changes are manually added to the '''regenerate.bash''' script. There is no magic voodoo code to determine what needs to be changed to make each game work correctly.


===Note on Updates===
===Linux Flatpaks===


:<span style="color: red">'''IMPORTANT:'''</span> If preparing a full copy of the eXoDOS Linux patch, any existing eXoDOS update files should be considered before packaging the files for final release. The initial eXoDOS 5 Linux patch included the eXoDOS 5.1 update. For completeness as well as the convenience of anyone installing the Linux patch without an active Internet connection, any new versions of '''exodos5-linux-patch.zip''' should always include the latest updates. At the same time, a cumulative update patch file, '''update_linux.zip''', is also maintained for people that would like to simply update their already installed version of eXoDOS 5. The details of how the update works will be discussed later. However, it should be noted that both the '''exodos5-linux-patch.zip''' file as well as '''update_linux.zip''' should contain the latest versions of everything at their time of release.
:The following flatpaks use org.freedesktop.Platform 24.08:
:* com.retro_exo.aria2c
:*com.retro_exo.dosbox-staging-081-2
:*com.retro_exo.dosbox-x-08220
:*com.retro_exo.dosbox-x-20240701
:*com.retro_exo.gzdoom-4-11-3
:*com.retro_exo.mcomix
:*com.retro_exo.scummvm-2-2-0
:*com.retro_exo.scummvm-2-3-0-git15811-gf97bfb7ce1
:The following flatpaks use org.freedesktop.Platform 23.08:
:* com.retro_exo.dosbox-074r3-1
:* com.retro_exo.dosbox-ece-r4301
:* com.retro_exo.dosbox-ece-r4358
:* com.retro_exo.dosbox-ece-r4482
:* com.retro_exo.dosbox-gridc-4-3-1
:* com.retro_exo.mpv
:*com.retro_exo.wine
:The following flatpaks use org.gnome.Platform 46:
:* com.retro_exo.abiword
:* com.retro_exo.gnumeric
:The following flatpaks use org.kde.Platform 6.7:
:* com.retro_exo.falkon
:* com.retro_exo.okular
===Linux Update and Patch Files===


:In the '''exodos5-linux-patch.zip''' file, any cumulative updates for bat, conf, and sh files are merged into the '''Content/!DOSmetadata_linux.zip''' and '''Content/Magazines_linux.zip''' files, overwriting the ones from the eXoDOS 5.0 release. Updates to game archives, on the other hand, are included in the '''eXo/util/update_linux.zip''' file.
:The Update directory is extracted from '''EXTDOS_linux.zip''' to the '''eXo/Update''' location. It contains the scripts to run the eXoDOS updater as well as subdirectories for updates and patch files. The '''eXo/Update''' directory may initially look something like the following:
<pre>
├── changelog.txt
├── cleanup.bat
├── cleanup.bsh
├── cleanup.command
├── !dos
│   └── linux
│      └── release
│          ├── Battle Isle 2 (1993).zip
│          ├── Breach 2 (1990).zip
│          ├── Carmageddon Max Pack (1998).zip
│          ├── Command and Conquer (1995).zip
│          ├── Command and Conquer - Red Alert (1996).zip
│          ├── Complete Great Naval Battles, The - The Final Fury (1996).zip
│          ├── DOOM - eXoWAD (2021).zip
│          ├── Grand Theft Auto (1997).zip
│          ├── Hard Nova (1990).zip
│          ├── Heroes of Might and Magic II (Deluxe Edition) (1998).zip
│          ├── Jane's Combat Simulations Advanced Tactical Fighters (1996).zip
│          ├── Last Half of Darkness (1989).zip
│          ├── Lemmings (1991).zip
│          ├── Lemmings 3 - All New World of Lemmings (1994).zip
│          ├── Leo the Lion (1997).zip
│          ├── Living Ball (1995).zip
│          ├── Mean 18 (1986).zip
│          ├── MechWarrior 2 (Limited Edition) (1996).zip
│          ├── NFL Challenge (1985).zip
│          ├── Normality (1996).zip
│          ├── Picture Perfect Golf (1995).zip
│          ├── Prisoner of Ice (1995).zip
│          ├── Realms of Arkania - Blade of Destiny (1992).zip
│          ├── Resurrection - Rise 2 (1996).zip
│          ├── Sigil (2019).zip
│          ├── Sigil II (2023).zip
│          ├── Star Trek - Judgement Rites CD (1993).zip
│          ├── Time Gate - Knight's Chase (1995).zip
│          ├── Ultima VI - The False Prophet (1990).zip
│          ├── Ultima V - Warriors of Destiny (1988).zip
│          └── Zone of Artificial Resources (1997).zip
├── index.txt
├── restore.exe
├── restore.py
├── update.bat
├── update.bsh
├── update.command
├── update_installed.bat
├── update_installed.bsh
├── update_installed.command
├── update.txt
├── update_xml.bat
├── update_xml.bsh
├── update_xml.command
└── ver
    └── ver.txt
</pre>


:<span style="color: red">'''CAUTION:'''</span> The '''update_linux.zip''' file hosted online is for cumulative updates and is different than the '''eXo/util/update_linux.zip''' file contained in the full release of the Linux patch. Any references in this document to the two files can be differentiated by the presence or absence of '''eXo/util/'''.
:Executing the '''update.command''' script will run an update for eXoDOS. This normally will be done in exogui from the eXoDOS game entry. Both the Windows version of eXoDOS and the Linux patch download the same updates. Updates work identically regardless of the operating system.
:* Files in the '''eXo/Update/!dos''' directory are for non-OS specific game file updates.
:* Files in the '''eXo/Update/!dos/linux/release''' directory are Linux specific patch files that are bundled with the eXoDOS Linux patch when you download it.
:* Files in the '''eXo/Update/!dos/linux''' directory are Linux specific update files that are downloaded as part of an eXoDOS update.
:All files extracted from Linux specific archives have unique filenames to differentiate them from files that should only be used in Windows.
:Files are extracted from these directories in the following order:
:# eXo/Update/!dos
:# eXo/Update/!dos/linux/release
:# eXo/Update/!dos/linux


===Preparing For Manual Conversion===
===Preparing For Manual Conversion===

Latest revision as of 21:03, 12 September 2024

eXoDOS Linux Patch

Overview

The eXoDOS Linux patch is a complete conversion to make all features of eXoDOS work on Linux systems just as they would in Windows, including both the lite and full versions. An official Linux frontend, called exogui, is included as part of this conversion. Additionally, the patch is written to ensure that the collection works as expected in dual-boot environments. After the Linux patch is installed, if eXoDOS is updated or games are installed, this will be reflected in both Linux and Windows environments.

As it is encouraged to seed the collection, installing the Linux patch will not alter any torrent files. The patch does not change the existing eXoDOS framework, but instead supplements it.

At this time of this writing, the latest eXoDOS Linux Patch is for version 6.4.

An add-on zip is also available as a separate download to add Linux support to the Media Pack.

*Note: The German Language Pack has not yet been converted*


Supported distributions include:

  • Arch / Manjaro Linux / SteamOS
  • Fedora
  • Ubuntu (and Ubuntu-based distributions) / Debian
  • Nearly any x86_64 distro that has flatpak support

Unsupported:

  • ARM, IBM Power, and RISC-V computers and devices are not supported at this time. This includes the Raspberry Pi. We need someone to volunteer to build ARM versions of the flatpaks for support to be added.
  • macOS and BSD are also unsupported at this time. Until we have a volunteer to add macOS support to the frontend, this is unlikely to change. Backend support exists for the eXoDREAMM project, and the backend for eXoDOS has been partially converted in case we get a volunteer.

Installation Process

Step 1 - Extracting Zip Archive

First, the eXoDOS 6.4 Linux Patch.zip file must be extracted to the correct location.
Copy the eXoDOS 6.4 Linux Patch.zip file to the root directory of your freshly downloaded eXoDOS 6.4 collection. (This is where files such as eXoDOS Catalog.pdf and Setup.bat are located)
Then, in your file manager, right click on the eXoDOS 6.4 Linux Patch.zip file and select "Extract Here" or "Extract > Extract archive here", depending on what you are using.
Alternatively, you may open the zip with a utility such as Ark, and drag the files and folders into the root eXoDOS directory.
The important thing is to ensure the files are extracted into the root directory of the collection, and not into a newly created subdirectory.
If you have also downloaded the eXoDOS Media Pack, ensure it has been downloaded the the same directory as the base eXoDOS collection. Then, download and place the "DOS_linux_Magazines.zip" file in the Content directory. Do not unzip this file.
After this has been done, proceed to the next step.

Step 2 - Installing System Dependencies

The next step is to install the software needed to run the collection. The install_dependencies.command script will run you through a guided setup to do this.

Note: If you are using Thunar or XFCE, you will first need to enable running shell files as executables. To do this, open a terminal and run the following command: xfconf-query --channel thunar --property /misc-exec-shell-scripts-by-default --create --type bool --set true

In your file manager, double-click on install_dependencies.command to start the dependency installer. If you are asked whether you want to execute the file, click yes.
If you are using Nautilus or Gnome and are not given this option to run by double-clicking, right click the file and select Run as Program.

Note: This step will need to be done on any Linux computer that has not previously ran eXoDOS 6, even if the full setup has already been completed on a portable drive. Also note that the flatpaks are installed at a user level. As such, other users will need to run the dependency installer separately as well. If you update your video drivers, you may also need to follow that up with a flatpak update. Rerunning a dependency installer installation will handle that for you.

Upon running the dependency installer, you will be prompted with a guided setup that gives the following options:
The "[D]ownload the latest setup" option will only grab the newest version of the eXo Dependency Installer, not eXoDOS itself. This may be useful if there is a problem with the dependency installer or if new flatpaks are needed. If the dependency installer is updated, it should be reran to launch the new version. To proceed with installing the dependencies, choose "[P]roceed with installation" and follow the on-screen instruction.
[P]roceed with installation
[D]ownload the latest setup
[R]emove all installed eXo packages
[A]bort installation
The "[D]ownload the latest setup" option will only grab the newest version of the eXo Dependency Installer, not eXoDOS itself. This may be useful if there is a problem with the dependency installer or if new flatpaks are needed. If the dependency installer is updated, it should be reran to launch the new version. To proceed with installing the dependencies, choose "[P]roceed with installation" and follow the on-screen instructions.

Step 3 - Installing eXoDOS

The final step is to run the eXoDOS Setup.
In your file manager, double-click on the eXoDOS Setup.command file to start the setup, and then follow the on-screen instructions. If you are asked whether you want to execute the file, click yes. If you are using Nautilus or Gnome and are not given this option, right click the file and select Run as Program.
The setup file will check for required files and warn you if any are missing. It will also check for files from the Media Pack Add-On.
This will unpack the required eXoDOS files, including the LaunchBox assets and the games front end assets/configs to run the collection. In addition, it will extract the Linux game launcher and setup files. It will make the collection work on both Windows and Linux computers.
It is important to run the setup and not extract any files manually. Not only are the files location sensitive, but the setup makes some changes to them.
The eXoDOS Setup will give you the opportunity to customize your set. This includes the option to remove Adult games from the exogui and LaunchBox menu. This removes games with sex or nudity from the LaunchBox XML file. This does not remove violent games. Please make use of the ratings category in LaunchBox if you would like to filter the games further.
You will also be prompted as to if you would like your global defaults to be Fullscreen or Windowed and whether or not you would like to default to Aspect Ratio On or Off.
Once it is complete, run exogui to dive right in.
Note: The eXoDOS collection can be run from any directory, as all launch files are designed to use relative paths to each other. However, if you choose to add a desktop shortcut to exogui and then later move eXoDOS to a new location, you will need to run the eXoDOS Updater to update the shortcut to point to the new location. The eXoDOS Updater will allow you to reconfigure all of the installation options instead of running through the entire setup process again.

Using eXoDOS

exogui

The official Linux frontend is exogui, a fork of Flashpoint Launcher. A member of our Discord, jelcynek, created exogui and has continued to maintain it over the years. More recently, Colin, the main Flashpoint Launcher developer, has also contributed to exogui. Together, they have made a very solid frontend. We are still looking for more volunteers to improve the UI experience, especially on the Steam Deck.
Simply double-click on the eXoDOS desktop icon, or execute the exogui.command file to launch the frontend. You will be presented with a list of all included games.
The website for exogui can be found at https://github.com/margorski/exodos-launcher/. At this time, jelcynek is looking for volunteers to help in the development of the frontend. If you are interested, please reach out to him in the #linux_port_for_nerds channel of our Discord.
The first time you attempt to run a game it will ask if you want to install it. Subsequent runs will directly launch the game.
Initial install may take some time depending on the size (a few of these games are upwards of 8 CDs!). During install you will be prompted to choose whether or not to enforce aspect ratio, full screen or windowed mode, and if you would like to apply a scaler. Scalers can smooth pixels, making older pixelated games look a bit more modern. The default setting is normal2x.
If you run the install file a second time, it will ask if you would like to uninstall the game. Choosing "yes" will erase the installed files from your disk, but keep the original ZIP file. You will be given an option to keep your saved games. If you choose not to uninstall the game you will get the chance to choose full screen or windowed again and another opportunity to change the scaler.
To launch a game or its setup from exogui, click on the game to select it, and then click on the 'Install', 'Play', or 'Setup' button in the right-hand pane.

Creating Desktop Shortcuts

If you would like to create a desktop shortcut to a specific game, open a plain text editor, such as gedit or kate, and create a file with the .desktop extension and the following contents, making changes to the Exec, Icon, and Name lines as appropriate:
[Desktop Entry]
Encoding=UTF-8
Version=1.0
Type=Application
Terminal=false
Exec="/home/username/eXoDOS/eXo/eXoDOS/!dos/mi1/Secret of Monkey Island, The (1990).command"
Icon=/usr/share/icons/Some Monkey Island Icon.png
Name[EN_US]=Secret of Monkey Island
Name=Secret of Monkey Island

Changelog

Changes to the eXoDOS 6.04 Linux Patch

  • Launch scripts directly from any file-manager: Files ending in the *.command extension can be launched directly from any file manager.
  • Revamped dependency installer with update support: For many distributions, sudo access is no longer needed.
  • Improved compatibility: The eXoDOS Linux patch will now run on virtually any x86_64 distro with flatpak support, including the Steam Deck.
  • Improved frontend: The exogui frontend is now feature packed with full support for extras, filters, images, playlists, and videos.
  • Improved backend: The backend has been completely revamped to include all eXoDOS 6 features.
  • Bug Squash: Hundreds of previously broken games have been fixed after thorough testing

Files

eXoDOS 6.4 Linux Patch.zip

eXoDOS 6.4 Linux Patch.zip contains the following files and directories:
├── Content
│   ├── !DOS_linux_metadata.zip
│   └── XODOS_linux_Metadata.zip
├── eXo
│   └── util
│       ├── eXoMerge.bsh
│       ├── install_dependencies.bsh
│       ├── Setup eXoDOS.bsh
│       └── utilDOS_linux.zip
├── eXoDOS Linux ReadMe.txt
├── eXoMerge.command
├── install_dependencies.command
└── Setup eXoDOS.command
This builds upon the existing file and directory structure of eXoDOS.
  • Content/!DOS_linux_metadata.zip - This contains DOSBox configuration files as well as the launcher and setup files (bsh, command, conf) for games.
  • Content/XODOS_linux_Metadata.zip - This contains the exogui files and some xml scripts.
  • eXo/util/eXoMerge.bsh - This is a support file for eXoMerge.command.
  • eXo/util/install_dependencies.bsh - This is a support file for install_dependencies.command.
  • eXo/util/Setup eXoDOS.bsh - This is a support file for Setup eXoDOS.command.
  • eXo/util/utilDOS_linux.zip - This contains the eXoDOS Linux backend files.
  • eXoMerge.command - This script is used to help merge two eXo collections that have already been installed.
  • install_dependencies.command - This launches the Linux/macOS setup to install system dependencies needed for eXo collections.
  • Setup eXoDOS.command - This launches the Linux/macOS setup for eXoDOS. While you cannot currently run eXoDOS on macOS, you can still install it for other systems.

util_linux.zip

util_linux.zip contents:
  • !english/texts_linux.txt - support file for the eXoDOS Updater
  • !languagepacks/Alternate Launcher.bsh - language pack support file for Linux alternate launcher (called by bsh script in the game Extras directory)
  • !languagepacks/Alternate Launcher.msh - language pack support file for macOS alternate launcher (called by msh script in the game Extras directory)
  • !languagepacks/install.bsh - language pack support file for Linux game installer (called by bsh script in game directory)
  • !languagepacks/install.msh - language pack support file for macOS game installer (called by msh script in game directory)
  • !languagepacks/ip.bsh - language pack support file to determine IP address for multiplayer games in Linux (called by the launch.bsh script in the same directory)
  • !languagepacks/ip.msh - language pack support file to determine IP address for multiplayer games in macOS (called by the launch.msh script in the same directory)
  • !languagepacks/launch.bsh - language pack support file to launch games in Linux (called by the <game name>.bsh script in the game directory)
  • !languagepacks/launch.msh - language pack support file to launch games in macOS (called by the <game name>.msh script in the game directory)
  • Sumatra/CallSumatra.bsh - Linux support file for CallSumatra.command
  • Sumatra/CallSumatra.command - exogui calls this to launch Sumatra for magazine articles in Linux
  • AltLauncher.bsh - support file for Linux alternate launcher (called by bsh script in the game Extras directory)
  • AltLauncher.msh - support file for macOS alternate launcher (called by msh script in the game Extras directory)
  • EXTDOS_linux.zip - contains Linux flatpaks, update files, AppImages, and emulator support files (bak, bsh, command, conf, txt)
  • alt_dosbox_linux.txt - defines the command to launch DOSBox for the alternate launcher (must be DOSBox Staging to not break conf files)
  • alt_launch_linux.txt - defines the directory containing the DOSBox Staging resource folder used by eXoDOS for the alternate launcher
  • converter.bash - support file for regenerate.bash that converts bat files to bash files using a long series of substitution commands
  • dosbox_linux.txt - defines what version of DOSBox is used by each game in Linux
  • eXoLBpm_linux.py - The LaunchBox Parents.xml merging tool for Linux
  • eXoLPLBXMLedit_linux.py - The eXoDOS Language Pack LaunchBox XML edit tool for Linux
  • eXoLPPPM_linux.py - The eXoDOS Language Pack Playlist Parents Merger tool for Linux
  • exodos.png - png file that can be used as a custom icon in Steam
  • exodosvi_cover.jpg - Box art image that can be used as a custom background in Steam
  • install.bsh - support file for Linux game install scripts (gets called by the install.bsh script in the game directory)
  • install.msh - support file for macOS game install scripts (gets called by the install.msh script in the game directory)
  • ip.bsh - support file to determine IP address for multiplayer games in Linux (called by the launch.bsh script in the same directory)
  • ip.msh - support file to determine IP address for multiplayer games in macOS (called by the launch.msh script in the same directory)
  • launch.bsh - support file to launch games in Linux (called by the <game name>.bsh script in the game directory)
  • launch.msh - support file to launch games in macOS (called by the <game name>.msh script in the game directory)
  • regenerate.bash - location sensitive development script used to convert unzipped files from eXo collections to Linux and macOS
  • version.bsh - Linux support file for version.command
  • version.command - This tells the currently installed version of eXoDOS
  • version.msh - macOS support file for version.command

Content/DOS_linux_Magazines.zip - Linux supplement for the Media Pack - This contains Linux DOSBox configuration, launcher, and cue files related to magazines and disk magazines (bat, bsh, command, conf, cue).

Development Scripts

Note: For the rest of this document, files will be described using their locations after installing eXoDOS.

eXo/util/converter.bash

The converter.bash script contains the convertScript function, which, when called, will attempt to convert a file's batch code to bash. The file that the convertScript function is ran against is determined by a variable, $currentScript. Note that the converter.bash script is not meant to be executed directly.
To prevent direct execution, the converter.bash script checks that a variable, $hideMessage, has a value of true. Note that even when $hideMessage = true, executing converter.bash does not automatically call the convertScript function. Instead, the source command should be ran against converter.bash to bring the convertScript function into the shell session's memory. Then, assuming the value of $currentScript has been set, the convertScript function should be called.
Example use where bat files in a directory called filesToConvert:
hideMessage='true'
. eXo/util/converter.bash
for file in filesToConvert/*.bat
do
    cp "$file" "${file%.bat}.bsh"
done
chmod +x filesToConvert/*.bsh
for currentScript in filesToConvert/*.bsh
do
    convertScript
done
Normally, the converter.bash script is called by the regenerate.bash script. Details about those scripts will be described later in this document. These scripts are intended for development purposes, and changes periodically have to be made to them to handle any conversions that do not succeed. This could involve anything from fixing case inconsistencies to parsing batch code that was written in an unforeseen way.
convertScript Function
The convertScript function runs a series of sed, ed, and Perl commands to convert a file from batch to bash. As this is a very complex text manipulation process, the order of each command is critically important. It is heavily recommended to add any new substitution commands close to the bottom of the function. Each subsequent text manipulation command may search for and change something that was previously altered, but not yet in a final state. If any existing text manipulation commands are changed or new ones added, everything needs to be very carefully audited. Edge cases are everywhere.
Example code snippet from the convertScript function:
    #escape backslashes in all echoes, change \ to / after the redirects
    sed -i -e '/^echo.*\\/{
                   s|#|##|g;
                   s|\\|/#|g;
                   :a;
                   s|^\(echo.*>.*\)/#\(.*\)|\1/\2|;
                   ta;
                   s|/#|\\\\|g;
                   s|##|#|g;
               }' "$currentScript"

    #escape quotes on echoes without redirects
    sed -i -e "/^echo/{ />/! s/\"/\\\\\"/g }" "$currentScript"
               
    #add a double quote to the beginning of echoes
    sed -i -e "s/^echo /echo \"/" "$currentScript"
    
    #add a double quote to the end of echoes without redirects
    sed -i -e "/^echo/{ />/!s/.$/\"/ }" "$currentScript"
    
    #ensure echo redirects are preceded by spaces
    sed -i -e "/^echo/ {/[^[:space:]]>>/ s/>>/ >>/;}" "$currentScript"
    sed -i -e "/^echo.*[^[:space:]]>/{ />>/! s/>/ >/;}" "$currentScript" 
    
    #add a double quote to the end of echoes with redirects
    sed -i -e "/^echo/ s/ >>/\" >> /" "$currentScript"
    sed -i -e "/^echo.*>/{ />>/! s/ >/\" > /;}" "$currentScript"
    
    #escape all $ characters
    sed -i -e "s/\\$/\\\\$/g" "$currentScript"
    
    #make all occurrences of goto lowercase except on echo and comment lines
    sed -i -e '/^echo\|^#/!s/goto/goto/gI' "$currentScript"
    
    #change all occurrences of GOTO to goto only after echo redirections
    sed -i -e '/^echo.*>.*GOTO/ {
                   s/#/##/g;
                   s/GOTO/goto#/g;
                   :a;
                   s/^\(echo.*>.*\)goto#\(.*\)/\1goto\2/;
                   ta;
                   s/goto#/GOTO/g;
                   s/##/#/g;
               }' "$currentScript"
As shown in the above code snippet, comments are used to tell what every text manipulation operation does. This is necessary to ensure that the script continues to be maintainable.
Note: When doing a systematic conversion of the eXoDOS collection, it is important to remember that the convertScript function is ran against every batch file in eXoDOS, with the exception of those in game archives (e.g. run.bat). Additional game specific text manipulations are written in the regenerate.bash script.

eXo/util/regenerate.bash

The purpose of the regenerate.bash script is to assist in the development of future Linux and macOS patches by automating the conversion of config files and Windows batch files to their Linux and macOS equivalents. This script is not intended for end-users. As new versions of eXoDOS come out, both the regenerate.bash script as well as the converter.bash will need to be altered. It is impossible to predict how the Windows batch files will be written. It is very common for eXo to do some extremely complex operations in batch files that can make updating these scripts very challenging. Version 6 added much more complexity to eXoDOS than had ever previously existed. As a result, from version 5 to version 6, these files grew over 5 and a half times in size and complexity. As time goes on, new challenges are likely to be faced for maintaining these scripts.
The regenerate.bash script first checks that the eXoDOS files are in the correct location in relation to it. Next, it loads the convertScript function into memory, and converts all of the unzipped bat, conf, and other known support files. As case inconsistencies are found, substitutions to correct the inconsistencies are manually placed into the regenerate.bash script.
Most text manipulation for the above steps is done through sed commands, although there are a few situations where ed and Perl are used instead.
In short, when executing the regenerate.bash script, it goes through the following steps:
  1. Gives a disclaimer that running the script will take a VERY long time
  2. Checks that standard eXo files are located in their expected locations in relation to the script
  3. Fixes zip archive references
  4. Fixes batch file reference inconsistencies
  5. Copies bat files to newly created bsh files
  6. Prepares bsh files for conversion
  7. Converts syntax for the Linux shell files (bsh) from Windows batch to bash
  8. Removes unnecessary dependency checks for eXoDREAMM and eXoScummVM
  9. Creates universal launch files for Linux and macOS (command files)
  10. Fixes dosbox.conf typos with known solutions
  11. Fixes dosbox.conf file and directory reference inconsistencies
  12. Creates DOSBox configuration files for Linux
  13. Makes necessary changes to Linux configuration files
  14. Applies Linux-only backend fixes
  15. Applies Linux-only game specific fixes
  16. Converts shell script reference txt files
  17. Prepares macOS shell files (this step is currently skipped for eXoDOS, eXoScummVM, and eXoWin3x)
  18. Corrects xml inconsistencies with known solutions
  19. Removes unnecessary files
Note: All of the case inconsistency fixes and game specific changes are manually added to the regenerate.bash script. There is no magic voodoo code to determine what needs to be changed to make each game work correctly.

Linux Flatpaks

The following flatpaks use org.freedesktop.Platform 24.08:
  • com.retro_exo.aria2c
  • com.retro_exo.dosbox-staging-081-2
  • com.retro_exo.dosbox-x-08220
  • com.retro_exo.dosbox-x-20240701
  • com.retro_exo.gzdoom-4-11-3
  • com.retro_exo.mcomix
  • com.retro_exo.scummvm-2-2-0
  • com.retro_exo.scummvm-2-3-0-git15811-gf97bfb7ce1
The following flatpaks use org.freedesktop.Platform 23.08:
  • com.retro_exo.dosbox-074r3-1
  • com.retro_exo.dosbox-ece-r4301
  • com.retro_exo.dosbox-ece-r4358
  • com.retro_exo.dosbox-ece-r4482
  • com.retro_exo.dosbox-gridc-4-3-1
  • com.retro_exo.mpv
  • com.retro_exo.wine
The following flatpaks use org.gnome.Platform 46:
  • com.retro_exo.abiword
  • com.retro_exo.gnumeric
The following flatpaks use org.kde.Platform 6.7:
  • com.retro_exo.falkon
  • com.retro_exo.okular

Linux Update and Patch Files

The Update directory is extracted from EXTDOS_linux.zip to the eXo/Update location. It contains the scripts to run the eXoDOS updater as well as subdirectories for updates and patch files. The eXo/Update directory may initially look something like the following:
├── changelog.txt
├── cleanup.bat
├── cleanup.bsh
├── cleanup.command
├── !dos
│   └── linux
│       └── release
│           ├── Battle Isle 2 (1993).zip
│           ├── Breach 2 (1990).zip
│           ├── Carmageddon Max Pack (1998).zip
│           ├── Command and Conquer (1995).zip
│           ├── Command and Conquer - Red Alert (1996).zip
│           ├── Complete Great Naval Battles, The - The Final Fury (1996).zip
│           ├── DOOM - eXoWAD (2021).zip
│           ├── Grand Theft Auto (1997).zip
│           ├── Hard Nova (1990).zip
│           ├── Heroes of Might and Magic II (Deluxe Edition) (1998).zip
│           ├── Jane's Combat Simulations Advanced Tactical Fighters (1996).zip
│           ├── Last Half of Darkness (1989).zip
│           ├── Lemmings (1991).zip
│           ├── Lemmings 3 - All New World of Lemmings (1994).zip
│           ├── Leo the Lion (1997).zip
│           ├── Living Ball (1995).zip
│           ├── Mean 18 (1986).zip
│           ├── MechWarrior 2 (Limited Edition) (1996).zip
│           ├── NFL Challenge (1985).zip
│           ├── Normality (1996).zip
│           ├── Picture Perfect Golf (1995).zip
│           ├── Prisoner of Ice (1995).zip
│           ├── Realms of Arkania - Blade of Destiny (1992).zip
│           ├── Resurrection - Rise 2 (1996).zip
│           ├── Sigil (2019).zip
│           ├── Sigil II (2023).zip
│           ├── Star Trek - Judgement Rites CD (1993).zip
│           ├── Time Gate - Knight's Chase (1995).zip
│           ├── Ultima VI - The False Prophet (1990).zip
│           ├── Ultima V - Warriors of Destiny (1988).zip
│           └── Zone of Artificial Resources (1997).zip
├── index.txt
├── restore.exe
├── restore.py
├── update.bat
├── update.bsh
├── update.command
├── update_installed.bat
├── update_installed.bsh
├── update_installed.command
├── update.txt
├── update_xml.bat
├── update_xml.bsh
├── update_xml.command
└── ver
    └── ver.txt
Executing the update.command script will run an update for eXoDOS. This normally will be done in exogui from the eXoDOS game entry. Both the Windows version of eXoDOS and the Linux patch download the same updates. Updates work identically regardless of the operating system.
  • Files in the eXo/Update/!dos directory are for non-OS specific game file updates.
  • Files in the eXo/Update/!dos/linux/release directory are Linux specific patch files that are bundled with the eXoDOS Linux patch when you download it.
  • Files in the eXo/Update/!dos/linux directory are Linux specific update files that are downloaded as part of an eXoDOS update.
All files extracted from Linux specific archives have unique filenames to differentiate them from files that should only be used in Windows.
Files are extracted from these directories in the following order:
  1. eXo/Update/!dos
  2. eXo/Update/!dos/linux/release
  3. eXo/Update/!dos/linux

Preparing For Manual Conversion

  1. to do

Packaging Files For Release

  1. to do along with numerous other sections